[clamav-users] Mirror Load + ClamAV Updates

Tue Jun 26 21:41:16 UTC 2018

On Tue, Jun 26, 2018 at 2:17 PM, Joel Esler (jesler) <jesler at cisco.com>
wrote:

> Team --
>
> Today we were able to add 100% of the mirror infrastructure to our CDN,
> Cloudflare.  We are currently measuring the load and evaluating the
> viability and problems (if any) with this solution.  We are currently
> pushing approx 12GB a second through their Tier 1 POP locations.
>
> We are seeking feedback about the stability of this, or if any updates are
> failing.  (I have seen the thread that is currently on-going).
>
>
> If you having problems downloading from the ClamAV mirror infrastructure,
> please delete your mirrors.dat file and start over.
>

The auto-updates via FreshClam have failed 4 times since midnight (00:36,
04:36, 08:36, 12:36) this morning.

Tue Jun 26 12:37:19 2018 -> ClamAV update process started at Tue Jun 26
12:37:19 2018
Tue Jun 26 12:37:19 2018 -> Using IPv6 aware code
Tue Jun 26 12:37:19 2018 -> Querying current.cvd.clamav.net
Tue Jun 26 12:37:19 2018 -> TTL: 1780
Tue Jun 26 12:37:19 2018 -> Software version from DNS: 0.100.0
Tue Jun 26 12:37:19 2018 -> WARNING: Your ClamAV installation is OUTDATED!
Tue Jun 26 12:37:19 2018 -> WARNING: Local version: 0.99.3 Recommended
version: 0.100.0
Tue Jun 26 12:37:19 2018 -> DON'T PANIC! Read
http://www.clamav.net/documents/upgrading-clamav
Tue Jun 26 12:37:19 2018 -> main.cvd version from DNS: 58
Tue Jun 26 12:37:19 2018 -> main.cvd is up to date (version: 58, sigs:
4566249, f-level: 60, builder: sigmgr)
Tue Jun 26 12:37:19 2018 -> daily.cvd version from DNS: 24698
Tue Jun 26 12:37:19 2018 -> Retrieving http://db.local.clamav.net/daily.cvd
Tue Jun 26 12:37:20 2018 -> Ignoring mirror 104.16.185.138 (due to previous
errors)
Tue Jun 26 12:37:20 2018 -> Ignoring mirror 104.16.186.138 (due to previous
errors)
Tue Jun 26 12:37:20 2018 -> Ignoring mirror 104.16.187.138 (due to previous
errors)
Tue Jun 26 12:37:20 2018 -> Ignoring mirror 104.16.189.138 (due to previous
errors)
Tue Jun 26 12:37:20 2018 -> Ignoring mirror 104.16.188.138 (due to previous
errors)
Tue Jun 26 12:37:20 2018 -> Ignoring mirror 2400:cb00:2048:1::6810:bd8a
(due to previous errors)
Tue Jun 26 12:37:20 2018 -> Ignoring mirror 2400:cb00:2048:1::6810:b98a
(due to previous errors)
Tue Jun 26 12:37:20 2018 -> Ignoring mirror 2400:cb00:2048:1::6810:ba8a
(due to previous errors)
Tue Jun 26 12:37:20 2018 -> Ignoring mirror 2400:cb00:2048:1::6810:bb8a
(due to previous errors)
Tue Jun 26 12:37:20 2018 -> Ignoring mirror 2400:cb00:2048:1::6810:bc8a
(due to previous errors)
Tue Jun 26 12:37:20 2018 -> ERROR: Can't download daily.cvd from
db.local.clamav.net
Tue Jun 26 12:37:20 2018 -> Giving up on db.local.clamav.net...
Tue Jun 26 12:37:20 2018 -> Update failed. Your network may be down or none
of the mirrors listed in /etc/clamav/freshclam.conf is working. Check
http://www.clamav.net/doc/mirrors-faq.html for possible reasons.

Moving mirrors.dat out of the way and restarting freshclam gives the
following before giving up:

Tue Jun 26 14:33:52 2018 -> Current working dir is /var/lib/clamav
Tue Jun 26 14:33:52 2018 -> freshclam daemon 0.99.3 (OS: linux-gnu, ARCH:
x86_64, CPU: x86_64)
Tue Jun 26 14:33:52 2018 -> Max retries == 5
Tue Jun 26 14:33:52 2018 -> ClamAV update process started at Tue Jun 26
14:33:52 2018
Tue Jun 26 14:33:52 2018 -> Using IPv6 aware code
Tue Jun 26 14:33:52 2018 -> Querying current.cvd.clamav.net
Tue Jun 26 14:33:52 2018 -> TTL: 1800
Tue Jun 26 14:33:52 2018 -> Software version from DNS: 0.100.0
Tue Jun 26 14:33:52 2018 -> WARNING: Your ClamAV installation is OUTDATED!
Tue Jun 26 14:33:52 2018 -> WARNING: Local version: 0.99.3 Recommended
version: 0.100.0
Tue Jun 26 14:33:52 2018 -> DON'T PANIC! Read
http://www.clamav.net/documents/upgrading-clamav
Tue Jun 26 14:33:52 2018 -> main.cvd version from DNS: 58
Tue Jun 26 14:33:52 2018 -> main.cvd is up to date (version: 58, sigs:
4566249, f-level: 60, builder: sigmgr)
Tue Jun 26 14:33:52 2018 -> daily.cvd version from DNS: 24699
Tue Jun 26 14:33:52 2018 -> Retrieving http://db.ca.clamav.net/daily.cvd
Tue Jun 26 14:33:52 2018 -> Trying to download
http://db.ca.clamav.net/daily.cvd (IP: 104.16.189.138)
Tue Jun 26 14:33:55 2018 -> Downloading daily.cvd [100%]
Tue Jun 26 14:33:56 2018 -> WARNING: Mirror 104.16.189.138 is not
synchronized.
Tue Jun 26 14:33:56 2018 -> Querying daily.0.84.0.0.6810BD8A.ping.clamav.net
Tue Jun 26 14:33:56 2018 -> Trying again in 5 secs...
Tue Jun 26 14:34:01 2018 -> ClamAV update process started at Tue Jun 26
14:34:01 2018
Tue Jun 26 14:34:01 2018 -> Using IPv6 aware code
Tue Jun 26 14:34:01 2018 -> Querying current.cvd.clamav.net
Tue Jun 26 14:34:01 2018 -> TTL: 1791
Tue Jun 26 14:34:01 2018 -> Software version from DNS: 0.100.0
Tue Jun 26 14:34:01 2018 -> WARNING: Your ClamAV installation is OUTDATED!
Tue Jun 26 14:34:01 2018 -> WARNING: Local version: 0.99.3 Recommended
version: 0.100.0
Tue Jun 26 14:34:01 2018 -> DON'T PANIC! Read
http://www.clamav.net/documents/upgrading-clamav
Tue Jun 26 14:34:01 2018 -> main.cvd version from DNS: 58
Tue Jun 26 14:34:01 2018 -> main.cvd is up to date (version: 58, sigs:
4566249, f-level: 60, builder: sigmgr)
Tue Jun 26 14:34:01 2018 -> daily.cvd version from DNS: 24699
Tue Jun 26 14:34:01 2018 -> Retrieving http://db.ca.clamav.net/daily.cvd
Tue Jun 26 14:34:01 2018 -> Trying to download
http://db.ca.clamav.net/daily.cvd (IP: 104.16.185.138)
Tue Jun 26 14:34:04 2018 -> Downloading daily.cvd [100%]
Tue Jun 26 14:34:06 2018 -> WARNING: Mirror 104.16.185.138 is not
synchronized.
Tue Jun 26 14:34:06 2018 -> Querying daily.0.84.0.0.6810B98A.ping.clamav.net
Tue Jun 26 14:34:06 2018 -> Can't query
daily.0.84.0.0.6810B98A.ping.clamav.net
Tue Jun 26 14:34:06 2018 -> Trying again in 5 secs...
Tue Jun 26 14:34:11 2018 -> ClamAV update process started at Tue Jun 26
14:34:11 2018
Tue Jun 26 14:34:11 2018 -> Using IPv6 aware code
Tue Jun 26 14:34:11 2018 -> Querying current.cvd.clamav.net
Tue Jun 26 14:34:11 2018 -> TTL: 1781
Tue Jun 26 14:34:11 2018 -> Software version from DNS: 0.100.0
Tue Jun 26 14:34:11 2018 -> WARNING: Your ClamAV installation is OUTDATED!
Tue Jun 26 14:34:11 2018 -> WARNING: Local version: 0.99.3 Recommended
version: 0.100.0
Tue Jun 26 14:34:11 2018 -> DON'T PANIC! Read
http://www.clamav.net/documents/upgrading-clamav
Tue Jun 26 14:34:11 2018 -> main.cvd version from DNS: 58
Tue Jun 26 14:34:11 2018 -> main.cvd is up to date (version: 58, sigs:
4566249, f-level: 60, builder: sigmgr)
Tue Jun 26 14:34:11 2018 -> daily.cvd version from DNS: 24699
Tue Jun 26 14:34:11 2018 -> Retrieving http://db.ca.clamav.net/daily.cvd
Tue Jun 26 14:34:11 2018 -> Trying to download
http://db.ca.clamav.net/daily.cvd (IP: 104.16.187.138)
Tue Jun 26 14:34:13 2018 -> Downloading daily.cvd [100%]
Tue Jun 26 14:34:15 2018 -> WARNING: Mirror 104.16.187.138 is not
synchronized.
Tue Jun 26 14:34:15 2018 -> Querying daily.0.84.0.0.6810BB8A.ping.clamav.net
Tue Jun 26 14:34:15 2018 -> Can't query
daily.0.84.0.0.6810BB8A.ping.clamav.net
Tue Jun 26 14:34:15 2018 -> Trying again in 5 secs...
Tue Jun 26 14:34:20 2018 -> ClamAV update process started at Tue Jun 26
14:34:20 2018
Tue Jun 26 14:34:20 2018 -> Using IPv6 aware code
Tue Jun 26 14:34:20 2018 -> Querying current.cvd.clamav.net
Tue Jun 26 14:34:20 2018 -> TTL: 1772
Tue Jun 26 14:34:20 2018 -> Software version from DNS: 0.100.0
Tue Jun 26 14:34:20 2018 -> WARNING: Your ClamAV installation is OUTDATED!
Tue Jun 26 14:34:20 2018 -> WARNING: Local version: 0.99.3 Recommended
version: 0.100.0
Tue Jun 26 14:34:20 2018 -> DON'T PANIC! Read
http://www.clamav.net/documents/upgrading-clamav
Tue Jun 26 14:34:20 2018 -> main.cvd version from DNS: 58
Tue Jun 26 14:34:20 2018 -> main.cvd is up to date (version: 58, sigs:
4566249, f-level: 60, builder: sigmgr)
Tue Jun 26 14:34:20 2018 -> daily.cvd version from DNS: 24699
Tue Jun 26 14:34:20 2018 -> Retrieving http://db.ca.clamav.net/daily.cvd
Tue Jun 26 14:34:20 2018 -> Ignoring mirror 104.16.185.138 (due to previous
errors)
Tue Jun 26 14:34:20 2018 -> Trying host db.ca.clamav.net (104.16.188.138)...
Tue Jun 26 14:34:20 2018 -> Trying to download
http://db.ca.clamav.net/daily.cvd (IP: 104.16.188.138)
Tue Jun 26 14:34:22 2018 -> Downloading daily.cvd [100%]
Tue Jun 26 14:34:24 2018 -> WARNING: Mirror 104.16.188.138 is not
synchronized.
Tue Jun 26 14:34:24 2018 -> Querying daily.0.84.0.0.6810BC8A.ping.clamav.net
Tue Jun 26 14:34:24 2018 -> Trying again in 5 secs...
Tue Jun 26 14:34:29 2018 -> ClamAV update process started at Tue Jun 26
14:34:29 2018
Tue Jun 26 14:34:29 2018 -> Using IPv6 aware code
Tue Jun 26 14:34:29 2018 -> Querying current.cvd.clamav.net
Tue Jun 26 14:34:29 2018 -> TTL: 1763
Tue Jun 26 14:34:29 2018 -> Software version from DNS: 0.100.0
Tue Jun 26 14:34:29 2018 -> WARNING: Your ClamAV installation is OUTDATED!
Tue Jun 26 14:34:29 2018 -> WARNING: Local version: 0.99.3 Recommended
version: 0.100.0
Tue Jun 26 14:34:29 2018 -> DON'T PANIC! Read
http://www.clamav.net/documents/upgrading-clamav
Tue Jun 26 14:34:29 2018 -> main.cvd version from DNS: 58
Tue Jun 26 14:34:29 2018 -> main.cvd is up to date (version: 58, sigs:
4566249, f-level: 60, builder: sigmgr)
Tue Jun 26 14:34:29 2018 -> daily.cvd version from DNS: 24699
Tue Jun 26 14:34:29 2018 -> Retrieving http://db.ca.clamav.net/daily.cvd
Tue Jun 26 14:34:29 2018 -> Ignoring mirror 104.16.187.138 (due to previous
errors)
Tue Jun 26 14:34:29 2018 -> Ignoring mirror 104.16.189.138 (due to previous
errors)
Tue Jun 26 14:34:29 2018 -> Ignoring mirror 104.16.188.138 (due to previous
errors)
Tue Jun 26 14:34:29 2018 -> Ignoring mirror 104.16.185.138 (due to previous
errors)
Tue Jun 26 14:34:29 2018 -> Trying host db.ca.clamav.net (104.16.186.138)...
Tue Jun 26 14:34:29 2018 -> Trying to download
http://db.ca.clamav.net/daily.cvd (IP: 104.16.186.138)
Tue Jun 26 14:34:32 2018 -> Downloading daily.cvd [100%]
Tue Jun 26 14:34:33 2018 -> WARNING: Mirror 104.16.186.138 is not
synchronized.
Tue Jun 26 14:34:33 2018 -> Querying daily.0.84.0.0.6810BA8A.ping.clamav.net
Tue Jun 26 14:34:33 2018 -> Can't query
daily.0.84.0.0.6810BA8A.ping.clamav.net
Tue Jun 26 14:34:33 2018 -> Giving up on db.ca.clamav.net...
Tue Jun 26 14:34:33 2018 -> ClamAV update process started at Tue Jun 26
14:34:33 2018
Tue Jun 26 14:34:33 2018 -> Using IPv6 aware code
Tue Jun 26 14:34:33 2018 -> Querying current.cvd.clamav.net
Tue Jun 26 14:34:33 2018 -> TTL: 1759
Tue Jun 26 14:34:33 2018 -> Software version from DNS: 0.100.0
Tue Jun 26 14:34:33 2018 -> WARNING: Your ClamAV installation is OUTDATED!
Tue Jun 26 14:34:33 2018 -> WARNING: Local version: 0.99.3 Recommended
version: 0.100.0
Tue Jun 26 14:34:33 2018 -> DON'T PANIC! Read
http://www.clamav.net/documents/upgrading-clamav
Tue Jun 26 14:34:33 2018 -> main.cvd version from DNS: 58
Tue Jun 26 14:34:33 2018 -> main.cvd is up to date (version: 58, sigs:
4566249, f-level: 60, builder: sigmgr)
Tue Jun 26 14:34:33 2018 -> daily.cvd version from DNS: 24699
Tue Jun 26 14:34:33 2018 -> Retrieving http://db.local.clamav.net/daily.cvd
Tue Jun 26 14:34:33 2018 -> Ignoring mirror 104.16.187.138 (due to previous
errors)
Tue Jun 26 14:34:33 2018 -> Ignoring mirror 104.16.188.138 (due to previous
errors)
Tue Jun 26 14:34:33 2018 -> Ignoring mirror 104.16.185.138 (due to previous
errors)
Tue Jun 26 14:34:33 2018 -> Ignoring mirror 104.16.189.138 (due to previous
errors)
Tue Jun 26 14:34:33 2018 -> Ignoring mirror 104.16.186.138 (due to previous
errors)
Tue Jun 26 14:34:33 2018 -> Trying host db.local.clamav.net
(2400:cb00:2048:1::6810:ba8a)...
Tue Jun 26 14:34:33 2018 -> nonblock_connect: connect(): fd=4 errno=101:
Network is unreachable
Tue Jun 26 14:34:33 2018 -> Can't connect to port 80 of host
db.local.clamav.net (IP: 2400:cb00:2048:1::6810:ba8a)
Tue Jun 26 14:34:33 2018 -> Trying host db.local.clamav.net
(2400:cb00:2048:1::6810:bb8a)...
Tue Jun 26 14:34:33 2018 -> nonblock_connect: connect(): fd=4 errno=101:
Network is unreachable
Tue Jun 26 14:34:33 2018 -> Can't connect to port 80 of host
db.local.clamav.net (IP: 2400:cb00:2048:1::6810:bb8a)
Tue Jun 26 14:34:33 2018 -> Trying host db.local.clamav.net
(2400:cb00:2048:1::6810:bc8a)...
Tue Jun 26 14:34:33 2018 -> nonblock_connect: connect(): fd=4 errno=101:
Network is unreachable
Tue Jun 26 14:34:33 2018 -> Can't connect to port 80 of host
db.local.clamav.net (IP: 2400:cb00:2048:1::6810:bc8a)
Tue Jun 26 14:34:33 2018 -> Trying host db.local.clamav.net
(2400:cb00:2048:1::6810:bd8a)...
Tue Jun 26 14:34:33 2018 -> nonblock_connect: connect(): fd=4 errno=101:
Network is unreachable
Tue Jun 26 14:34:33 2018 -> Can't connect to port 80 of host
db.local.clamav.net (IP: 2400:cb00:2048:1::6810:bd8a)
Tue Jun 26 14:34:33 2018 -> Trying host db.local.clamav.net
(2400:cb00:2048:1::6810:b98a)...
Tue Jun 26 14:34:33 2018 -> nonblock_connect: connect(): fd=4 errno=101:
Network is unreachable
Tue Jun 26 14:34:33 2018 -> Can't connect to port 80 of host
db.local.clamav.net (IP: 2400:cb00:2048:1::6810:b98a)
Tue Jun 26 14:34:33 2018 -> ERROR: Can't download daily.cvd from
db.local.clamav.net
Tue Jun 26 14:34:33 2018 -> Giving up on db.local.clamav.net...
Tue Jun 26 14:34:33 2018 -> Update failed. Your network may be down or none
of the mirrors listed in /etc/clamav/freshclam.conf is working. Check
http://www.clamav.net/doc/mirrors-faq.html for possible reasons.

The interesting bit is the "Tue Jun 26 14:39:19 2018 -> WARNING: Mirror
104.16.188.138 is not synchronized" line.

Changing freshclam.conf to use "DatabaseMirror database.clamav.net" doesn't
change anything (it's normally set to db.ca.clamav.net).

main.cvd     is dated June  7
daily.cvd    is dated June 25
mbl.ndb      is dated June 26
bytecode.cvd is dated June 22

This is on Debian 8 which is why the ClamAV version is a little behind.

-- 
Freddie Cash
fjwcash at gmail.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.clamav.net/pipermail/clamav-users/attachments/20180626/625a3532/attachment.htm>