On Tue, Jun 26, 2018 at 2:17 PM, Joel Esler (jesler) <jesler@cisco.com> wrote:
Team -- 

Today we were able to add 100% of the mirror infrastructure to our CDN, Cloudflare.  We are currently measuring the load and evaluating the viability and problems (if any) with this solution.  We are currently pushing approx 12GB a second through their Tier 1 POP locations.

We are seeking feedback about the stability of this, or if any updates are failing.  (I have seen the thread that is currently on-going).


If you having problems downloading from the ClamAV mirror infrastructure, please delete your mirrors.dat file and start over.

​The auto-updates via FreshClam have failed 4 times since midnight (00:36, 04:36, 08:36, 12:36) this morning.​

Tue Jun 26 12:37:19 2018 -> ClamAV update process started at Tue Jun 26 12:37:19 2018
Tue Jun 26 12:37:19 2018 -> Using IPv6 aware code
Tue Jun 26 12:37:19 2018 -> Querying current.cvd.clamav.net
Tue Jun 26 12:37:19 2018 -> TTL: 1780
Tue Jun 26 12:37:19 2018 -> Software version from DNS: 0.100.0
Tue Jun 26 12:37:19 2018 -> WARNING: Your ClamAV installation is OUTDATED!
Tue Jun 26 12:37:19 2018 -> WARNING: Local version: 0.99.3 Recommended version: 0.100.0
Tue Jun 26 12:37:19 2018 -> DON'T PANIC! Read http://www.clamav.net/documents/upgrading-clamav
Tue Jun 26 12:37:19 2018 -> main.cvd version from DNS: 58
Tue Jun 26 12:37:19 2018 -> main.cvd is up to date (version: 58, sigs: 4566249, f-level: 60, builder: sigmgr)
Tue Jun 26 12:37:19 2018 -> daily.cvd version from DNS: 24698
Tue Jun 26 12:37:19 2018 -> Retrieving http://db.local.clamav.net/daily.cvd
Tue Jun 26 12:37:20 2018 -> Ignoring mirror 104.16.185.138 (due to previous errors)
Tue Jun 26 12:37:20 2018 -> Ignoring mirror 104.16.186.138 (due to previous errors)
Tue Jun 26 12:37:20 2018 -> Ignoring mirror 104.16.187.138 (due to previous errors)
Tue Jun 26 12:37:20 2018 -> Ignoring mirror 104.16.189.138 (due to previous errors)
Tue Jun 26 12:37:20 2018 -> Ignoring mirror 104.16.188.138 (due to previous errors)
Tue Jun 26 12:37:20 2018 -> Ignoring mirror 2400:cb00:2048:1::6810:bd8a (due to previous errors)
Tue Jun 26 12:37:20 2018 -> Ignoring mirror 2400:cb00:2048:1::6810:b98a (due to previous errors)
Tue Jun 26 12:37:20 2018 -> Ignoring mirror 2400:cb00:2048:1::6810:ba8a (due to previous errors)
Tue Jun 26 12:37:20 2018 -> Ignoring mirror 2400:cb00:2048:1::6810:bb8a (due to previous errors)
Tue Jun 26 12:37:20 2018 -> Ignoring mirror 2400:cb00:2048:1::6810:bc8a (due to previous errors)
Tue Jun 26 12:37:20 2018 -> ERROR: Can't download daily.cvd from db.local.clamav.net
Tue Jun 26 12:37:20 2018 -> Giving up on db.local.clamav.net...
Tue Jun 26 12:37:20 2018 -> Update failed. Your network may be down or none of the mirrors listed in /etc/clamav/freshclam.conf is working. Check http://www.clamav.net/doc/mirrors-faq.html for possible reasons.

​Moving mirrors.dat out of the way and restarting freshclam gives the following before giving up:

Tue Jun 26 14:33:52 2018 -> Current working dir is /var/lib/clamav
Tue Jun 26 14:33:52 2018 -> freshclam daemon 0.99.3 (OS: linux-gnu, ARCH: x86_64, CPU: x86_64)
Tue Jun 26 14:33:52 2018 -> Max retries == 5
Tue Jun 26 14:33:52 2018 -> ClamAV update process started at Tue Jun 26 14:33:52 2018
Tue Jun 26 14:33:52 2018 -> Using IPv6 aware code
Tue Jun 26 14:33:52 2018 -> Querying current.cvd.clamav.net
Tue Jun 26 14:33:52 2018 -> TTL: 1800
Tue Jun 26 14:33:52 2018 -> Software version from DNS: 0.100.0
Tue Jun 26 14:33:52 2018 -> WARNING: Your ClamAV installation is OUTDATED!
Tue Jun 26 14:33:52 2018 -> WARNING: Local version: 0.99.3 Recommended version: 0.100.0
Tue Jun 26 14:33:52 2018 -> DON'T PANIC! Read http://www.clamav.net/documents/upgrading-clamav
Tue Jun 26 14:33:52 2018 -> main.cvd version from DNS: 58
Tue Jun 26 14:33:52 2018 -> main.cvd is up to date (version: 58, sigs: 4566249, f-level: 60, builder: sigmgr)
Tue Jun 26 14:33:52 2018 -> daily.cvd version from DNS: 24699
Tue Jun 26 14:33:52 2018 -> Retrieving http://db.ca.clamav.net/daily.cvd
Tue Jun 26 14:33:52 2018 -> Trying to download http://db.ca.clamav.net/daily.cvd (IP: 104.16.189.138)
Tue Jun 26 14:33:55 2018 -> Downloading daily.cvd [100%]
Tue Jun 26 14:33:56 2018 -> WARNING: Mirror 104.16.189.138 is not synchronized.
Tue Jun 26 14:33:56 2018 -> Querying daily.0.84.0.0.6810BD8A.ping.clamav.net
Tue Jun 26 14:33:56 2018 -> Trying again in 5 secs...
Tue Jun 26 14:34:01 2018 -> ClamAV update process started at Tue Jun 26 14:34:01 2018
Tue Jun 26 14:34:01 2018 -> Using IPv6 aware code
Tue Jun 26 14:34:01 2018 -> Querying current.cvd.clamav.net
Tue Jun 26 14:34:01 2018 -> TTL: 1791
Tue Jun 26 14:34:01 2018 -> Software version from DNS: 0.100.0
Tue Jun 26 14:34:01 2018 -> WARNING: Your ClamAV installation is OUTDATED!
Tue Jun 26 14:34:01 2018 -> WARNING: Local version: 0.99.3 Recommended version: 0.100.0
Tue Jun 26 14:34:01 2018 -> DON'T PANIC! Read http://www.clamav.net/documents/upgrading-clamav
Tue Jun 26 14:34:01 2018 -> main.cvd version from DNS: 58
Tue Jun 26 14:34:01 2018 -> main.cvd is up to date (version: 58, sigs: 4566249, f-level: 60, builder: sigmgr)
Tue Jun 26 14:34:01 2018 -> daily.cvd version from DNS: 24699
Tue Jun 26 14:34:01 2018 -> Retrieving http://db.ca.clamav.net/daily.cvd
Tue Jun 26 14:34:01 2018 -> Trying to download http://db.ca.clamav.net/daily.cvd (IP: 104.16.185.138)
Tue Jun 26 14:34:04 2018 -> Downloading daily.cvd [100%]
Tue Jun 26 14:34:06 2018 -> WARNING: Mirror 104.16.185.138 is not synchronized.
Tue Jun 26 14:34:06 2018 -> Querying daily.0.84.0.0.6810B98A.ping.clamav.net
Tue Jun 26 14:34:06 2018 -> Can't query daily.0.84.0.0.6810B98A.ping.clamav.net
Tue Jun 26 14:34:06 2018 -> Trying again in 5 secs...
Tue Jun 26 14:34:11 2018 -> ClamAV update process started at Tue Jun 26 14:34:11 2018
Tue Jun 26 14:34:11 2018 -> Using IPv6 aware code
Tue Jun 26 14:34:11 2018 -> Querying current.cvd.clamav.net
Tue Jun 26 14:34:11 2018 -> TTL: 1781
Tue Jun 26 14:34:11 2018 -> Software version from DNS: 0.100.0
Tue Jun 26 14:34:11 2018 -> WARNING: Your ClamAV installation is OUTDATED!
Tue Jun 26 14:34:11 2018 -> WARNING: Local version: 0.99.3 Recommended version: 0.100.0
Tue Jun 26 14:34:11 2018 -> DON'T PANIC! Read http://www.clamav.net/documents/upgrading-clamav
Tue Jun 26 14:34:11 2018 -> main.cvd version from DNS: 58
Tue Jun 26 14:34:11 2018 -> main.cvd is up to date (version: 58, sigs: 4566249, f-level: 60, builder: sigmgr)
Tue Jun 26 14:34:11 2018 -> daily.cvd version from DNS: 24699
Tue Jun 26 14:34:11 2018 -> Retrieving http://db.ca.clamav.net/daily.cvd
Tue Jun 26 14:34:11 2018 -> Trying to download http://db.ca.clamav.net/daily.cvd (IP: 104.16.187.138)
Tue Jun 26 14:34:13 2018 -> Downloading daily.cvd [100%]
Tue Jun 26 14:34:15 2018 -> WARNING: Mirror 104.16.187.138 is not synchronized.
Tue Jun 26 14:34:15 2018 -> Querying daily.0.84.0.0.6810BB8A.ping.clamav.net
Tue Jun 26 14:34:15 2018 -> Can't query daily.0.84.0.0.6810BB8A.ping.clamav.net
Tue Jun 26 14:34:15 2018 -> Trying again in 5 secs...
Tue Jun 26 14:34:20 2018 -> ClamAV update process started at Tue Jun 26 14:34:20 2018
Tue Jun 26 14:34:20 2018 -> Using IPv6 aware code
Tue Jun 26 14:34:20 2018 -> Querying current.cvd.clamav.net
Tue Jun 26 14:34:20 2018 -> TTL: 1772
Tue Jun 26 14:34:20 2018 -> Software version from DNS: 0.100.0
Tue Jun 26 14:34:20 2018 -> WARNING: Your ClamAV installation is OUTDATED!
Tue Jun 26 14:34:20 2018 -> WARNING: Local version: 0.99.3 Recommended version: 0.100.0
Tue Jun 26 14:34:20 2018 -> DON'T PANIC! Read http://www.clamav.net/documents/upgrading-clamav
Tue Jun 26 14:34:20 2018 -> main.cvd version from DNS: 58
Tue Jun 26 14:34:20 2018 -> main.cvd is up to date (version: 58, sigs: 4566249, f-level: 60, builder: sigmgr)
Tue Jun 26 14:34:20 2018 -> daily.cvd version from DNS: 24699
Tue Jun 26 14:34:20 2018 -> Retrieving http://db.ca.clamav.net/daily.cvd
Tue Jun 26 14:34:20 2018 -> Ignoring mirror 104.16.185.138 (due to previous errors)
Tue Jun 26 14:34:20 2018 -> Trying host db.ca.clamav.net (104.16.188.138)...
Tue Jun 26 14:34:20 2018 -> Trying to download http://db.ca.clamav.net/daily.cvd (IP: 104.16.188.138)
Tue Jun 26 14:34:22 2018 -> Downloading daily.cvd [100%]
Tue Jun 26 14:34:24 2018 -> WARNING: Mirror 104.16.188.138 is not synchronized.
Tue Jun 26 14:34:24 2018 -> Querying daily.0.84.0.0.6810BC8A.ping.clamav.net
Tue Jun 26 14:34:24 2018 -> Trying again in 5 secs...
Tue Jun 26 14:34:29 2018 -> ClamAV update process started at Tue Jun 26 14:34:29 2018
Tue Jun 26 14:34:29 2018 -> Using IPv6 aware code
Tue Jun 26 14:34:29 2018 -> Querying current.cvd.clamav.net
Tue Jun 26 14:34:29 2018 -> TTL: 1763
Tue Jun 26 14:34:29 2018 -> Software version from DNS: 0.100.0
Tue Jun 26 14:34:29 2018 -> WARNING: Your ClamAV installation is OUTDATED!
Tue Jun 26 14:34:29 2018 -> WARNING: Local version: 0.99.3 Recommended version: 0.100.0
Tue Jun 26 14:34:29 2018 -> DON'T PANIC! Read http://www.clamav.net/documents/upgrading-clamav
Tue Jun 26 14:34:29 2018 -> main.cvd version from DNS: 58
Tue Jun 26 14:34:29 2018 -> main.cvd is up to date (version: 58, sigs: 4566249, f-level: 60, builder: sigmgr)
Tue Jun 26 14:34:29 2018 -> daily.cvd version from DNS: 24699
Tue Jun 26 14:34:29 2018 -> Retrieving http://db.ca.clamav.net/daily.cvd
Tue Jun 26 14:34:29 2018 -> Ignoring mirror 104.16.187.138 (due to previous errors)
Tue Jun 26 14:34:29 2018 -> Ignoring mirror 104.16.189.138 (due to previous errors)
Tue Jun 26 14:34:29 2018 -> Ignoring mirror 104.16.188.138 (due to previous errors)
Tue Jun 26 14:34:29 2018 -> Ignoring mirror 104.16.185.138 (due to previous errors)
Tue Jun 26 14:34:29 2018 -> Trying host db.ca.clamav.net (104.16.186.138)...
Tue Jun 26 14:34:29 2018 -> Trying to download http://db.ca.clamav.net/daily.cvd (IP: 104.16.186.138)
Tue Jun 26 14:34:32 2018 -> Downloading daily.cvd [100%]
Tue Jun 26 14:34:33 2018 -> WARNING: Mirror 104.16.186.138 is not synchronized.
Tue Jun 26 14:34:33 2018 -> Querying daily.0.84.0.0.6810BA8A.ping.clamav.net
Tue Jun 26 14:34:33 2018 -> Can't query daily.0.84.0.0.6810BA8A.ping.clamav.net
Tue Jun 26 14:34:33 2018 -> Giving up on db.ca.clamav.net...
Tue Jun 26 14:34:33 2018 -> ClamAV update process started at Tue Jun 26 14:34:33 2018
Tue Jun 26 14:34:33 2018 -> Using IPv6 aware code
Tue Jun 26 14:34:33 2018 -> Querying current.cvd.clamav.net
Tue Jun 26 14:34:33 2018 -> TTL: 1759
Tue Jun 26 14:34:33 2018 -> Software version from DNS: 0.100.0
Tue Jun 26 14:34:33 2018 -> WARNING: Your ClamAV installation is OUTDATED!
Tue Jun 26 14:34:33 2018 -> WARNING: Local version: 0.99.3 Recommended version: 0.100.0
Tue Jun 26 14:34:33 2018 -> DON'T PANIC! Read http://www.clamav.net/documents/upgrading-clamav
Tue Jun 26 14:34:33 2018 -> main.cvd version from DNS: 58
Tue Jun 26 14:34:33 2018 -> main.cvd is up to date (version: 58, sigs: 4566249, f-level: 60, builder: sigmgr)
Tue Jun 26 14:34:33 2018 -> daily.cvd version from DNS: 24699
Tue Jun 26 14:34:33 2018 -> Retrieving http://db.local.clamav.net/daily.cvd
Tue Jun 26 14:34:33 2018 -> Ignoring mirror 104.16.187.138 (due to previous errors)
Tue Jun 26 14:34:33 2018 -> Ignoring mirror 104.16.188.138 (due to previous errors)
Tue Jun 26 14:34:33 2018 -> Ignoring mirror 104.16.185.138 (due to previous errors)
Tue Jun 26 14:34:33 2018 -> Ignoring mirror 104.16.189.138 (due to previous errors)
Tue Jun 26 14:34:33 2018 -> Ignoring mirror 104.16.186.138 (due to previous errors)
Tue Jun 26 14:34:33 2018 -> Trying host db.local.clamav.net (2400:cb00:2048:1::6810:ba8a)...
Tue Jun 26 14:34:33 2018 -> nonblock_connect: connect(): fd=4 errno=101: Network is unreachable
Tue Jun 26 14:34:33 2018 -> Can't connect to port 80 of host db.local.clamav.net (IP: 2400:cb00:2048:1::6810:ba8a)
Tue Jun 26 14:34:33 2018 -> Trying host db.local.clamav.net (2400:cb00:2048:1::6810:bb8a)...
Tue Jun 26 14:34:33 2018 -> nonblock_connect: connect(): fd=4 errno=101: Network is unreachable
Tue Jun 26 14:34:33 2018 -> Can't connect to port 80 of host db.local.clamav.net (IP: 2400:cb00:2048:1::6810:bb8a)
Tue Jun 26 14:34:33 2018 -> Trying host db.local.clamav.net (2400:cb00:2048:1::6810:bc8a)...
Tue Jun 26 14:34:33 2018 -> nonblock_connect: connect(): fd=4 errno=101: Network is unreachable
Tue Jun 26 14:34:33 2018 -> Can't connect to port 80 of host db.local.clamav.net (IP: 2400:cb00:2048:1::6810:bc8a)
Tue Jun 26 14:34:33 2018 -> Trying host db.local.clamav.net (2400:cb00:2048:1::6810:bd8a)...
Tue Jun 26 14:34:33 2018 -> nonblock_connect: connect(): fd=4 errno=101: Network is unreachable
Tue Jun 26 14:34:33 2018 -> Can't connect to port 80 of host db.local.clamav.net (IP: 2400:cb00:2048:1::6810:bd8a)
Tue Jun 26 14:34:33 2018 -> Trying host db.local.clamav.net (2400:cb00:2048:1::6810:b98a)...
Tue Jun 26 14:34:33 2018 -> nonblock_connect: connect(): fd=4 errno=101: Network is unreachable
Tue Jun 26 14:34:33 2018 -> Can't connect to port 80 of host db.local.clamav.net (IP: 2400:cb00:2048:1::6810:b98a)
Tue Jun 26 14:34:33 2018 -> ERROR: Can't download daily.cvd from db.local.clamav.net
Tue Jun 26 14:34:33 2018 -> Giving up on db.local.clamav.net...
Tue Jun 26 14:34:33 2018 -> Update failed. Your network may be down or none of the mirrors listed in /etc/clamav/freshclam.conf is working. Check http://www.clamav.net/doc/mirrors-faq.html for possible reasons.

The interesting bit is the "Tue Jun 26 14:39:19 2018 -> WARNING: Mirror 104.16.188.138 is not synchronized" line.

Changing freshclam.conf to use "DatabaseMirror database.clamav.net" doesn't change anything (it's normally set to db.ca.clamav.net).


main.cvd     is dated June  7
daily.cvd    is dated June 25
mbl.ndb      is dated June 26
bytecode.cvd is dated June 22


​This is on Debian 8 which is why the ClamAV version is a little behind.​



--
Freddie Cash
fjwcash@gmail.com