[clamav-users] Mirror issues and what we are doing to fix it

Wed Aug 30 13:15:15 UTC 2017

On Wednesday 30 August 2017 08:48:42 Joel Esler (jesler) wrote:

> Gene,
>
> Thanks.  I’ll give this to the ops team.

I had a total failure at 18:00 EDT last night:
=============
Tue Aug 29 18:02:04 2017 -> Received signal: wake up
Tue Aug 29 18:02:04 2017 -> ClamAV update process started at Tue Aug 29 18:02:04 2017
Tue Aug 29 18:02:04 2017 -> main.cld is up to date (version: 58, sigs: 4566249, f-level: 60, builder: sigmgr)
Tue Aug 29 18:02:35 2017 -> nonblock_recv: recv timing out (30 secs)
Tue Aug 29 18:02:35 2017 -> WARNING: getfile: Error while reading database from db.us.clamav.net (IP: 150.214.142.197): Operation 
now in progress
Tue Aug 29 18:02:35 2017 -> WARNING: getpatch: Can't download daily-23735.cdiff from db.us.clamav.net
Tue Aug 29 18:03:08 2017 -> Downloading daily-23735.cdiff [100%]
Tue Aug 29 18:03:39 2017 -> nonblock_recv: recv timing out (30 secs)
Tue Aug 29 18:03:39 2017 -> WARNING: getfile: Error while reading database from db.us.clamav.net (IP: 200.236.31.1): Operation now 
in progress
Tue Aug 29 18:03:39 2017 -> WARNING: getpatch: Can't download daily-23736.cdiff from db.us.clamav.net
Tue Aug 29 18:04:09 2017 -> nonblock_connect: connect timing out (30 secs)
Tue Aug 29 18:04:09 2017 -> Can't connect to port 80 of host db.us.clamav.net (IP: 155.98.64.87)
Tue Aug 29 18:04:09 2017 -> Trying host db.us.clamav.net (204.130.133.50)...
Tue Aug 29 18:04:39 2017 -> nonblock_connect: connect timing out (30 secs)
Tue Aug 29 18:04:39 2017 -> Can't connect to port 80 of host db.us.clamav.net (IP: 204.130.133.50)
Tue Aug 29 18:04:39 2017 -> Trying host db.us.clamav.net (69.12.162.28)...
Tue Aug 29 18:05:09 2017 -> nonblock_connect: connect timing out (30 secs)
Tue Aug 29 18:05:09 2017 -> Can't connect to port 80 of host db.us.clamav.net (IP: 69.12.162.28)
Tue Aug 29 18:05:09 2017 -> Trying host db.us.clamav.net (194.8.197.22)...
Tue Aug 29 18:05:10 2017 -> WARNING: getfile: daily-23736.cdiff not found on db.us.clamav.net (IP: 194.8.197.22)
Tue Aug 29 18:05:10 2017 -> WARNING: getpatch: Can't download daily-23736.cdiff from db.us.clamav.net
Tue Aug 29 18:05:11 2017 -> Trying host db.us.clamav.net (150.214.142.197)...
Tue Aug 29 18:05:18 2017 -> WARNING: getfile: Error while reading database from db.us.clamav.net (IP: 150.214.142.197): Operation 
now in progress
Tue Aug 29 18:05:18 2017 -> WARNING: getpatch: Can't download daily-23736.cdiff from db.us.clamav.net
Tue Aug 29 18:05:18 2017 -> Trying host db.us.clamav.net (69.163.100.14)...
Tue Aug 29 18:05:48 2017 -> nonblock_connect: connect timing out (30 secs)
Tue Aug 29 18:05:48 2017 -> Can't connect to port 80 of host db.us.clamav.net (IP: 69.163.100.14)
Tue Aug 29 18:05:48 2017 -> Trying host db.us.clamav.net (198.148.78.4)...
Tue Aug 29 18:05:54 2017 -> WARNING: getfile: Error while reading database from db.us.clamav.net (IP: 198.148.78.4): Operation now 
in progress
Tue Aug 29 18:05:54 2017 -> WARNING: getpatch: Can't download daily-23736.cdiff from db.us.clamav.net
Tue Aug 29 18:05:54 2017 -> Trying host db.us.clamav.net (198.148.78.4)...
Tue Aug 29 18:06:04 2017 -> WARNING: getfile: daily-23736.cdiff not found on db.us.clamav.net (IP: 198.148.78.4)
Tue Aug 29 18:06:04 2017 -> WARNING: getpatch: Can't download daily-23736.cdiff from db.us.clamav.net
Tue Aug 29 18:06:04 2017 -> WARNING: Incremental update failed, trying to download daily.cvd
Tue Aug 29 18:07:03 2017 -> nonblock_recv: recv timing out (30 secs)
Tue Aug 29 18:07:03 2017 -> WARNING: getfile: Download interrupted: Operation now in progress (IP: 194.8.197.22)
Tue Aug 29 18:07:03 2017 -> WARNING: Can't download daily.cvd from db.us.clamav.net
Tue Aug 29 18:07:03 2017 -> Trying again in 5 secs...
Tue Aug 29 18:07:08 2017 -> ClamAV update process started at Tue Aug 29 18:07:08 2017
Tue Aug 29 18:07:08 2017 -> main.cld is up to date (version: 58, sigs: 4566249, f-level: 60, builder: sigmgr)
Tue Aug 29 18:07:08 2017 -> Trying host db.us.clamav.net (198.148.78.4)...
Tue Aug 29 18:07:21 2017 -> Downloading daily-23735.cdiff [100%]
Tue Aug 29 18:07:27 2017 -> WARNING: getfile: Error while reading database from db.us.clamav.net (IP: 198.148.78.4): Operation now 
in progress
Tue Aug 29 18:07:27 2017 -> WARNING: getpatch: Can't download daily-23736.cdiff from db.us.clamav.net
Tue Aug 29 18:07:58 2017 -> nonblock_connect: connect timing out (30 secs)
Tue Aug 29 18:07:58 2017 -> Can't connect to port 80 of host db.us.clamav.net (IP: 204.130.133.50)
Tue Aug 29 18:07:58 2017 -> Trying host db.us.clamav.net (69.12.162.28)...
Tue Aug 29 18:08:28 2017 -> nonblock_connect: connect timing out (30 secs)
Tue Aug 29 18:08:28 2017 -> Can't connect to port 80 of host db.us.clamav.net (IP: 69.12.162.28)
Tue Aug 29 18:08:28 2017 -> Trying host db.us.clamav.net (155.98.64.87)...
Tue Aug 29 18:08:28 2017 -> WARNING: getfile: daily-23736.cdiff not found on db.us.clamav.net (IP: 155.98.64.87)
Tue Aug 29 18:08:28 2017 -> WARNING: getpatch: Can't download daily-23736.cdiff from db.us.clamav.net
Tue Aug 29 18:08:28 2017 -> Trying host db.us.clamav.net (69.163.100.14)...
Tue Aug 29 18:08:59 2017 -> nonblock_recv: recv timing out (30 secs)
Tue Aug 29 18:08:59 2017 -> WARNING: getfile: Error while reading database from db.us.clamav.net (IP: 69.163.100.14): Operation now 
in progress
Tue Aug 29 18:08:59 2017 -> WARNING: getpatch: Can't download daily-23736.cdiff from db.us.clamav.net
Tue Aug 29 18:08:59 2017 -> WARNING: getpatch: Can't download daily-23736.cdiff from db.us.clamav.net
Tue Aug 29 18:08:59 2017 -> WARNING: getpatch: Can't download daily-23736.cdiff from db.us.clamav.net
Tue Aug 29 18:08:59 2017 -> WARNING: Incremental update failed, trying to download daily.cvd
Tue Aug 29 18:09:29 2017 -> nonblock_connect: connect timing out (30 secs)
Tue Aug 29 18:09:29 2017 -> Can't connect to port 80 of host db.us.clamav.net (IP: 204.130.133.50)
Tue Aug 29 18:09:29 2017 -> Trying host db.us.clamav.net (69.12.162.28)...
Tue Aug 29 18:09:59 2017 -> nonblock_connect: connect timing out (30 secs)
Tue Aug 29 18:09:59 2017 -> Can't connect to port 80 of host db.us.clamav.net (IP: 69.12.162.28)
Tue Aug 29 18:09:59 2017 -> Trying host db.us.clamav.net (194.8.197.22)...
Tue Aug 29 18:11:09 2017 -> nonblock_recv: recv timing out (30 secs)
Tue Aug 29 18:11:09 2017 -> WARNING: getfile: Download interrupted: Operation now in progress (IP: 194.8.197.22)
Tue Aug 29 18:11:09 2017 -> WARNING: Can't download daily.cvd from db.us.clamav.net
Tue Aug 29 18:11:09 2017 -> Trying again in 5 secs...
Tue Aug 29 18:11:14 2017 -> ClamAV update process started at Tue Aug 29 18:11:14 2017
Tue Aug 29 18:11:14 2017 -> main.cld is up to date (version: 58, sigs: 4566249, f-level: 60, builder: sigmgr)
Tue Aug 29 18:11:14 2017 -> Trying host db.us.clamav.net (155.98.64.87)...
Tue Aug 29 18:11:15 2017 -> Downloading daily-23735.cdiff [100%]
Tue Aug 29 18:11:15 2017 -> WARNING: getfile: daily-23736.cdiff not found on db.us.clamav.net (IP: 155.98.64.87)
Tue Aug 29 18:11:15 2017 -> WARNING: getpatch: Can't download daily-23736.cdiff from db.us.clamav.net
Tue Aug 29 18:11:15 2017 -> WARNING: getpatch: Can't download daily-23736.cdiff from db.us.clamav.net
Tue Aug 29 18:11:15 2017 -> WARNING: getpatch: Can't download daily-23736.cdiff from db.us.clamav.net
Tue Aug 29 18:11:15 2017 -> WARNING: getpatch: Can't download daily-23736.cdiff from db.us.clamav.net
Tue Aug 29 18:11:15 2017 -> WARNING: getpatch: Can't download daily-23736.cdiff from db.us.clamav.net
Tue Aug 29 18:11:16 2017 -> WARNING: Incremental update failed, trying to download daily.cvd
Tue Aug 29 18:11:16 2017 -> Trying host db.us.clamav.net (155.98.64.87)...
Tue Aug 29 18:17:31 2017 -> Downloading daily.cvd [100%]
Tue Aug 29 18:17:33 2017 -> WARNING: Mirror 155.98.64.87 is not synchronized.
Tue Aug 29 18:17:33 2017 -> Trying again in 5 secs...
Tue Aug 29 18:17:38 2017 -> ClamAV update process started at Tue Aug 29 18:17:38 2017
Tue Aug 29 18:17:38 2017 -> main.cld is up to date (version: 58, sigs: 4566249, f-level: 60, builder: sigmgr)
Tue Aug 29 18:18:08 2017 -> nonblock_connect: connect timing out (30 secs)
Tue Aug 29 18:18:08 2017 -> Can't connect to port 80 of host db.us.clamav.net (IP: 69.12.162.28)
Tue Aug 29 18:18:08 2017 -> Trying host db.us.clamav.net (204.130.133.50)...
Tue Aug 29 18:18:38 2017 -> nonblock_connect: connect timing out (30 secs)
Tue Aug 29 18:18:38 2017 -> Can't connect to port 80 of host db.us.clamav.net (IP: 204.130.133.50)
Tue Aug 29 18:18:38 2017 -> Trying host db.us.clamav.net (194.8.197.22)...
Tue Aug 29 18:18:42 2017 -> WARNING: getfile: Error while reading database from db.us.clamav.net (IP: 194.8.197.22): Operation now 
in progress
Tue Aug 29 18:18:42 2017 -> WARNING: getpatch: Can't download daily-23735.cdiff from db.us.clamav.net
Tue Aug 29 18:18:43 2017 -> WARNING: getpatch: Can't download daily-23735.cdiff from db.us.clamav.net
Tue Aug 29 18:18:43 2017 -> WARNING: getpatch: Can't download daily-23735.cdiff from db.us.clamav.net
Tue Aug 29 18:18:43 2017 -> WARNING: getpatch: Can't download daily-23735.cdiff from db.us.clamav.net
Tue Aug 29 18:18:43 2017 -> WARNING: getpatch: Can't download daily-23735.cdiff from db.us.clamav.net
Tue Aug 29 18:18:43 2017 -> WARNING: Incremental update failed, trying to download daily.cvd
Tue Aug 29 18:18:43 2017 -> Trying host db.us.clamav.net (204.130.133.50)...
Tue Aug 29 18:19:13 2017 -> nonblock_connect: connect timing out (30 secs)
Tue Aug 29 18:19:13 2017 -> Can't connect to port 80 of host db.us.clamav.net (IP: 204.130.133.50)
Tue Aug 29 18:19:13 2017 -> Trying host db.us.clamav.net (69.12.162.28)...
Tue Aug 29 18:19:43 2017 -> nonblock_connect: connect timing out (30 secs)
Tue Aug 29 18:19:43 2017 -> Can't connect to port 80 of host db.us.clamav.net (IP: 69.12.162.28)
Tue Aug 29 18:19:43 2017 -> Trying host db.us.clamav.net (155.98.64.87)...
Tue Aug 29 18:21:50 2017 -> Downloading daily.cvd [100%]
Tue Aug 29 18:21:52 2017 -> WARNING: Mirror 155.98.64.87 is not synchronized.
Tue Aug 29 18:21:52 2017 -> Trying again in 5 secs...
Tue Aug 29 18:21:57 2017 -> ClamAV update process started at Tue Aug 29 18:21:57 2017
Tue Aug 29 18:21:57 2017 -> main.cld is up to date (version: 58, sigs: 4566249, f-level: 60, builder: sigmgr)
Tue Aug 29 18:21:57 2017 -> WARNING: getpatch: Can't download daily-23735.cdiff from db.us.clamav.net
Tue Aug 29 18:21:57 2017 -> WARNING: getpatch: Can't download daily-23735.cdiff from db.us.clamav.net
Tue Aug 29 18:21:57 2017 -> WARNING: getpatch: Can't download daily-23735.cdiff from db.us.clamav.net
Tue Aug 29 18:21:57 2017 -> WARNING: getpatch: Can't download daily-23735.cdiff from db.us.clamav.net
Tue Aug 29 18:21:57 2017 -> ERROR: getpatch: Can't download daily-23735.cdiff from db.us.clamav.net
Tue Aug 29 18:21:57 2017 -> WARNING: Incremental update failed, trying to download daily.cvd
Tue Aug 29 18:21:57 2017 -> Trying host db.us.clamav.net (155.98.64.87)...
Tue Aug 29 18:23:26 2017 -> Downloading daily.cvd [100%]
Tue Aug 29 18:23:28 2017 -> WARNING: Mirror 155.98.64.87 is not synchronized.
Tue Aug 29 18:23:29 2017 -> Giving up on db.us.clamav.net...
Tue Aug 29 18:23:29 2017 -> ClamAV update process started at Tue Aug 29 18:23:29 2017
Tue Aug 29 18:23:29 2017 -> main.cld is up to date (version: 58, sigs: 4566249, f-level: 60, builder: sigmgr)
Tue Aug 29 18:23:58 2017 -> WARNING: getfile: Error while reading database from database.clamav.net (IP: 69.12.162.28): Connection 
reset by peer
Tue Aug 29 18:23:58 2017 -> WARNING: getpatch: Can't download daily-23735.cdiff from database.clamav.net
Tue Aug 29 18:23:58 2017 -> WARNING: getpatch: Can't download daily-23735.cdiff from database.clamav.net
Tue Aug 29 18:23:58 2017 -> WARNING: getpatch: Can't download daily-23735.cdiff from database.clamav.net
Tue Aug 29 18:23:58 2017 -> WARNING: getpatch: Can't download daily-23735.cdiff from database.clamav.net
Tue Aug 29 18:23:58 2017 -> ERROR: getpatch: Can't download daily-23735.cdiff from database.clamav.net
Tue Aug 29 18:23:58 2017 -> WARNING: Incremental update failed, trying to download daily.cvd
Tue Aug 29 18:23:58 2017 -> ERROR: Can't download daily.cvd from database.clamav.net
Tue Aug 29 18:23:58 2017 -> Giving up on database.clamav.net...
Tue Aug 29 18:23:58 2017 -> Update failed. Your network may be down or none of the mirrors listed in /etc/clamav/freshclam.conf is 
working. Check http://www.clamav.net/doc/mirrors-faq.html for possible reasons.
==============

The daily wasn't anyplace.

But its worked well 2 more times since. I just assumed the dns problem 
was being adjusted when the failure occurred. Further thinking seems to
connect it to file locking while the mirrors were being updated? I think 
that is to be expected.  OTOH for that, 20 minutes does seems excessive.

In any event, the full log above might be helpfull.

[lengthy deletia]

Thanks Joel.

Cheers, Gene Heskett
-- 
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
Genes Web page <http://geneslinuxbox.net:6309/gene>