[clamav-users] freshclam: Verification: Can't verify database integrity

[Jim Popovitch]

On Mon, 2022-12-26 at 10:14 -0500, Jim Popovitch via clamav-users wrote:
> On Mon, 2022-12-26 at 15:51 +0100, Matus UHLAR - fantomas wrote:
> > On 25.12.22 16:16, Jim Popovitch via clamav-users wrote:
> > > What the heck could be causing freshclam verification problems for the
> > > past 2 days?  I'm getting rate-limited over and over because freshclam
> > > fails to verify daily.cvd (and then retries over and over).  Is there a
> > > known problem with daily.cvd downloads being corrupt?  Google says to
> > > "wget http://database.clamav.net/daily.cvd" but that no longer works.
> > > What should I be doing differently?
> > 
> > 
> > > ~$ grep freshclam /var/log/syslog
> > > Dec 25 18:29:29 mx3 freshclam[1013]: freshclam daemon 0.103.7 (OS: linux-gnu, ARCH: x86_64, CPU: x86_64)
> > > Dec 25 18:29:29 mx3 freshclam[1013]: ClamAV update process started at Sun Dec 25 18:29:29 2022
> > > Dec 25 18:29:29 mx3 freshclam[1013]: ClamAV update process started at Sun Dec 25 18:29:29 2022
> > 
> > this looks like you are running two concurrent update processes.
> > This may or may not cause the problem.
> 
> I can't explain the 2 identical logged lines, freshclam has been logging
> dups that for a while now:

It just occurred to me, with this latest round of errors, that there are
not 2 processes running.  The PID is 1807 for all logged errors.  This
means that freshclam is making 2 connections.   Any thoughts on
debugging these problems with freshclam?  All my googling suggest that
it's a mirror problem, is there a place to report mirror problems?

Dec 26 21:15:06 mx3 freshclam[1807]: freshclam daemon 0.103.7 (OS: linux-gnu, ARCH: x86_64, CPU: x86_64)
Dec 26 21:15:06 mx3 freshclam[1807]: ClamAV update process started at Mon Dec 26 21:15:06 2022
Dec 26 21:15:06 mx3 freshclam[1807]: ClamAV update process started at Mon Dec 26 21:15:06 2022
Dec 26 21:15:06 mx3 freshclam[1807]: WARNING: Cool-down expired, ok to try again.
Dec 26 21:15:06 mx3 freshclam[1807]: Cool-down expired, ok to try again.
Dec 26 21:15:06 mx3 freshclam[1807]: daily database available for download (remote version: 26762)
Dec 26 21:15:06 mx3 freshclam[1807]: daily database available for download (remote version: 26762)
Dec 26 21:15:07 mx3 freshclam[1807]: ERROR: Verification: Can't verify database integrity
Dec 26 21:15:07 mx3 freshclam[1807]: Verification: Can't verify database integrity
Dec 26 21:15:07 mx3 freshclam[1807]: Trying again in 5 secs...
Dec 26 21:15:07 mx3 freshclam[1807]: Trying again in 5 secs...
Dec 26 21:15:12 mx3 freshclam[1807]: daily database available for download (remote version: 26762)
Dec 26 21:15:12 mx3 freshclam[1807]: daily database available for download (remote version: 26762)
Dec 26 21:15:13 mx3 freshclam[1807]: ERROR: Verification: Can't verify database integrity
Dec 26 21:15:13 mx3 freshclam[1807]: Verification: Can't verify database integrity
Dec 26 21:15:13 mx3 freshclam[1807]: Trying again in 5 secs...
Dec 26 21:15:13 mx3 freshclam[1807]: Trying again in 5 secs...
Dec 26 21:15:18 mx3 freshclam[1807]: daily database available for download (remote version: 26762)
Dec 26 21:15:18 mx3 freshclam[1807]: daily database available for download (remote version: 26762)
Dec 26 21:15:18 mx3 freshclam[1807]: ERROR: Verification: Can't verify database integrity
Dec 26 21:15:18 mx3 freshclam[1807]: Verification: Can't verify database integrity
Dec 26 21:15:18 mx3 freshclam[1807]: Giving up on https://database.clamav.net...
Dec 26 21:15:18 mx3 freshclam[1807]: daily database available for download (remote version: 26762)
Dec 26 21:15:18 mx3 freshclam[1807]: Giving up on https://database.clamav.net...
Dec 26 21:15:18 mx3 freshclam[1807]: daily database available for download (remote version: 26762)
Dec 26 21:15:19 mx3 freshclam[1807]: ERROR: Verification: Can't verify database integrity
Dec 26 21:15:19 mx3 freshclam[1807]: Verification: Can't verify database integrity
Dec 26 21:15:19 mx3 freshclam[1807]: Trying again in 5 secs...
Dec 26 21:15:19 mx3 freshclam[1807]: Trying again in 5 secs...
Dec 26 21:15:24 mx3 freshclam[1807]: daily database available for download (remote version: 26762)
Dec 26 21:15:24 mx3 freshclam[1807]: daily database available for download (remote version: 26762)
Dec 26 21:15:25 mx3 freshclam[1807]: ERROR: Verification: Can't verify database integrity
Dec 26 21:15:25 mx3 freshclam[1807]: Verification: Can't verify database integrity
Dec 26 21:15:25 mx3 freshclam[1807]: Trying again in 5 secs...
Dec 26 21:15:25 mx3 freshclam[1807]: Trying again in 5 secs...
Dec 26 21:15:30 mx3 freshclam[1807]: daily database available for download (remote version: 26762)
Dec 26 21:15:30 mx3 freshclam[1807]: daily database available for download (remote version: 26762)
Dec 26 21:15:30 mx3 freshclam[1807]: ERROR: Can't download daily.cvd from https://database.clamav.net/daily.cvd
Dec 26 21:15:30 mx3 freshclam[1807]: WARNING: FreshClam received error code 429 from the ClamAV Content Delivery Network (CDN).
Dec 26 21:15:30 mx3 freshclam[1807]: This means that you have been rate limited by the CDN.
Dec 26 21:15:30 mx3 freshclam[1807]:  1. Run FreshClam no more than once an hour to check for updates.
Dec 26 21:15:30 mx3 freshclam[1807]:     FreshClam should check DNS first to see if an update is needed.
Dec 26 21:15:30 mx3 freshclam[1807]:  2. If you have more than 10 hosts on your network attempting to download,
Dec 26 21:15:30 mx3 freshclam[1807]:     it is recommended that you set up a private mirror on your network using
Dec 26 21:15:30 mx3 freshclam[1807]:     cvdupdate (https://pypi.org/project/cvdupdate/) to save bandwidth on the
Dec 26 21:15:30 mx3 freshclam[1807]:     CDN and your own network.
Dec 26 21:15:30 mx3 freshclam[1807]:  3. Please do not open a ticket asking for an exemption from the rate limit,
Dec 26 21:15:30 mx3 freshclam[1807]:     it will not be granted.
Dec 26 21:15:30 mx3 freshclam[1807]: WARNING: You are on cool-down until after: 2022-12-27 21:15:30
Dec 26 21:15:30 mx3 freshclam[1807]: Can't download daily.cvd from https://database.clamav.net/daily.cvd
Dec 26 21:15:30 mx3 freshclam[1807]: main.cld database is up-to-date (version: 62, sigs: 6647427, f-level: 90, builder: sigmgr)
Dec 26 21:15:30 mx3 freshclam[1807]: bytecode database available for download (remote version: 333)
Dec 26 21:15:30 mx3 freshclam[1807]: FreshClam received error code 429 from the ClamAV Content Delivery Network (CDN).
Dec 26 21:15:30 mx3 freshclam[1807]: This means that you have been rate limited by the CDN.
Dec 26 21:15:30 mx3 freshclam[1807]:  1. Run FreshClam no more than once an hour to check for updates.
Dec 26 21:15:30 mx3 freshclam[1807]:     FreshClam should check DNS first to see if an update is needed.
Dec 26 21:15:30 mx3 freshclam[1807]:  2. If you have more than 10 hosts on your network attempting to download,
Dec 26 21:15:30 mx3 freshclam[1807]:     it is recommended that you set up a private mirror on your network using
Dec 26 21:15:30 mx3 freshclam[1807]:     cvdupdate (https://pypi.org/project/cvdupdate/) to save bandwidth on the
Dec 26 21:15:30 mx3 freshclam[1807]:     CDN and your own network.
Dec 26 21:15:30 mx3 freshclam[1807]:  3. Please do not open a ticket asking for an exemption from the rate limit,
Dec 26 21:15:30 mx3 freshclam[1807]:     it will not be granted.
Dec 26 21:15:30 mx3 freshclam[1807]: You are on cool-down until after: 2022-12-27 21:15:30
Dec 26 21:15:30 mx3 freshclam[1807]: main.cld database is up-to-date (version: 62, sigs: 6647427, f-level: 90, builder: sigmgr)
Dec 26 21:15:30 mx3 freshclam[1807]: bytecode database available for download (remote version: 333)
Dec 26 21:15:30 mx3 freshclam[1807]: ERROR: Verification: Can't verify database integrity
Dec 26 21:15:30 mx3 freshclam[1807]: Verification: Can't verify database integrity
Dec 26 21:15:30 mx3 freshclam[1807]: Trying again in 5 secs...
Dec 26 21:15:30 mx3 freshclam[1807]: Trying again in 5 secs...
Dec 26 21:15:35 mx3 freshclam[1807]: bytecode database available for download (remote version: 333)
Dec 26 21:15:35 mx3 freshclam[1807]: bytecode database available for download (remote version: 333)
Dec 26 21:15:35 mx3 freshclam[1807]: ERROR: Verification: Can't verify database integrity
Dec 26 21:15:35 mx3 freshclam[1807]: Verification: Can't verify database integrity
Dec 26 21:15:35 mx3 freshclam[1807]: Trying again in 5 secs...
Dec 26 21:15:35 mx3 freshclam[1807]: Trying again in 5 secs...
Dec 26 21:15:40 mx3 freshclam[1807]: bytecode database available for download (remote version: 333)
Dec 26 21:15:40 mx3 freshclam[1807]: bytecode database available for download (remote version: 333)
Dec 26 21:15:41 mx3 freshclam[1807]: ERROR: Verification: Can't verify database integrity
Dec 26 21:15:41 mx3 freshclam[1807]: Verification: Can't verify database integrity
Dec 26 21:15:41 mx3 freshclam[1807]: Giving up on https://database.clamav.net...
Dec 26 21:15:41 mx3 freshclam[1807]: bytecode database available for download (remote version: 333)
Dec 26 21:15:41 mx3 freshclam[1807]: Giving up on https://database.clamav.net...
Dec 26 21:15:41 mx3 freshclam[1807]: bytecode database available for download (remote version: 333)
Dec 26 21:15:41 mx3 freshclam[1807]: ERROR: Verification: Can't verify database integrity
Dec 26 21:15:41 mx3 freshclam[1807]: Verification: Can't verify database integrity
Dec 26 21:15:41 mx3 freshclam[1807]: Trying again in 5 secs...
Dec 26 21:15:41 mx3 freshclam[1807]: Trying again in 5 secs...
Dec 26 21:15:46 mx3 freshclam[1807]: bytecode database available for download (remote version: 333)
Dec 26 21:15:46 mx3 freshclam[1807]: bytecode database available for download (remote version: 333)
Dec 26 21:15:46 mx3 freshclam[1807]: ERROR: Verification: Can't verify database integrity
Dec 26 21:15:46 mx3 freshclam[1807]: Verification: Can't verify database integrity
Dec 26 21:15:46 mx3 freshclam[1807]: Trying again in 5 secs...
Dec 26 21:15:46 mx3 freshclam[1807]: Trying again in 5 secs...