[clamav-users] Yet another synchronization failure!

Wed Jul 18 19:37:38 UTC 2018

A few days ago, I programmed some pre-tests so as to avoid running
freshclam until *both* the DNS TXT record and the first few bytes of
daily.cvd (obtained via curl) agree that there is a new version which
*actually* is available for download via freshclam.

It turns out that doesn't cover all the possible mis-synchronizations.

Today, my tests showed the new daily.cvd was indeed available (and
freshclam downloaded it), but the new bytecode.cvd wasn't *really*
available, so freshclam reported overall failure. Worse yet, the curl
test on bytecode.cvd says that the new one still isn't available one
hour later.

Our enhanced log follows. It shows that daily.cvd #24761 became
available by 14:18 (EDT), but bytecode.cvd #325 was *not* really
available even though the DNS TXT records said it was, and it still
wasn't really available at 15:18 (or even now, at 15:30).

I guess I'll have to enhance my pre-test to demand that *all* of
daily.cvd, bytecode.cvd and main.cvd pass the curl tests before
invoking freshclam. (Today, this would *any* updating even more.)

  ------------------------------  Wednesday 18 July 2018 at 14:03:01  ------------------------------

  /opt/clamav/bin/testclam-external
  -->  DNS  D 24760/24760  B 324/324  M 58/58

  ------------------------------  Wednesday 18 July 2018 at 14:18:01  ------------------------------

  /opt/clamav/bin/testclam-external
  -->  UPD  D 24761/24761/24760  B 324/325/324  M 58/58/58

  /opt/clamav/bin/freshclam -v --stdout --on-update-execute=EXIT_1
  Current working dir is /opt/clamav.d/clamav.0.100.1/share/clamav
  Max retries == 1
  ClamAV update process started at Wed Jul 18 14:18:04 2018
  Using IPv6 aware code
  Querying current.cvd.clamav.net
  TTL: 1798
  Software version from DNS: 0.100.1
  main.cvd version from DNS: 58
  main.cvd is up to date (version: 58, sigs: 4566249, f-level: 60, builder: sigmgr)
  daily.cvd version from DNS: 24761
  Retrieving http://database.clamav.net/daily.cvd
  Using ip '10.11.14.160' for fetching.
  Trying to download http://database.clamav.net/daily.cvd (IP: 104.16.187.138)
  Downloading daily.cvd [100%]
  Loading signatures from daily.cvd
  Properly loaded 2017974 signatures from new daily.cvd
  daily.cvd updated (version: 24761, sigs: 2017974, f-level: 63, builder: neo)
  Querying daily.24761.92.1.0.6810BB8A.ping.clamav.net
  bytecode.cvd version from DNS: 325
  Retrieving http://database.clamav.net/bytecode.cvd
  Using ip '10.11.14.160' for fetching.
  Trying to download http://database.clamav.net/bytecode.cvd (IP: 104.16.187.138)
  Downloading bytecode.cvd [100%]
  WARNING: Mirror 104.16.187.138 is not synchronized.
  Querying bytecode.0.92.0.0.6810BB8A.ping.clamav.net
  Giving up on database.clamav.net...
  Update failed. Your network may be down or none of the mirrors listed in /opt/clamav.d/clamav.0.100.1/etc/freshclam.conf is working. Check https://www.clamav.net/documents/official-mirror-faq for possible reasons.

  /opt/clamav/bin/freshclam --list-mirrors

  Mirror #1
  IP: 104.16.187.138
  Successes: 6
  Failures: 1
  Last access: Wed Jul 18 14:18:13 2018
  Ignore: Yes
  -------------------------------------
  Mirror #2
  IP: 104.16.189.138
  Successes: 4
  Failures: 0
  Last access: Sun Jul 15 10:48:05 2018
  Ignore: No
  -------------------------------------
  Mirror #3
  IP: 104.16.188.138
  Successes: 5
  Failures: 0
  Last access: Mon Jul 16 17:48:04 2018
  Ignore: No
  -------------------------------------
  Mirror #4
  IP: 104.16.185.138
  Successes: 5
  Failures: 0
  Last access: Mon Jul 16 09:48:04 2018
  Ignore: No
  -------------------------------------
  Mirror #5
  IP: 104.16.186.138
  Successes: 5
  Failures: 0
  Last access: Tue Jul 17 01:33:06 2018
  Ignore: No

  ------------------------------  Wednesday 18 July 2018 at 14:18:13  ------------------------------

  ------------------------------  Wednesday 18 July 2018 at 14:33:01  ------------------------------

  /opt/clamav/bin/testclam-external
  -->  EXT  D 24761/24761/24761  B 324/325/324  M 58/58/58

  ------------------------------  Wednesday 18 July 2018 at 14:48:01  ------------------------------

  /opt/clamav/bin/testclam-external
  -->  EXT  D 24761/24761/24761  B 324/325/324  M 58/58/58

  ------------------------------  Wednesday 18 July 2018 at 15:03:01  ------------------------------

  /opt/clamav/bin/testclam-external
  -->  EXT  D 24761/24761/24761  B 324/325/324  M 58/58/58

  ------------------------------  Wednesday 18 July 2018 at 15:18:01  ------------------------------

  /opt/clamav/bin/testclam-external
  -->  EXT  D 24761/24761/24761  B 324/325/324  M 58/58/58