New Software Watch

Software Watch: the daily web scan

Internal: slice 2 of docs/specs/SOFTWARE_WATCH.md scans each verified site once a day, lists its software with how it was found and what Magpie checks, behind the preview gate.

Internal: slice 2 of docs/specs/SOFTWARE_WATCH.md. A new scheduled job, software-watch-scans (bin/process-software-watch.php --scans), scans each verified site once a day in its own hour and runs Scan now within a minute, at most once every 10 minutes a site. A scan reads response headers, cookie names, the generator tag, the addresses of scripts and stylesheets, the well-known paths of products the page suggested, library version banners, the TLS certificate and the domain's DNS records, at most 25 requests in 60 seconds through PinnedHttpClient, and nothing from another domain the site sends visitors to. What it recognises comes from resources/software-watch/catalogue.php (80 products). Each piece of software is stored with its evidence and what Magpie checks about it: checked, checked in part (no version, part of a version, or a version a Linux distribution may have patched), not checked, or listed only. A failed scan keeps what was found before; software missing from three scans in a row moves to No longer found. A site's page shows its software and its scans; the software list narrows by what Magpie checks, and each piece has its own page.