ceabc2c72c
The prior --max-filesize 1 aborted on the 301 redirect page's own body before curl could follow it to the mirror, so the validator reported HTTP 301 for every URL and failed the whole catalog (100+ URLs that are actually valid). download.kiwix.org 301-redirects both valid and dead files to a mirror, so the redirect must be followed to learn the real status. Drop --max-filesize and rely on Range: bytes=0-0 (mirrors return 206 after one byte) with the body discarded to /dev/null and --max-time as the bound. Verified against a sample across devdocs/libretexts/stack_exchange/maps/zimit (all 206) and a known-dead URL (404). Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| ISSUE_TEMPLATE | ||
| scripts | ||
| workflows | ||
| dependabot.yaml | ||