download.kiwix.org routes the large Wikimedia-family ZIMs (Wikipedia, Wikiversity, Wikibooks — including the flagship full Wikipedia) to dumps.wikimedia.org, which enforces a User-Agent policy and returns HTTP 403 for requests with a missing or generic (axios/x) User-Agent. Because doResumableDownload sent no User-Agent, every Wikimedia-hosted ZIM failed to download while Kiwix-mirror-hosted ZIMs succeeded — so a curated set or Easy Setup run would silently stall on exactly the highest-value content. Add a descriptive User-Agent to the HEAD and GET requests. Verified against the live mirror: default/empty UA -> 403, ProjectNOMAD UA -> 200/206. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| controllers | ||
| exceptions | ||
| jobs | ||
| middleware | ||
| models | ||
| services | ||
| utils | ||
| validators | ||