Shihab Shahriyar c6c9c4efd8 fix(feedexport): persist batch_id across JOBDIR restarts ... When a crawl with FEED_EXPORT_BATCH_ITEM_COUNT (or FEEDS.batch_item_count) and a %(batch_id) URI template was restarted with the same JOBDIR, the in-memory batch counter reset to 1 and silently overwrote files produced by the previous run. Store the last successfully-written batch_id per uri_template in <JOBDIR>/feedexport.state (JSON) and resume from last+1 on the next run. The state file is only written when JOBDIR is set and the URI template references %(batch_id), so non-JOBDIR crawls and time-only templates behave exactly as before. Adds a regression test that runs the exporter twice against the same JOBDIR and asserts prior batch files are not overwritten. Closes #5153		2026-06-22 18:25:27 -05:00
..
_images	Removed obsolete firebug-images	2018-08-23 16:19:13 +02:00
addons.rst	Fix missing load_object import and grammar in docs (#7417)	2026-04-09 15:31:01 +02:00
api.rst	Deprecate spider arguments of StatsCollector methods (#7011)	2025-08-20 09:52:22 +02:00
architecture.rst	Fix missing load_object import and grammar in docs (#7417)	2026-04-09 15:31:01 +02:00
asyncio.rst	Clarify the first-class-citizen nature of asyncio support (#7599)	2026-06-11 10:51:46 +02:00
autothrottle.rst	Deprecate CONCURRENT_REQUESTS_PER_IP setting (#6921)	2025-06-30 16:51:05 +05:00
benchmarking.rst	Add sphinx-lint. (#6920)	2025-06-28 01:37:20 +02:00
broad-crawls.rst	Change default priority queue to DownloaderAwarePriorityQueue (#6940)	2025-12-11 11:25:17 +01:00
commands.rst	Remove outdated version marker directives (< 2.8.0) from documentation (#7198)	2025-12-22 10:00:39 +01:00
components.rst	Rename DNS_RESOLVER to TWISTED_DNS_RESOLVER (#7361)	2026-04-08 13:58:35 +02:00
contracts.rst	Merge branch 'master' of github.com:Laerte/scrapy	2024-08-27 07:16:10 -03:00
coroutines.rst	Small docs fixes. (#7598)	2026-06-11 10:51:03 +02:00
debug.rst	Mention open_in_browser in the release notes	2023-11-29 12:13:04 +01:00
deploy.rst	Run and fix linkcheck. (#6524)	2024-11-04 11:40:07 +01:00
developer-tools.rst	Update tool versions (#7127)	2025-10-27 14:11:31 +01:00
djangoitem.rst	Update documentation links	2016-03-03 16:28:33 +00:00
download-handlers.rst	Add support for HTTP/2 and for SOCKS proxies to HttpxDownloadHandler, improve handler docs (#7575)	2026-06-09 01:10:44 +05:00
downloader-middleware.rst	Implement HTTP Auth settings and request metadata keys (#7590)	2026-06-11 15:56:53 +05:00
dynamic-content.rst	Deprecate FormRequest in favor of form2request (#6438)	2026-05-04 22:38:29 +05:00
exceptions.rst	Remove outdated version marker directives (< 2.8.0) from documentation (#7198)	2025-12-22 10:00:39 +01:00
exporters.rst	docs: switch `scrapy.Item` examples to dataclasses (#7513)	2026-06-08 12:40:28 +05:00
extensions.rst	Small docs fixes. (#7598)	2026-06-11 10:51:03 +02:00
feed-exports.rst	fix(feedexport): persist batch_id across JOBDIR restarts	2026-06-22 18:25:27 -05:00
item-pipeline.rst	fix: missing self argument in ScreenshotPipeline constructor (#7248)	2026-02-13 09:42:26 +01:00
items.rst	Item docs: mention Pydantic support (#6966)	2026-02-05 22:18:01 +04:00
jobs.rst	Document cb_kwargs/meta deep-copy when JOBDIR is set (#7573)	2026-06-11 14:40:15 +05:00
leaks.rst	Deprecate FormRequest in favor of form2request (#6438)	2026-05-04 22:38:29 +05:00
link-extractors.rst	Release notes for 2.15.0 (#7373)	2026-04-09 16:56:30 +05:00
loaders.rst	docs: switch `scrapy.Item` examples to dataclasses (#7513)	2026-06-08 12:40:28 +05:00
logging.rst	docs: document daily log file rotation (#7501)	2026-05-12 19:34:51 +05:00
media-pipeline.rst	Update default_settings, deprecate CRAWLSPIDER_FOLLOW_LINKS. (#7592)	2026-06-11 00:22:09 +05:00
practices.rst	Document scrapy-lint, remove start_url check (#7627)	2026-06-22 20:12:16 +05:00
request-response.rst	Implement HTTP Auth settings and request metadata keys (#7590)	2026-06-11 15:56:53 +05:00
scheduler.rst	Add Jobdir documentation (#5260)	2026-02-06 22:33:02 +04:00
scrapyd.rst	Use https:// for readthedocs links	2017-06-01 16:41:52 +02:00
selectors.rst	Release notes for 2.15.0 (#7373)	2026-04-09 16:56:30 +05:00
settings.rst	Small docs fixes. (#7598)	2026-06-11 10:51:03 +02:00
shell.rst	Release notes for 2.15.0 (#7373)	2026-04-09 16:56:30 +05:00
signals.rst	Deprecate the mail API (#7263)	2026-03-24 21:31:12 +01:00
spider-middleware.rst	Release notes for Scrapy 2.16.0. (#7536)	2026-05-19 17:26:21 +05:00
spiders.rst	Implement HTTP Auth settings and request metadata keys (#7590)	2026-06-11 15:56:53 +05:00
stats.rst	Update tool versions (#7127)	2025-10-27 14:11:31 +01:00
telnetconsole.rst	Small docs fixes. (#7598)	2026-06-11 10:51:03 +02:00