scrapy/docs/topics
Labib Bin Salam e0a7de7213
Document cb_kwargs/meta deep-copy when JOBDIR is set (#7573)
When JOBDIR is enabled, requests are serialized to disk with pickle, so
the objects stored in a request's cb_kwargs and meta are deep-copied on
the round trip. Callbacks then receive copies rather than the original
objects, which is easy to miss and can silently break code that relies on
sharing mutable state. Add a note to the request serialization section of
the jobs docs and a cross-referenced caution to the Request.cb_kwargs
attribute docs.

Closes #6120
2026-06-11 14:40:15 +05:00
..
_images Removed obsolete firebug-images 2018-08-23 16:19:13 +02:00
addons.rst Fix missing load_object import and grammar in docs (#7417) 2026-04-09 15:31:01 +02:00
api.rst Deprecate spider arguments of StatsCollector methods (#7011) 2025-08-20 09:52:22 +02:00
architecture.rst Fix missing load_object import and grammar in docs (#7417) 2026-04-09 15:31:01 +02:00
asyncio.rst Clarify the first-class-citizen nature of asyncio support (#7599) 2026-06-11 10:51:46 +02:00
autothrottle.rst Deprecate CONCURRENT_REQUESTS_PER_IP setting (#6921) 2025-06-30 16:51:05 +05:00
benchmarking.rst Add sphinx-lint. (#6920) 2025-06-28 01:37:20 +02:00
broad-crawls.rst Change default priority queue to DownloaderAwarePriorityQueue (#6940) 2025-12-11 11:25:17 +01:00
commands.rst Remove outdated version marker directives (< 2.8.0) from documentation (#7198) 2025-12-22 10:00:39 +01:00
components.rst Rename DNS_RESOLVER to TWISTED_DNS_RESOLVER (#7361) 2026-04-08 13:58:35 +02:00
contracts.rst Merge branch 'master' of github.com:Laerte/scrapy 2024-08-27 07:16:10 -03:00
coroutines.rst Small docs fixes. (#7598) 2026-06-11 10:51:03 +02:00
debug.rst Mention open_in_browser in the release notes 2023-11-29 12:13:04 +01:00
deploy.rst Run and fix linkcheck. (#6524) 2024-11-04 11:40:07 +01:00
developer-tools.rst Update tool versions (#7127) 2025-10-27 14:11:31 +01:00
djangoitem.rst Update documentation links 2016-03-03 16:28:33 +00:00
download-handlers.rst Add support for HTTP/2 and for SOCKS proxies to HttpxDownloadHandler, improve handler docs (#7575) 2026-06-09 01:10:44 +05:00
downloader-middleware.rst Add support for HTTP/2 and for SOCKS proxies to HttpxDownloadHandler, improve handler docs (#7575) 2026-06-09 01:10:44 +05:00
dynamic-content.rst Deprecate FormRequest in favor of form2request (#6438) 2026-05-04 22:38:29 +05:00
exceptions.rst Remove outdated version marker directives (< 2.8.0) from documentation (#7198) 2025-12-22 10:00:39 +01:00
exporters.rst docs: switch `scrapy.Item` examples to dataclasses (#7513) 2026-06-08 12:40:28 +05:00
extensions.rst Small docs fixes. (#7598) 2026-06-11 10:51:03 +02:00
feed-exports.rst Release notes for 2.15.0 (#7373) 2026-04-09 16:56:30 +05:00
item-pipeline.rst fix: missing self argument in ScreenshotPipeline constructor (#7248) 2026-02-13 09:42:26 +01:00
items.rst Item docs: mention Pydantic support (#6966) 2026-02-05 22:18:01 +04:00
jobs.rst Document cb_kwargs/meta deep-copy when JOBDIR is set (#7573) 2026-06-11 14:40:15 +05:00
leaks.rst Deprecate FormRequest in favor of form2request (#6438) 2026-05-04 22:38:29 +05:00
link-extractors.rst Release notes for 2.15.0 (#7373) 2026-04-09 16:56:30 +05:00
loaders.rst docs: switch `scrapy.Item` examples to dataclasses (#7513) 2026-06-08 12:40:28 +05:00
logging.rst docs: document daily log file rotation (#7501) 2026-05-12 19:34:51 +05:00
media-pipeline.rst Update default_settings, deprecate CRAWLSPIDER_FOLLOW_LINKS. (#7592) 2026-06-11 00:22:09 +05:00
practices.rst Add settings for TLS min/max version as a replacement for the TLS method (#6546) 2026-06-08 11:54:10 +02:00
request-response.rst Document cb_kwargs/meta deep-copy when JOBDIR is set (#7573) 2026-06-11 14:40:15 +05:00
scheduler.rst Add Jobdir documentation (#5260) 2026-02-06 22:33:02 +04:00
scrapyd.rst Use https:// for readthedocs links 2017-06-01 16:41:52 +02:00
selectors.rst Release notes for 2.15.0 (#7373) 2026-04-09 16:56:30 +05:00
settings.rst Small docs fixes. (#7598) 2026-06-11 10:51:03 +02:00
shell.rst Release notes for 2.15.0 (#7373) 2026-04-09 16:56:30 +05:00
signals.rst Deprecate the mail API (#7263) 2026-03-24 21:31:12 +01:00
spider-middleware.rst Release notes for Scrapy 2.16.0. (#7536) 2026-05-19 17:26:21 +05:00
spiders.rst docs: switch `scrapy.Item` examples to dataclasses (#7513) 2026-06-08 12:40:28 +05:00
stats.rst Update tool versions (#7127) 2025-10-27 14:11:31 +01:00
telnetconsole.rst Small docs fixes. (#7598) 2026-06-11 10:51:03 +02:00