3052 Commits

Author	SHA1	Message	Date
Adrian	160d04502f	Merge fd37bf145e into ad43bf0c56	2026-08-15 21:24:06 +05:00
Adrian	a22523bfd3	Add a HTTP2_MAX_FRAME_SIZE setting (#7988)	2026-08-14 14:19:06 +05:00
Adrian Chaves	fd37bf145e	Sync with be514d8c5d, add missing issues/PRs	2026-08-13 11:04:51 +02:00
Adrian Chaves	4681268959	Merge remote-tracking branch 'origin/master' into release-notes-2.18	2026-08-13 10:50:51 +02:00
Adrian	8bb06bf00b	Stop marking the Twisted-based HTTP/2 download handler as experimental, and privatize its API (#7986)	2026-08-12 23:33:38 +05:00
Adrian Chaves	26584e99ae	WIP	2026-08-12 19:12:39 +02:00
Adrian Chaves	0566518ce9	Merge remote-tracking branch 'origin/master' into release-notes-2.18	2026-08-12 19:03:29 +02:00
Adrian	65b37286cc	Document the ITEM_PROCESSOR setting (#7983)	2026-08-12 20:34:25 +05:00
Adrian Chaves	24bec31366	WIP	2026-08-12 15:55:21 +02:00
Adrian Chaves	4caee732a1	WIP	2026-08-12 15:38:38 +02:00
Adrian Chaves	8f03e5ca39	Address feedback	2026-08-12 15:20:43 +02:00
Adrian Chaves	09627b0f05	WIP	2026-08-12 06:38:51 +02:00
Adrian Chaves	acb54187af	Replace the VERSION placeholder with 2.18.0	2026-08-12 05:59:45 +02:00
Adrian Chaves	6a2928f8d7	WIP	2026-08-10 19:53:21 +02:00
Adrian Chaves	e46bd554b4	Merge remote-tracking branch 'origin/master' into release-notes-2.18	2026-08-10 19:35:01 +02:00
Adrian Chaves	5f4e08f361	WIP	2026-08-10 19:33:26 +02:00
Adrian	8ce041e528	:issue: → :gh: (#7974)	2026-08-10 19:30:48 +02:00
Adrian Chaves	737a1c15c7	WIP	2026-08-10 18:58:07 +02:00
Adrian Chaves	db5a243b9f	Fix IPython wording	2026-08-10 18:22:14 +02:00
Adrian Chaves	1b9f965b65	Clarify the user implact of the AutoThrottle change	2026-08-10 17:39:30 +02:00
Adrian Chaves	4ed6b3acef	WIP	2026-08-10 14:58:42 +02:00
Adrian Chaves	4e6e8ed10a	Merge remote-tracking branch 'origin/master' into release-notes-2.18	2026-08-10 13:37:35 +02:00
Adrian	f1694269d8	Add FTPS support to the FTP feed export storage (#7953)	2026-08-10 11:33:58 +02:00
Adrian Chaves	e70750eb67	WIP	2026-08-10 11:27:58 +02:00
Adrian	fe96c1f54b	Serialize dates and times as ISO 8601 in ScrapyJSONEncoder (#7918)	2026-08-10 14:07:42 +05:00
Adrian	4cc2356637	Implement browser-like bad header handling for the default download handler (#7806) ... * Implement browser-like bad header handling for the default download handler * Remove dead code	2026-08-10 13:59:44 +05:00
Adrian	c285f4cb18	Support CloseSpider during spider startup (#7905)	2026-08-10 10:06:54 +02:00
Adrian	508bd7faec	Type late Crawler attributes as always set instead of None (#7882)	2026-08-10 09:07:34 +02:00
Adrian	09c918115b	Document response parsing memory use in the security page (#7930)	2026-08-10 08:43:57 +02:00
Adrian	ae68786210	Document how to customize media pipeline file names from responses (#7909)	2026-08-09 23:08:59 +05:00
Adrian	5270f3cf99	Add a depth_reset request metadata key (#7913)	2026-08-09 23:07:10 +05:00
Adrian	d41bfaec05	Document how to disallow subdomains of allowed domains (#7903)	2026-08-09 23:05:43 +05:00
Adrian	ba29ce8d3b	Add a docs section on using download_async() from a downloader middleware (#7872)	2026-08-09 23:02:44 +05:00
Adrian	fc082aa914	Clarify the docs about reactor settings (#7880)	2026-08-09 23:01:31 +05:00
Adrian	bee31890a2	Report exceptions from Spider.start() (#7884)	2026-08-09 22:56:03 +05:00
Adrian	482a02d30c	Add a cookies documentation page (#7947)	2026-08-09 22:41:32 +05:00
Adrian	786ab10494	Document how to write a custom item exporter (#7931)	2026-08-09 22:31:53 +05:00
Adrian	609f64c55d	Make brotli a hard dependency (#7929)	2026-08-09 19:24:14 +02:00
Adrian	5427080f48	Create a page on optimization (#7938)	2026-08-09 18:37:24 +02:00
Adrian	a6c017c2ca	Advise setting an identifying user agent (#7890)	2026-08-09 16:59:22 +05:00
Adrian	18ed0c0f7c	Fall back to the response encoding in TextResponse.json() (#7897)	2026-08-09 16:58:09 +05:00
Adrian	050a8cf159	Improve the docs about delaying start request iteration (#7883)	2026-08-09 16:57:08 +05:00
Adrian	59ce27afdd	Send the bytes_received and headers_received signals over HTTP/2 (#7896)	2026-08-09 16:55:02 +05:00
Adrian	7c797968a3	Docs: clarify the handling of exceptions raised in errbacks (#7898)	2026-08-09 16:53:33 +05:00
Adrian	a18d58d7b5	Document that process_spider_output receives a lazy result (#7939)	2026-08-09 12:26:15 +02:00
Adrian	9e84112221	Cover update_vars() in the shell docs (#7889)	2026-08-09 14:25:14 +05:00
Adrian	0b2d220197	Improve docs for multi-spider runs (#7907)	2026-08-09 14:19:50 +05:00
Adrian	0e324f3d4a	Let spiders change allowed_domains at run time (#7912)	2026-08-09 14:17:44 +05:00
Adrian	4a69e48f0f	Log the first depth-limited link only (#7916)	2026-08-09 14:08:49 +05:00
Adrian	81d12c6eb8	Document the Referer caveat of DEFAULT_REQUEST_HEADERS (#7917)	2026-08-09 14:08:06 +05:00