scrapy

Commit Graph

Author	SHA1	Message	Date
Andrey Rakhmatullin	2ad81a0ef8	Deprecate the spider arg of downloader middleware methods. (#7037 ) * Deprecate the spider arg of downloader middleware methods. * Add a test for deprecated spider args in downloader mws.	2025-09-02 21:51:47 +05:00
Andrey Rakhmatullin	ed63fa94d6	Deprecate spider args of middlewares and pipelines. (#7006 ) * Deprecate spider args of spider middleware methods. * Deprecate the spider arg of pipeline process_item(). * Fix a typing issue. * Deprecate the spider arg of pipeline {open,close}_spider(). * Cleanup. * Update docs. * Add pragma: no cover to some deprecated code. * More tests. * More tests. * More tests. * Simplify _process_parallel().	2025-08-21 13:23:10 +05:00
Andrey Rakhmatullin	baa579df62	Deprecate various `spider` args in `MiddlewareManager` subclasses (#6984 ) * Add a crawler argument to MiddlewareManager.__init__(). * Deprecate the spider argument in some MiddlewareManager subclasses. * Remove the spider argument from ExecutionEngine.open_spider_async(). * Remove the spider argument from Scraper.open_spider(). * Fix the Scraper.close_spider() type hint. * Remove the spider argument from Downloader internals. * Deprecate the spider arg of download_func. * Deprecate the spider arg of Downloader.fetch(). * Deprecate the spider arg of ItemPipelineManager.process_item(). * Fix pylint. * Tests for MiddlewareManager spider code. * Deprecated spider arg handling for custom pipeline managers. * Add a test for the deprecated spider arg in a custom downloader. * Remove TODO. * Fix pylint.	2025-08-05 12:21:08 +05:00
Andrey Rakhmatullin	3843091c5f	Mark abstract base classes as such. (#6930 ) * Mark abstract base classes as such. * Remove an unneeded method. * Fix exporter test coverage.	2025-06-30 15:14:34 +05:00
Andrey Rakhmatullin	7bbe775040	Converting tests to plain asserts, part 5. (#6712 )	2025-03-09 20:24:45 +01:00
Andrey Rakhmatullin	a898331d14	Preparations for switching to direct pytest. (#6678 )	2025-02-16 20:28:58 +01:00
Andrey Rakhmatullin	eda3a89b3f	Remove build_from_settings().	2024-11-11 16:44:47 +05:00
Andrey Rakhmatullin	e58b8078f0	Improve NotConfigured handling when clspath is a class.	2023-08-01 20:20:15 +04:00
Andrey Rakhmatullin	79bf8b1f2e	Test cleanup.	2023-06-15 19:28:14 +04:00
Andrey Rakhmatullin	075ad6f196	Test, linter etc. fixes.	2023-06-14 16:34:18 +04:00
Andrey Rakhmatullin	898e3045a1	Merge branch 'master' into addons	2023-06-14 15:37:08 +04:00
Jalil SA	a5c1ef8276	sort imports with isort	2023-01-25 14:25:15 -06:00
Emmanuel Rondan	e211ec0aa2	adding black formatter to all the code	2022-11-29 11:30:46 -03:00
nyov	cf50561b86	Allow passing classes directly in Settings (#3873 ) Co-authored-by: Adrián Chaves <adrian@chaves.io>	2020-08-26 13:08:14 +02:00
Marc Hernández	336f19f5cc	Change super syntax (#4707 )	2020-08-04 20:42:01 +02:00
Eugenio Lacuesta	bf56517abf	Flake8: Remove E128 (tests, part 2)	2020-05-06 19:18:29 -03:00
elacuesta	dfbe1d9507	Remove object base class (#4430 )	2020-03-16 20:12:46 +01:00
Adrián Chaves	f261cf65e9	Add missing blank lines between functions and classes Also fixed 2 unrelated Flake8 issues	2019-11-18 17:16:09 +01:00
Andrey Rakhmatullin	1d7c8cb0b1	Remove six.PY2 and six.PY3 conditionals.	2019-11-14 13:45:37 +05:00
Eugenio Lacuesta	f97e3e90f2	Use collections.deque instead of list to store methods	2018-10-29 12:40:20 -03:00
Jakob de Maeyer	cfed9b6659	Allow passing Python objects to middleware dict settings	2015-11-11 21:08:19 +01:00
nyov	8ab1648a36	PY3 fix test middleware	2015-07-29 13:51:01 +00:00
Mikhail Korobov	628a8d8a15	TST modernize some of the asserts	2014-08-01 23:44:23 +06:00
Daniel Graña	242c08553f	move tests under root dir	2014-07-30 19:45:08 -03:00

24 Commits