scrapy/scrapy
Andrey Rakhmatullin ed63fa94d6
Deprecate spider args of middlewares and pipelines. (#7006)
* Deprecate spider args of spider middleware methods.

* Deprecate the spider arg of pipeline process_item().

* Fix a typing issue.

* Deprecate the spider arg of pipeline {open,close}_spider().

* Cleanup.

* Update docs.

* Add pragma: no cover to some deprecated code.

* More tests.

* More tests.

* More tests.

* Simplify _process_parallel().
2025-08-21 13:23:10 +05:00
..
commands Deprecate various `spider` args in `MiddlewareManager` subclasses (#6984) 2025-08-05 12:21:08 +05:00
contracts Bump tool versions. (#6941) 2025-07-05 10:30:30 +02:00
core Deprecate spider args of middlewares and pipelines. (#7006) 2025-08-21 13:23:10 +05:00
downloadermiddlewares Deprecate spider arguments of StatsCollector methods (#7011) 2025-08-20 09:52:22 +02:00
extensions Deprecate spider arguments of StatsCollector methods (#7011) 2025-08-20 09:52:22 +02:00
http Bump tool versions. (#6941) 2025-07-05 10:30:30 +02:00
linkextractors Bump tool versions. (#6941) 2025-07-05 10:30:30 +02:00
loader Improve internal refs to scrapy.Request and scrapy.Selector (#6526) 2025-01-07 16:18:18 +05:00
pipelines Deprecate spider args of middlewares and pipelines. (#7006) 2025-08-21 13:23:10 +05:00
selector Enable the flake8-builtins rules. (#6942) 2025-07-05 21:43:18 +05:00
settings Bump tool versions. (#6941) 2025-07-05 10:30:30 +02:00
spidermiddlewares Deprecate spider args of middlewares and pipelines. (#7006) 2025-08-21 13:23:10 +05:00
spiders Bump tool versions. (#6941) 2025-07-05 10:30:30 +02:00
templates Fix small typo in middlewares.py.tmpl (#6970) 2025-07-27 01:52:57 +02:00
utils Deprecate spider args of middlewares and pipelines. (#7006) 2025-08-21 13:23:10 +05:00
VERSION Bump version: 2.13.2 → 2.13.3 2025-07-02 20:39:46 +05:00
__init__.py Bump tool versions. (#6941) 2025-07-05 10:30:30 +02:00
__main__.py adding black formatter to all the code 2022-11-29 11:30:46 -03:00
addons.py Allow updating pre-crawler settings from add-ons (#6568) 2025-01-22 12:07:44 +01:00
cmdline.py Minor improvement in cmdline.py (#6875) 2025-06-09 12:07:01 +02:00
crawler.py Deprecate Crawler.stop(). (#6999) 2025-08-11 08:32:55 +02:00
dupefilters.py Deprecate spider arguments of StatsCollector methods (#7011) 2025-08-20 09:52:22 +02:00
exceptions.py Flexible severity of logging level when items are dropped (#6608) 2025-01-15 11:08:18 +01:00
exporters.py Mark abstract base classes as such. (#6930) 2025-06-30 15:14:34 +05:00
extension.py Drop Python 3.8 Support (#6472) 2024-10-16 10:03:16 +02:00
interfaces.py Remove useless pylint: disable lines. 2025-01-02 12:32:25 +05:00
item.py Update the outdated Item docstring. (#6427) 2024-11-04 16:17:56 +05:00
link.py Enable RUF Ruff rules. 2025-01-01 21:41:08 +05:00
logformatter.py Fix a regression in errback result handling. (#6863) 2025-06-06 12:47:38 +05:00
mail.py Bump tool versions. (#6941) 2025-07-05 10:30:30 +02:00
middleware.py Deprecate spider args of middlewares and pipelines. (#7006) 2025-08-21 13:23:10 +05:00
mime.types moved module scrapy.core.downloader.responsetypes to scrapy.responsetypes 2011-08-07 02:49:57 -03:00
pqueues.py Bump tool versions. (#6941) 2025-07-05 10:30:30 +02:00
py.typed Add py.typed 2023-09-21 13:06:12 +02:00
resolver.py Add flake8-raise rules to ruff. 2024-12-12 20:33:35 +05:00
responsetypes.py Remove --keep-runtime-typing from pyupgrade. 2024-10-17 21:26:02 +05:00
robotstxt.py Bump tool versions. (#6941) 2025-07-05 10:30:30 +02:00
shell.py More *_async APIs (#6997) 2025-08-08 22:15:41 +05:00
signalmanager.py More *_async APIs (#6997) 2025-08-08 22:15:41 +05:00
signals.py Support asynchronous start requests (#6729) 2025-05-07 19:04:03 +02:00
spiderloader.py Don't use CrawlerProcess in the commands that don't need it. (#6824) 2025-05-28 19:57:33 +05:00
squeues.py Bump ruff, switch from black to ruff-format (#6631) 2025-01-27 11:07:09 +01:00
statscollectors.py Deprecate spider arguments of StatsCollector methods (#7011) 2025-08-20 09:52:22 +02:00