RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
scrapy/tests
History
Andrey Rakhmatullin baa579df62
Deprecate various `spider` args in `MiddlewareManager` subclasses (#6984) 
* Add a crawler argument to MiddlewareManager.__init__().

* Deprecate the spider argument in some MiddlewareManager subclasses.

* Remove the spider argument from ExecutionEngine.open_spider_async().

* Remove the spider argument from Scraper.open_spider().

* Fix the Scraper.close_spider() type hint.

* Remove the spider argument from Downloader internals.

* Deprecate the spider arg of download_func.

* Deprecate the spider arg of Downloader.fetch().

* Deprecate the spider arg of ItemPipelineManager.process_item().

* Fix pylint.

* Tests for MiddlewareManager spider code.

* Deprecated spider arg handling for custom pipeline managers.

* Add a test for the deprecated spider arg in a custom downloader.

* Remove TODO.

* Fix pylint.
 		2025-08-05 12:21:08 +05:00
..
AsyncCrawlerProcess Bump tool versions. (#6941) 2025-07-05 10:30:30 +02:00
AsyncCrawlerRunner Add `AsyncCrawlerProcess` and `Crawler.crawl_async()` (#6817) 2025-05-28 18:55:44 +05:00
CrawlerProcess Add `AsyncCrawlerProcess` and `Crawler.crawl_async()` (#6817) 2025-05-28 18:55:44 +05:00
CrawlerRunner Extract in-process test HTTP servers into separate processes (#6960) 2025-07-25 12:42:27 +05:00
keys Commit mitmproxy-dhparam.pem. 2024-11-15 21:08:18 +05:00
mocks Enable the flake8-builtins rules. (#6942) 2025-07-05 21:43:18 +05:00
mockserver Extract in-process test HTTP servers into separate processes (#6960) 2025-07-25 12:42:27 +05:00
sample_data Add support for multiple-compressed responses (#6063) 2024-02-22 12:16:24 +01:00
test_cmdline Converting tests to plain asserts, part 2. (#6699) 2025-03-06 20:52:41 +01:00
test_cmdline_crawl_with_pipeline Fix and ban the top-level twisted.internet.reactor imports. (#6835) 2025-05-28 15:53:52 +05:00
test_settings Bump tool versions. (#6941) 2025-07-05 10:30:30 +02:00
test_spiderloader Don't use CrawlerProcess in the commands that don't need it. (#6824) 2025-05-28 19:57:33 +05:00
test_utils_misc Syntax Error Fixed (#6738) 2025-03-20 17:02:10 +05:00
utils Extract in-process test HTTP servers into separate processes (#6960) 2025-07-25 12:42:27 +05:00
__init__.py Support asynchronous start requests (#6729) 2025-05-07 19:04:03 +02:00
ignores.txt Remove deprecated classes BaseSgmlLinkExtractor, RegexLinkExtractor and SgmlLinkExtractor (#4356) 2020-07-17 12:40:04 +02:00
pipelines.py reaplying black, fixing conflicts and ignoring bandit checks on test directory 2023-01-20 10:55:46 -03:00
spiders.py Fix invalid XML samples in tests that break with lxml 6. (#6919) 2025-06-27 16:24:09 +05:00
test_addons.py Migrate to pytest-twisted (#6938) 2025-07-06 21:27:17 +05:00
test_closespider.py Extract in-process test HTTP servers into separate processes (#6960) 2025-07-25 12:42:27 +05:00
test_command_check.py Remove ProcessTest and SiteTest. (#6885) 2025-06-13 22:18:27 +05:00
test_command_crawl.py Use AsyncCrawlerProcess in commands. (#6845) 2025-06-03 17:47:52 +05:00
test_command_fetch.py Extract in-process test HTTP servers into separate processes (#6960) 2025-07-25 12:42:27 +05:00
test_command_genspider.py Bump tool versions. (#6941) 2025-07-05 10:30:30 +02:00
test_command_parse.py Extract in-process test HTTP servers into separate processes (#6960) 2025-07-25 12:42:27 +05:00
test_command_runspider.py Bump tool versions. (#6941) 2025-07-05 10:30:30 +02:00
test_command_shell.py Extract in-process test HTTP servers into separate processes (#6960) 2025-07-25 12:42:27 +05:00
test_command_startproject.py Refactoring of test_utils_*. (#6905) 2025-06-23 23:39:24 +05:00
test_command_version.py Remove ProcessTest and SiteTest. (#6885) 2025-06-13 22:18:27 +05:00
test_commands.py Bump tool versions. (#6941) 2025-07-05 10:30:30 +02:00
test_contracts.py Extract in-process test HTTP servers into separate processes (#6960) 2025-07-25 12:42:27 +05:00
test_core_downloader.py Deprecate various `spider` args in `MiddlewareManager` subclasses (#6984) 2025-08-05 12:21:08 +05:00
test_crawl.py Extract in-process test HTTP servers into separate processes (#6960) 2025-07-25 12:42:27 +05:00
test_crawler.py Generic improvements related to reactorless tests (#6968) 2025-07-25 13:35:00 +05:00
test_dependencies.py Reduce deps on unittest, unify inlineCallbacks imports in tests. (#6873) 2025-06-06 22:59:09 +02:00
test_downloader_handler_twisted_ftp.py Generic improvements related to reactorless tests (#6968) 2025-07-25 13:35:00 +05:00
test_downloader_handler_twisted_http2.py Extract in-process test HTTP servers into separate processes (#6960) 2025-07-25 12:42:27 +05:00
test_downloader_handler_twisted_http10.py Extract in-process test HTTP servers into separate processes (#6960) 2025-07-25 12:42:27 +05:00
test_downloader_handler_twisted_http11.py Extract in-process test HTTP servers into separate processes (#6960) 2025-07-25 12:42:27 +05:00
test_downloader_handlers.py Generic improvements related to reactorless tests (#6968) 2025-07-25 13:35:00 +05:00
test_downloader_handlers_http_base.py Generic improvements related to reactorless tests (#6968) 2025-07-25 13:35:00 +05:00
test_downloadermiddleware.py Deprecate various `spider` args in `MiddlewareManager` subclasses (#6984) 2025-08-05 12:21:08 +05:00
test_downloadermiddleware_ajaxcrawlable.py Converting tests to plain asserts, part 3. (#6700) 2025-03-06 20:50:14 +01:00
test_downloadermiddleware_cookies.py Converting tests to plain asserts, part 3. (#6700) 2025-03-06 20:50:14 +01:00
test_downloadermiddleware_defaultheaders.py Converting tests to plain asserts, part 3. (#6700) 2025-03-06 20:50:14 +01:00
test_downloadermiddleware_downloadtimeout.py Converting tests to plain asserts, part 3. (#6700) 2025-03-06 20:50:14 +01:00
test_downloadermiddleware_httpauth.py Converting tests to plain asserts, part 3. (#6700) 2025-03-06 20:50:14 +01:00
test_downloadermiddleware_httpcache.py refactor tests/test_downloadermiddleware_httpcache.py (#6769) 2025-05-12 13:04:34 +02:00
test_downloadermiddleware_httpcompression.py Bump tool versions. (#6941) 2025-07-05 10:30:30 +02:00
test_downloadermiddleware_httpproxy.py Converting tests to plain asserts, part 3. (#6700) 2025-03-06 20:50:14 +01:00
test_downloadermiddleware_offsite.py Preparations for switching to direct pytest. (#6678) 2025-02-16 20:28:58 +01:00
test_downloadermiddleware_redirect.py Converting tests to plain asserts, part 3. (#6700) 2025-03-06 20:50:14 +01:00
test_downloadermiddleware_retry.py Enable the flake8-builtins rules. (#6942) 2025-07-05 21:43:18 +05:00
test_downloadermiddleware_robotstxt.py Added download_async() to ExecutionEngine and test cases for download() and download_async() (#6842) 2025-07-27 23:17:51 +05:00
test_downloadermiddleware_stats.py Converting tests to plain asserts, part 3. (#6700) 2025-03-06 20:50:14 +01:00
test_downloadermiddleware_useragent.py Converting tests to plain asserts, part 3. (#6700) 2025-03-06 20:50:14 +01:00
test_downloaderslotssettings.py Deprecate various `spider` args in `MiddlewareManager` subclasses (#6984) 2025-08-05 12:21:08 +05:00
test_dupefilters.py Enable the flake8-builtins rules. (#6942) 2025-07-05 21:43:18 +05:00
test_engine.py Deprecate various `spider` args in `MiddlewareManager` subclasses (#6984) 2025-08-05 12:21:08 +05:00
test_engine_loop.py Generic improvements related to reactorless tests (#6968) 2025-07-25 13:35:00 +05:00
test_engine_stop_download_bytes.py Extract in-process test HTTP servers into separate processes (#6960) 2025-07-25 12:42:27 +05:00
test_engine_stop_download_headers.py Extract in-process test HTTP servers into separate processes (#6960) 2025-07-25 12:42:27 +05:00
test_exporters.py Mark abstract base classes as such. (#6930) 2025-06-30 15:14:34 +05:00
test_extension_periodic_log.py Reduce deps on unittest, unify inlineCallbacks imports in tests. (#6873) 2025-06-06 22:59:09 +02:00
test_extension_telnet.py Migrate to pytest-twisted (#6938) 2025-07-06 21:27:17 +05:00
test_extension_throttle.py Preparations for switching to direct pytest. (#6678) 2025-02-16 20:28:58 +01:00
test_feedexport.py Extract in-process test HTTP servers into separate processes (#6960) 2025-07-25 12:42:27 +05:00
test_http2_client_protocol.py Generic improvements related to reactorless tests (#6968) 2025-07-25 13:35:00 +05:00
test_http_cookies.py Converting tests to plain asserts, part 7. (#6710) 2025-03-09 20:23:51 +01:00
test_http_headers.py Converting tests to plain asserts, part 7. (#6710) 2025-03-09 20:23:51 +01:00
test_http_request.py Migrate to pytest-twisted (#6938) 2025-07-06 21:27:17 +05:00
test_http_response.py Converting tests to plain asserts, part 8. (#6711) 2025-03-09 20:24:12 +01:00
test_item.py Converting tests to plain asserts, part 6. (#6709) 2025-03-09 20:20:24 +01:00
test_link.py Converting tests to plain asserts, part 6. (#6709) 2025-03-09 20:20:24 +01:00
test_linkextractors.py Fix invalid XML samples in tests that break with lxml 6. (#6919) 2025-06-27 16:24:09 +05:00
test_loader.py Converting tests to plain asserts, part 8. (#6711) 2025-03-09 20:24:12 +01:00
test_logformatter.py Extract in-process test HTTP servers into separate processes (#6960) 2025-07-25 12:42:27 +05:00
test_logstats.py Converting tests to plain asserts, part 5. (#6712) 2025-03-09 20:24:45 +01:00
test_mail.py Converting tests to plain asserts, part 5. (#6712) 2025-03-09 20:24:45 +01:00
test_middleware.py Deprecate various `spider` args in `MiddlewareManager` subclasses (#6984) 2025-08-05 12:21:08 +05:00
test_pipeline_crawl.py Extract in-process test HTTP servers into separate processes (#6960) 2025-07-25 12:42:27 +05:00
test_pipeline_files.py Extract in-process test HTTP servers into separate processes (#6960) 2025-07-25 12:42:27 +05:00
test_pipeline_images.py Add type check in get_media_requests to enforce image / file urls as a list (#6949) 2025-07-19 11:54:35 +02:00
test_pipeline_media.py Generic improvements related to reactorless tests (#6968) 2025-07-25 13:35:00 +05:00
test_pipelines.py Deprecate various `spider` args in `MiddlewareManager` subclasses (#6984) 2025-08-05 12:21:08 +05:00
test_poet.py Fix getting annotations for _parse_sitemap() at the runtime. (#6671) 2025-02-14 20:40:06 +05:00
test_pqueues.py Improve the assumption in test_queue_push_pop_priorities(). (#6974) 2025-07-28 20:37:45 +02:00
test_proxy_connect.py Extract in-process test HTTP servers into separate processes (#6960) 2025-07-25 12:42:27 +05:00
test_request_attribute_binding.py Extract in-process test HTTP servers into separate processes (#6960) 2025-07-25 12:42:27 +05:00
test_request_cb_kwargs.py Extract in-process test HTTP servers into separate processes (#6960) 2025-07-25 12:42:27 +05:00
test_request_dict.py Converting tests to plain asserts, part 5. (#6712) 2025-03-09 20:24:45 +01:00
test_request_left.py Extract in-process test HTTP servers into separate processes (#6960) 2025-07-25 12:42:27 +05:00
test_responsetypes.py Converting tests to plain asserts, part 5. (#6712) 2025-03-09 20:24:45 +01:00
test_robotstxt_interface.py Bump tool versions. (#6941) 2025-07-05 10:30:30 +02:00
test_scheduler.py Extract in-process test HTTP servers into separate processes (#6960) 2025-07-25 12:42:27 +05:00
test_scheduler_base.py Extract in-process test HTTP servers into separate processes (#6960) 2025-07-25 12:42:27 +05:00
test_scrapy__getattr__.py Bump tool versions. (#6941) 2025-07-05 10:30:30 +02:00
test_selector.py Test refactoring, part 2. (#6928) 2025-06-29 23:10:38 +02:00
test_signals.py Extract in-process test HTTP servers into separate processes (#6960) 2025-07-25 12:42:27 +05:00
test_spider.py Migrate to pytest-twisted (#6938) 2025-07-06 21:27:17 +05:00
test_spider_start.py Migrate to pytest-twisted (#6938) 2025-07-06 21:27:17 +05:00
test_spidermiddleware.py Deprecate various `spider` args in `MiddlewareManager` subclasses (#6984) 2025-08-05 12:21:08 +05:00
test_spidermiddleware_base.py Test refactoring, part 2. (#6928) 2025-06-29 23:10:38 +02:00
test_spidermiddleware_depth.py Test refactoring, part 2. (#6928) 2025-06-29 23:10:38 +02:00
test_spidermiddleware_httperror.py Extract in-process test HTTP servers into separate processes (#6960) 2025-07-25 12:42:27 +05:00
test_spidermiddleware_output_chain.py Extract in-process test HTTP servers into separate processes (#6960) 2025-07-25 12:42:27 +05:00
test_spidermiddleware_process_start.py Migrate to pytest-twisted (#6938) 2025-07-06 21:27:17 +05:00
test_spidermiddleware_referer.py Bump tool versions. (#6941) 2025-07-05 10:30:30 +02:00
test_spidermiddleware_start.py Migrate to pytest-twisted (#6938) 2025-07-06 21:27:17 +05:00
test_spidermiddleware_urllength.py Test refactoring, part 2. (#6928) 2025-06-29 23:10:38 +02:00
test_spiderstate.py Test refactoring, part 2. (#6928) 2025-06-29 23:10:38 +02:00
test_squeues.py Better fix for test_non_pickable_object on Windows. 2025-03-10 13:15:28 +05:00
test_squeues_request.py Test refactoring, part 2. (#6928) 2025-06-29 23:10:38 +02:00
test_stats.py Test refactoring, part 2. (#6928) 2025-06-29 23:10:38 +02:00
test_toplevel.py Bump tool versions. (#6941) 2025-07-05 10:30:30 +02:00
test_utils_asyncgen.py Migrate to pytest-twisted (#6938) 2025-07-06 21:27:17 +05:00
test_utils_asyncio.py Migrate to pytest-twisted (#6938) 2025-07-06 21:27:17 +05:00
test_utils_conf.py Refactoring of test_utils_*. (#6905) 2025-06-23 23:39:24 +05:00
test_utils_console.py Refactoring of test_utils_*. (#6905) 2025-06-23 23:39:24 +05:00
test_utils_curl.py Refactoring of test_utils_*. (#6905) 2025-06-23 23:39:24 +05:00
test_utils_datatypes.py Enable the flake8-builtins rules. (#6942) 2025-07-05 21:43:18 +05:00
test_utils_defer.py Migrate to pytest-twisted (#6938) 2025-07-06 21:27:17 +05:00
test_utils_deprecate.py Refactoring of test_utils_*. (#6905) 2025-06-23 23:39:24 +05:00
test_utils_display.py Enable the flake8-builtins rules. (#6942) 2025-07-05 21:43:18 +05:00
test_utils_gz.py Refactoring of test_utils_*. (#6905) 2025-06-23 23:39:24 +05:00
test_utils_httpobj.py Refactoring of test_utils_*. (#6905) 2025-06-23 23:39:24 +05:00
test_utils_iterators.py Enable the flake8-builtins rules. (#6942) 2025-07-05 21:43:18 +05:00
test_utils_log.py Refactoring of test_utils_*. (#6905) 2025-06-23 23:39:24 +05:00
test_utils_project.py Refactoring of test_utils_*. (#6905) 2025-06-23 23:39:24 +05:00
test_utils_python.py Deprecate various `spider` args in `MiddlewareManager` subclasses (#6984) 2025-08-05 12:21:08 +05:00
test_utils_reactor.py Migrate to pytest-twisted (#6938) 2025-07-06 21:27:17 +05:00
test_utils_request.py Refactoring of test_utils_*. (#6905) 2025-06-23 23:39:24 +05:00
test_utils_response.py Refactoring of test_utils_*. (#6905) 2025-06-23 23:39:24 +05:00
test_utils_serialize.py Enable the flake8-builtins rules. (#6942) 2025-07-05 21:43:18 +05:00
test_utils_signal.py Generic improvements related to reactorless tests (#6968) 2025-07-25 13:35:00 +05:00
test_utils_sitemap.py Refactoring of test_utils_*. (#6905) 2025-06-23 23:39:24 +05:00
test_utils_spider.py Bump tool versions. (#6941) 2025-07-05 10:30:30 +02:00
test_utils_template.py Refactoring of test_utils_*. (#6905) 2025-06-23 23:39:24 +05:00
test_utils_trackref.py Refactoring of test_utils_*. (#6905) 2025-06-23 23:39:24 +05:00
test_utils_url.py Bump tool versions. (#6941) 2025-07-05 10:30:30 +02:00
test_webclient.py Extract in-process test HTTP servers into separate processes (#6960) 2025-07-25 12:42:27 +05:00
upper-constraints.txt upper-constraints.txt: restrict botocore further 2021-03-18 23:42:29 +01:00