..
AsyncCrawlerProcess
Foundations for the reactorless mode. ( #7199 )
2026-01-31 20:48:54 +05:00
AsyncCrawlerRunner
Foundations for the reactorless mode. ( #7199 )
2026-01-31 20:48:54 +05:00
CrawlerProcess
Foundations for the reactorless mode. ( #7199 )
2026-01-31 20:48:54 +05:00
CrawlerRunner
Foundations for the reactorless mode. ( #7199 )
2026-01-31 20:48:54 +05:00
keys
Update tool versions ( #7127 )
2025-10-27 14:11:31 +01:00
mocks
Enable the flake8-builtins rules. ( #6942 )
2025-07-05 21:43:18 +05:00
mockserver
Unified download handler exceptions ( #7208 )
2026-01-21 23:09:54 +05:00
sample_data
Add support for multiple-compressed responses ( #6063 )
2024-02-22 12:16:24 +01:00
test_cmdline
Converting tests to plain asserts, part 2. ( #6699 )
2025-03-06 20:52:41 +01:00
test_cmdline_crawl_with_pipeline
Update tool versions ( #7127 )
2025-10-27 14:11:31 +01:00
test_settings
Fix override behavior in getwithbase() issue #6912 ( #6993 )
2026-02-07 00:17:55 +04:00
test_spiderloader
Don't use CrawlerProcess in the commands that don't need it. ( #6824 )
2025-05-28 19:57:33 +05:00
test_utils_misc
Remove code deprecated in 2.12.0 ( #7126 )
2025-10-27 17:14:38 +05:00
utils
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
__init__.py
Support asynchronous start requests ( #6729 )
2025-05-07 19:04:03 +02:00
ignores.txt
Remove deprecated classes BaseSgmlLinkExtractor, RegexLinkExtractor and SgmlLinkExtractor ( #4356 )
2020-07-17 12:40:04 +02:00
pipelines.py
Deprecate spider args of middlewares and pipelines. ( #7006 )
2025-08-21 13:23:10 +05:00
spiders.py
Fix invalid XML samples in tests that break with lxml 6. ( #6919 )
2025-06-27 16:24:09 +05:00
test_addons.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_closespider.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_command_check.py
Speed up and refactor command tests ( #7118 )
2025-10-27 12:28:16 +01:00
test_command_crawl.py
Speed up and refactor command tests ( #7118 )
2025-10-27 12:28:16 +01:00
test_command_fetch.py
Speed up and refactor command tests ( #7118 )
2025-10-27 12:28:16 +01:00
test_command_genspider.py
Update tool versions ( #7127 )
2025-10-27 14:11:31 +01:00
test_command_parse.py
Speed up and refactor command tests ( #7118 )
2025-10-27 12:28:16 +01:00
test_command_runspider.py
Unified download handler exceptions ( #7208 )
2026-01-21 23:09:54 +05:00
test_command_shell.py
Unified download handler exceptions ( #7208 )
2026-01-21 23:09:54 +05:00
test_command_startproject.py
Update tool versions ( #7127 )
2025-10-27 14:11:31 +01:00
test_command_version.py
Speed up and refactor command tests ( #7118 )
2025-10-27 12:28:16 +01:00
test_commands.py
Speed up and refactor command tests ( #7118 )
2025-10-27 12:28:16 +01:00
test_contracts.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_core_downloader.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_core_scraper.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_crawl.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_crawler.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_dependencies.py
Reduce deps on unittest, unify inlineCallbacks imports in tests. ( #6873 )
2025-06-06 22:59:09 +02:00
test_downloader_handler_twisted_ftp.py
Reactorless tests 1: the test env ( #6952 )
2026-02-02 19:25:30 +05:00
test_downloader_handler_twisted_http2.py
Reactorless tests 2: enable pytest-asyncio. ( #7233 )
2026-02-02 19:36:23 +01:00
test_downloader_handler_twisted_http10.py
Reactorless tests 1: the test env ( #6952 )
2026-02-02 19:25:30 +05:00
test_downloader_handler_twisted_http11.py
Reactorless tests 1: the test env ( #6952 )
2026-02-02 19:25:30 +05:00
test_downloader_handlers.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_downloader_handlers_http_base.py
Refactor HTTP download handlers ( #7238 )
2026-02-03 20:13:30 +01:00
test_downloadermiddleware.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_downloadermiddleware_ajaxcrawlable.py
Converting tests to plain asserts, part 3. ( #6700 )
2025-03-06 20:50:14 +01:00
test_downloadermiddleware_cookies.py
Deprecate the spider arg of downloader middleware methods. ( #7037 )
2025-09-02 21:51:47 +05:00
test_downloadermiddleware_defaultheaders.py
Deprecate the spider arg of downloader middleware methods. ( #7037 )
2025-09-02 21:51:47 +05:00
test_downloadermiddleware_downloadtimeout.py
Deprecate spider attributes that can be replaced by settings, round 2 ( #7039 )
2025-12-01 01:26:17 +05:00
test_downloadermiddleware_httpauth.py
Deprecate the spider arg of downloader middleware methods. ( #7037 )
2025-09-02 21:51:47 +05:00
test_downloadermiddleware_httpcache.py
Deprecate the spider arg of downloader middleware methods. ( #7037 )
2025-09-02 21:51:47 +05:00
test_downloadermiddleware_httpcompression.py
Restore brotlicffi support ( #7160 )
2025-11-25 12:06:55 +05:00
test_downloadermiddleware_httpproxy.py
Deprecate the spider arg of downloader middleware methods. ( #7037 )
2025-09-02 21:51:47 +05:00
test_downloadermiddleware_offsite.py
Deprecate the spider arg of downloader middleware methods. ( #7037 )
2025-09-02 21:51:47 +05:00
test_downloadermiddleware_redirect.py
Deprecate the spider arg of downloader middleware methods. ( #7037 )
2025-09-02 21:51:47 +05:00
test_downloadermiddleware_retry.py
Unified download handler exceptions ( #7208 )
2026-01-21 23:09:54 +05:00
test_downloadermiddleware_robotstxt.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_downloadermiddleware_stats.py
Deprecate the spider arg of downloader middleware methods. ( #7037 )
2025-09-02 21:51:47 +05:00
test_downloadermiddleware_useragent.py
Deprecate spider attributes that can be replaced by settings, round 2 ( #7039 )
2025-12-01 01:26:17 +05:00
test_downloaderslotssettings.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_dupefilters.py
Enable the flake8-builtins rules. ( #6942 )
2025-07-05 21:43:18 +05:00
test_engine.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_engine_loop.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_engine_stop_download_bytes.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_engine_stop_download_headers.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_exporters.py
Mark abstract base classes as such. ( #6930 )
2025-06-30 15:14:34 +05:00
test_extension_periodic_log.py
Reactorless tests 1: the test env ( #6952 )
2026-02-02 19:25:30 +05:00
test_extension_statsmailer.py
Update tool versions ( #7127 )
2025-10-27 14:11:31 +01:00
test_extension_telnet.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_extension_throttle.py
Preparations for switching to direct pytest. ( #6678 )
2025-02-16 20:28:58 +01:00
test_feedexport.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_http2_client_protocol.py
Refactor HTTP download handlers ( #7238 )
2026-02-03 20:13:30 +01:00
test_http_cookies.py
Converting tests to plain asserts, part 7. ( #6710 )
2025-03-09 20:23:51 +01:00
test_http_headers.py
Update tool versions ( #7127 )
2025-10-27 14:11:31 +01:00
test_http_request.py
Reducing memory footprint of `Request` object: __slots__ and lazy evaluation ( #7036 )
2026-02-05 22:15:53 +04:00
test_http_response.py
Update tool versions ( #7127 )
2025-10-27 14:11:31 +01:00
test_item.py
Update tool versions ( #7127 )
2025-10-27 14:11:31 +01:00
test_link.py
Converting tests to plain asserts, part 6. ( #6709 )
2025-03-09 20:20:24 +01:00
test_linkextractors.py
Fix invalid XML samples in tests that break with lxml 6. ( #6919 )
2025-06-27 16:24:09 +05:00
test_loader.py
Converting tests to plain asserts, part 8. ( #6711 )
2025-03-09 20:24:12 +01:00
test_logformatter.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_logstats.py
Reactorless tests 1: the test env ( #6952 )
2026-02-02 19:25:30 +05:00
test_mail.py
Reactorless tests 1: the test env ( #6952 )
2026-02-02 19:25:30 +05:00
test_middleware.py
Deprecate the spider arg of downloader middleware methods. ( #7037 )
2025-09-02 21:51:47 +05:00
test_pipeline_crawl.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_pipeline_files.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_pipeline_images.py
Update tool versions ( #7127 )
2025-10-27 14:11:31 +01:00
test_pipeline_media.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_pipelines.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_poet.py
Fix getting annotations for _parse_sitemap() at the runtime. ( #6671 )
2025-02-14 20:40:06 +05:00
test_pqueues.py
Improve the assumption in test_queue_push_pop_priorities(). ( #6974 )
2025-07-28 20:37:45 +02:00
test_proxy_connect.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_request_attribute_binding.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_request_cb_kwargs.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_request_dict.py
Converting tests to plain asserts, part 5. ( #6712 )
2025-03-09 20:24:45 +01:00
test_request_left.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_responsetypes.py
Converting tests to plain asserts, part 5. ( #6712 )
2025-03-09 20:24:45 +01:00
test_robotstxt_interface.py
UTF-8 BOM at the beginning of the file ignored ( #7095 )
2025-10-15 18:15:07 +04:00
test_scheduler.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_scheduler_base.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_scrapy__getattr__.py
Remove code deprecated in 2.12.0 ( #7126 )
2025-10-27 17:14:38 +05:00
test_selector.py
Test refactoring, part 2. ( #6928 )
2025-06-29 23:10:38 +02:00
test_signals.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_spider.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_spider_start.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_spidermiddleware.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_spidermiddleware_base.py
Extract @_warn_spider_arg. ( #7033 )
2025-09-01 20:17:13 +05:00
test_spidermiddleware_depth.py
Deprecate spider args of middlewares and pipelines. ( #7006 )
2025-08-21 13:23:10 +05:00
test_spidermiddleware_httperror.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_spidermiddleware_output_chain.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_spidermiddleware_process_start.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_spidermiddleware_referer.py
Deprecate the spider arg of downloader middleware methods. ( #7037 )
2025-09-02 21:51:47 +05:00
test_spidermiddleware_start.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_spidermiddleware_urllength.py
Deprecate spider args of middlewares and pipelines. ( #7006 )
2025-08-21 13:23:10 +05:00
test_spiderstate.py
Test refactoring, part 2. ( #6928 )
2025-06-29 23:10:38 +02:00
test_squeues.py
Update tool versions ( #7127 )
2025-10-27 14:11:31 +01:00
test_squeues_request.py
Test refactoring, part 2. ( #6928 )
2025-06-29 23:10:38 +02:00
test_stats.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_toplevel.py
Bump tool versions. ( #6941 )
2025-07-05 10:30:30 +02:00
test_utils_asyncgen.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_utils_asyncio.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_utils_conf.py
Update tool versions ( #7127 )
2025-10-27 14:11:31 +01:00
test_utils_console.py
Refactoring of test_utils_*. ( #6905 )
2025-06-23 23:39:24 +05:00
test_utils_curl.py
Update tool versions ( #7127 )
2025-10-27 14:11:31 +01:00
test_utils_datatypes.py
Enable the flake8-builtins rules. ( #6942 )
2025-07-05 21:43:18 +05:00
test_utils_defer.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_utils_deprecate.py
Merge pull request #7145 from Icorebleidd/master
2025-11-28 01:16:02 +05:00
test_utils_display.py
Enable the flake8-builtins rules. ( #6942 )
2025-07-05 21:43:18 +05:00
test_utils_gz.py
Refactoring of test_utils_*. ( #6905 )
2025-06-23 23:39:24 +05:00
test_utils_httpobj.py
Refactoring of test_utils_*. ( #6905 )
2025-06-23 23:39:24 +05:00
test_utils_iterators.py
Enable the flake8-builtins rules. ( #6942 )
2025-07-05 21:43:18 +05:00
test_utils_log.py
Refactoring of test_utils_*. ( #6905 )
2025-06-23 23:39:24 +05:00
test_utils_project.py
Refactoring of test_utils_*. ( #6905 )
2025-06-23 23:39:24 +05:00
test_utils_python.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_utils_reactor.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_utils_request.py
Remove code deprecated in 2.12.0 ( #7126 )
2025-10-27 17:14:38 +05:00
test_utils_response.py
Fix get_meta_refresh to correctly resolve relative URLs using <base> tag ( #7047 )
2025-09-10 15:17:16 +02:00
test_utils_serialize.py
Enable the flake8-builtins rules. ( #6942 )
2025-07-05 21:43:18 +05:00
test_utils_signal.py
Rename async test decorators. ( #7234 )
2026-02-02 20:39:43 +01:00
test_utils_sitemap.py
Refactoring of test_utils_*. ( #6905 )
2025-06-23 23:39:24 +05:00
test_utils_spider.py
Bump tool versions. ( #6941 )
2025-07-05 10:30:30 +02:00
test_utils_template.py
Refactoring of test_utils_*. ( #6905 )
2025-06-23 23:39:24 +05:00
test_utils_trackref.py
Refactoring of test_utils_*. ( #6905 )
2025-06-23 23:39:24 +05:00
test_utils_url.py
Bump tool versions. ( #6941 )
2025-07-05 10:30:30 +02:00
test_webclient.py
Reactorless tests 1: the test env ( #6952 )
2026-02-02 19:25:30 +05:00
test_zz_resources.py
Reactorless tests 2: enable pytest-asyncio. ( #7233 )
2026-02-02 19:36:23 +01:00