scrapy/tests
Adrian 06af687662
Fail with a clear message when Spider.start() is not an asynchronous generator (#7946)
* Fail with a clear message when Spider.start() is not an asynchronous generator

* Silence pylint
2026-08-14 14:25:35 +05:00
..
AsyncCrawlerProcess Stop skipping the IPv6 resolver tests (#7935) 2026-08-09 13:57:44 +05:00
AsyncCrawlerRunner
CrawlerProcess Stop skipping the IPv6 resolver tests (#7935) 2026-08-09 13:57:44 +05:00
CrawlerRunner
benchmarks Add URL benchmarks (#7914) 2026-08-09 14:12:44 +05:00
keys Add FTPS support to the FTP feed export storage (#7953) 2026-08-10 11:33:58 +02:00
mocks
mockserver Add FTPS support to the FTP feed export storage (#7953) 2026-08-10 11:33:58 +02:00
sample_data
test_cmdline Simplify cmdline settings test (#7853) 2026-08-09 14:55:58 +05:00
test_cmdline_crawl_with_pipeline
test_settings
test_spiderloader
test_utils_misc Next refactoring pass of test_utils_*. (#7797) 2026-07-28 14:24:34 +02:00
utils Rerun tests that need real Internet access when they fail (#7985) 2026-08-12 21:46:00 +02:00
__init__.py
ignores.txt Address warnings from the VCS workflow (#7966) 2026-08-10 13:46:20 +05:00
pipelines.py
spiders.py Improve spiders coverage (#7768) 2026-07-28 15:24:04 +05:00
test_addons.py
test_closespider.py
test_command_check.py Remove remaining cross-imports in test modules. (#7782) 2026-07-27 12:19:12 +02:00
test_command_crawl.py Improve test coverage for scrapy.commands (#7829) 2026-07-31 12:19:49 +05:00
test_command_fetch.py Improve test coverage for scrapy.commands (#7829) 2026-07-31 12:19:49 +05:00
test_command_genspider.py Improve test coverage for scrapy.commands (#7829) 2026-07-31 12:19:49 +05:00
test_command_parse.py Improve test coverage for scrapy.commands (#7829) 2026-07-31 12:19:49 +05:00
test_command_runspider.py Improve test coverage for scrapy.commands (#7829) 2026-07-31 12:19:49 +05:00
test_command_shell.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_command_startproject.py
test_command_version.py
test_commands.py Improve test coverage for scrapy.commands (#7829) 2026-07-31 12:19:49 +05:00
test_contracts.py
test_core_downloader.py Type tests.mockserver and other resource-defining files (#7865) 2026-08-03 23:44:28 +05:00
test_core_scraper.py
test_crawl.py Improve spiders coverage (#7768) 2026-07-28 15:24:04 +05:00
test_crawler.py Type late Crawler attributes as always set instead of None (#7882) 2026-08-10 09:07:34 +02:00
test_crawler_runners.py
test_crawler_subprocess.py Report exceptions from Spider.start() (#7884) 2026-08-09 22:56:03 +05:00
test_dependencies.py
test_downloader_handler_httpx.py Implement browser-like bad header handling for the default download handler (#7806) 2026-08-10 13:59:44 +05:00
test_downloader_handler_twisted_ftp.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_downloader_handler_twisted_http2.py Stop marking the Twisted-based HTTP/2 download handler as experimental, and privatize its API (#7986) 2026-08-12 23:33:38 +05:00
test_downloader_handler_twisted_http11.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_downloader_handlers.py
test_downloadermiddleware.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_downloadermiddleware_cookies.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_downloadermiddleware_defaultheaders.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_downloadermiddleware_downloadtimeout.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_downloadermiddleware_httpauth.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_downloadermiddleware_httpcache.py Stop test_storage from expiring its cache entry on slow runners (#7993) 2026-08-13 11:42:38 +02:00
test_downloadermiddleware_httpcompression.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_downloadermiddleware_httpproxy.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_downloadermiddleware_offsite.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_downloadermiddleware_redirect.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_downloadermiddleware_redirect_metarefresh.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_downloadermiddleware_retry.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_downloadermiddleware_robotstxt.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_downloadermiddleware_stats.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_downloadermiddleware_useragent.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_downloaderslotssettings.py
test_dupefilters.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_engine.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_engine_close_spider.py
test_engine_download.py Cover passing spider to a deprecated Downloader.fetch() (#7863) 2026-08-03 13:55:39 +02:00
test_engine_loop.py Fail with a clear message when Spider.start() is not an asynchronous generator (#7946) 2026-08-14 14:25:35 +05:00
test_engine_stop_download_bytes.py Remove remaining cross-imports in test modules. (#7782) 2026-07-27 12:19:12 +02:00
test_engine_stop_download_headers.py Remove remaining cross-imports in test modules. (#7782) 2026-07-27 12:19:12 +02:00
test_exporters.py Serialize dates and times as ISO 8601 in ScrapyJSONEncoder (#7918) 2026-08-10 14:07:42 +05:00
test_extension_debug.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_extension_memdebug.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_extension_memusage.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_extension_periodic_log.py Deprecate PeriodicLog.multiplier instead of removing it altogether (#7982) 2026-08-12 11:23:41 +05:00
test_extension_statsmailer.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_extension_telnet.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_extension_throttle.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_feedexport.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_feedexport_batch.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_feedexport_postprocess.py Type tests involving items and exports (#7867) 2026-08-09 22:51:20 +05:00
test_feedexport_storages.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_feedexport_uri_params.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_http2_client_protocol.py Speed up test_POST_large_json_x10 with a smaller JSON (#7859) 2026-08-14 14:23:00 +05:00
test_http_cookies.py
test_http_headers.py Type tests related to requests and responses (#7864) 2026-08-03 17:16:23 +05:00
test_http_request.py Type tests related to requests and responses (#7864) 2026-08-03 17:16:23 +05:00
test_http_request_form.py Type tests related to requests and responses (#7864) 2026-08-03 17:16:23 +05:00
test_http_request_json.py Remove remaining cross-imports in test modules. (#7782) 2026-07-27 12:19:12 +02:00
test_http_response.py Remove remaining cross-imports in test modules. (#7782) 2026-07-27 12:19:12 +02:00
test_http_response_text.py Fall back to the response encoding in TextResponse.json() (#7897) 2026-08-09 16:58:09 +05:00
test_item.py Type tests involving items and exports (#7867) 2026-08-09 22:51:20 +05:00
test_link.py
test_linkextractors.py Canonicalize each extracted link once (#7961) 2026-08-09 22:30:30 +05:00
test_loader.py Type tests involving items and exports (#7867) 2026-08-09 22:51:20 +05:00
test_logformatter.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_logstats.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_mail.py
test_middleware.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_pipeline_crawl.py Type tests involving items and exports (#7867) 2026-08-09 22:51:20 +05:00
test_pipeline_files.py Deprecate the old import path of FileException (#7973) 2026-08-10 20:19:46 +02:00
test_pipeline_images.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_pipeline_media.py Deprecate the old import path of FileException (#7973) 2026-08-10 20:19:46 +02:00
test_pipelines.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_poet.py
test_pqueues.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_request_attribute_binding.py Type tests related to requests and responses (#7864) 2026-08-03 17:16:23 +05:00
test_request_cb_kwargs.py Type tests related to requests and responses (#7864) 2026-08-03 17:16:23 +05:00
test_request_dict.py Type tests related to requests and responses (#7864) 2026-08-03 17:16:23 +05:00
test_request_left.py Type tests related to requests and responses (#7864) 2026-08-03 17:16:23 +05:00
test_resolver.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_responsetypes.py
test_robotstxt_interface.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_scheduler.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_scheduler_base.py Migrate away from testfixtures. (#7793) 2026-07-28 09:52:52 +02:00
test_scrapy__getattr__.py
test_selector.py
test_signalmanager.py
test_signals.py
test_spider.py Improve spiders coverage (#7768) 2026-07-28 15:24:04 +05:00
test_spider_crawl.py Improve spiders coverage (#7768) 2026-07-28 15:24:04 +05:00
test_spider_sitemap.py Improve spiders coverage (#7768) 2026-07-28 15:24:04 +05:00
test_spider_start.py
test_spidermiddleware.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_spidermiddleware_base.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_spidermiddleware_depth.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_spidermiddleware_httperror.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_spidermiddleware_metacopy.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_spidermiddleware_output_chain.py Migrate away from testfixtures. (#7793) 2026-07-28 09:52:52 +02:00
test_spidermiddleware_process_start.py Remove remaining cross-imports in test modules. (#7782) 2026-07-27 12:19:12 +02:00
test_spidermiddleware_referer.py
test_spidermiddleware_start.py
test_spidermiddleware_urllength.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_spiderstate.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_squeues.py
test_squeues_request.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_stats.py Generalize the use of build_from_crawler() internally (#7808) 2026-08-10 20:55:10 +05:00
test_toplevel.py
test_utils_asyncgen.py Next refactoring pass of test_utils_*. (#7797) 2026-07-28 14:24:34 +02:00
test_utils_asyncio.py Add scrapy.utils.asyncio.sleep() (#7843) 2026-07-31 18:59:38 +05:00
test_utils_conf.py
test_utils_console.py Address warnings from the VCS workflow (#7966) 2026-08-10 13:46:20 +05:00
test_utils_curl.py Next refactoring pass of test_utils_*. (#7797) 2026-07-28 14:24:34 +02:00
test_utils_datatypes.py Next refactoring pass of test_utils_*. (#7797) 2026-07-28 14:24:34 +02:00
test_utils_decorators.py Don't evaluate annotations when inspecting signatures (#7818) 2026-07-30 20:18:45 +05:00
test_utils_defer.py Next refactoring pass of test_utils_*. (#7797) 2026-07-28 14:24:34 +02:00
test_utils_deprecate.py Next refactoring pass of test_utils_*. (#7797) 2026-07-28 14:24:34 +02:00
test_utils_display.py Next refactoring pass of test_utils_*. (#7797) 2026-07-28 14:24:34 +02:00
test_utils_gz.py Next refactoring pass of test_utils_*. (#7797) 2026-07-28 14:24:34 +02:00
test_utils_httpobj.py Next refactoring pass of test_utils_*. (#7797) 2026-07-28 14:24:34 +02:00
test_utils_iterators.py
test_utils_log.py Deprecate interpolating log formatter messages with the returned dict (#7971) 2026-08-10 21:29:53 +05:00
test_utils_project.py Next refactoring pass of test_utils_*. (#7797) 2026-07-28 14:24:34 +02:00
test_utils_python.py Don't evaluate annotations when inspecting signatures (#7818) 2026-07-30 20:18:45 +05:00
test_utils_reactor.py Next refactoring pass of test_utils_*. (#7797) 2026-07-28 14:24:34 +02:00
test_utils_reactorless.py
test_utils_request.py Add Request.to_curl() (#7743) (#7802) 2026-07-29 13:47:15 +05:00
test_utils_response.py Stop the open_in_browser ReDoS tests from failing on slow interpreters (#7995) 2026-08-14 11:07:41 +05:00
test_utils_serialize.py Serialize dates and times as ISO 8601 in ScrapyJSONEncoder (#7918) 2026-08-10 14:07:42 +05:00
test_utils_signal.py Next refactoring pass of test_utils_*. (#7797) 2026-07-28 14:24:34 +02:00
test_utils_sitemap.py Next refactoring pass of test_utils_*. (#7797) 2026-07-28 14:24:34 +02:00
test_utils_spider.py
test_utils_template.py Next refactoring pass of test_utils_*. (#7797) 2026-07-28 14:24:34 +02:00
test_utils_trackref.py Let trackref release classes defined at run time (#7922) 2026-08-10 13:09:57 +05:00
test_utils_url.py Next refactoring pass of test_utils_*. (#7797) 2026-07-28 14:24:34 +02:00
test_zz_resources.py