RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
scrapy/tests
History
Andrey Rakhmatullin 2798c03bb0
Add Python 3.14 to CI. (#6604) 
* Add Python 3.14 (alpha3) to CI.

* Disable mitmproxy on 3.14 for now.

* 3.14.0-alpha.4.

* 3.14.0-alpha.5

* 3.14.0-beta2.

* 3.14 release.

* Fix test_non_pickable_object.

* Fix handling of file:/path feed URIs.

* Better mocking of streams for TextTestResult.

* Do not use .php in test_file_path() as it's now a known extension.

* Fix the URL in TestFeedExporterSignals.

* Fix typing.

* Bump more envs to 3.14.

* Silence pylint.

* Fix another test for .php handling change.

* Remove test_install_asyncio_reactor.

* More bumps to 3.14.

* Revert docs-tests to use 3.13.

* Debug options for Windows.

* Re-enable xdist.

* Revert Windows PYTEST_ADDOPTS.

* Silence loop policy deprecation warnings.

* Restore a lost pylint suppression.

* Update asyncio_enabled_reactor_same_loop.py to new Twisted.

* Fix RobotFileParser tests for Python 3.14.5.
 		2026-05-12 23:49:37 +05:00
..
AsyncCrawlerProcess Rename DNS_RESOLVER to TWISTED_DNS_RESOLVER (#7361) 2026-04-08 13:58:35 +02:00
AsyncCrawlerRunner Rename TWISTED_ENABLED to TWISTED_REACTOR_ENABLED. (#7394) 2026-04-02 10:20:54 +02:00
CrawlerProcess Add Python 3.14 to CI. (#6604) 2026-05-12 23:49:37 +05:00
CrawlerRunner Rename TWISTED_ENABLED to TWISTED_REACTOR_ENABLED. (#7394) 2026-04-02 10:20:54 +02:00
keys Update tool versions (#7127) 2025-10-27 14:11:31 +01:00
mocks Enable the flake8-builtins rules. (#6942) 2025-07-05 21:43:18 +05:00
mockserver Update the TLS code to Twisted 26.4.0 (#7347) 2026-05-12 18:22:31 +05:00
sample_data Add support for multiple-compressed responses (#6063) 2024-02-22 12:16:24 +01:00
test_cmdline Converting tests to plain asserts, part 2. (#6699) 2025-03-06 20:52:41 +01:00
test_cmdline_crawl_with_pipeline Fix open_spider exception handling to set exit code 1 (#7255) 2026-02-19 11:21:59 +01:00
test_settings Restore 2.14 getwithbase, add a new method for class key deduplication (#7449) 2026-04-22 19:00:39 +05:00
test_spiderloader Don't use CrawlerProcess in the commands that don't need it. (#6824) 2025-05-28 19:57:33 +05:00
test_utils_misc deprecate `walk_modules` in favour of `walk_modules_iter` (#7388) 2026-04-01 22:11:35 +05:00
utils Enable mypy warn_return_any. (#7492) 2026-05-04 22:24:47 +02:00
__init__.py TLS code modernization (#7353) 2026-03-25 15:42:43 +05:00
ignores.txt Remove deprecated classes BaseSgmlLinkExtractor, RegexLinkExtractor and SgmlLinkExtractor (#4356) 2020-07-17 12:40:04 +02:00
pipelines.py Deprecate spider args of middlewares and pipelines. (#7006) 2025-08-21 13:23:10 +05:00
spiders.py Disable mypy allow_untyped_calls. (#7331) 2026-03-24 10:31:17 +01:00
test_addons.py Rename TWISTED_ENABLED to TWISTED_REACTOR_ENABLED. (#7394) 2026-04-02 10:20:54 +02:00
test_closespider.py Enable in-process HTTP tests without a reactor. (#7254) 2026-02-13 19:08:06 +01:00
test_command_check.py Fixes for Python 3.14. (#7460) 2026-04-27 18:47:52 +05:00
test_command_crawl.py Rename TWISTED_ENABLED to TWISTED_REACTOR_ENABLED. (#7394) 2026-04-02 10:20:54 +02:00
test_command_fetch.py Rename TWISTED_ENABLED to TWISTED_REACTOR_ENABLED. (#7394) 2026-04-02 10:20:54 +02:00
test_command_genspider.py Update tool versions (#7127) 2025-10-27 14:11:31 +01:00
test_command_parse.py Rename TWISTED_ENABLED to TWISTED_REACTOR_ENABLED. (#7394) 2026-04-02 10:20:54 +02:00
test_command_runspider.py Rename TWISTED_ENABLED to TWISTED_REACTOR_ENABLED. (#7394) 2026-04-02 10:20:54 +02:00
test_command_shell.py Reactorless shell and other small shell improvements (#7395) 2026-04-08 18:24:51 +05:00
test_command_startproject.py Update tool versions (#7127) 2025-10-27 14:11:31 +01:00
test_command_version.py Speed up and refactor command tests (#7118) 2025-10-27 12:28:16 +01:00
test_commands.py Improve commands (#7376) 2026-04-08 14:59:00 +02:00
test_contracts.py Deprecate FormRequest in favor of form2request (#6438) 2026-05-04 22:38:29 +05:00
test_core_downloader.py Update the TLS code to Twisted 26.4.0 (#7347) 2026-05-12 18:22:31 +05:00
test_core_scraper.py Enable in-process HTTP tests without a reactor. (#7254) 2026-02-13 19:08:06 +01:00
test_crawl.py Rename TWISTED_ENABLED to TWISTED_REACTOR_ENABLED. (#7394) 2026-04-02 10:20:54 +02:00
test_crawler.py Rename TWISTED_ENABLED to TWISTED_REACTOR_ENABLED. (#7394) 2026-04-02 10:20:54 +02:00
test_crawler_subprocess.py Add Python 3.14 to CI. (#6604) 2026-05-12 23:49:37 +05:00
test_dependencies.py Reduce deps on unittest, unify inlineCallbacks imports in tests. (#6873) 2025-06-06 22:59:09 +02:00
test_downloader_handler_httpx.py Cleanup/clarifications of proxy support and improvements for proxy tests (#7496) 2026-05-12 17:45:54 +05:00
test_downloader_handler_twisted_ftp.py Rename TWISTED_ENABLED to TWISTED_REACTOR_ENABLED. (#7394) 2026-04-02 10:20:54 +02:00
test_downloader_handler_twisted_http2.py Cleanup/clarifications of proxy support and improvements for proxy tests (#7496) 2026-05-12 17:45:54 +05:00
test_downloader_handler_twisted_http11.py Cleanup/clarifications of proxy support and improvements for proxy tests (#7496) 2026-05-12 17:45:54 +05:00
test_downloader_handlers.py Dynamic loading for S3 HTTPS handler (#7370) 2026-03-30 10:12:43 +02:00
test_downloader_handlers_http_base.py Cleanup/clarifications of proxy support and improvements for proxy tests (#7496) 2026-05-12 17:45:54 +05:00
test_downloadermiddleware.py Rename async test decorators. (#7234) 2026-02-02 20:39:43 +01:00
test_downloadermiddleware_cookies.py Deprecate the spider arg of downloader middleware methods. (#7037) 2025-09-02 21:51:47 +05:00
test_downloadermiddleware_defaultheaders.py Deprecate the spider arg of downloader middleware methods. (#7037) 2025-09-02 21:51:47 +05:00
test_downloadermiddleware_downloadtimeout.py Deprecate spider attributes that can be replaced by settings, round 2 (#7039) 2025-12-01 01:26:17 +05:00
test_downloadermiddleware_httpauth.py Deprecate the spider arg of downloader middleware methods. (#7037) 2025-09-02 21:51:47 +05:00
test_downloadermiddleware_httpcache.py Deprecate ScrapyCommand.set_crawler(), remove/fix some dead code. (#7276) 2026-03-24 10:36:48 +01:00
test_downloadermiddleware_httpcompression.py Restore brotlicffi support (#7160) 2025-11-25 12:06:55 +05:00
test_downloadermiddleware_httpproxy.py Move to mypy --strict with exceptions. (#7300) 2026-03-02 15:47:23 +05:00
test_downloadermiddleware_offsite.py Deprecate the spider arg of downloader middleware methods. (#7037) 2025-09-02 21:51:47 +05:00
test_downloadermiddleware_redirect.py Split long test files (#7329) 2026-03-13 10:30:25 +01:00
test_downloadermiddleware_redirect_base.py Split long test files (#7329) 2026-03-13 10:30:25 +01:00
test_downloadermiddleware_redirect_metarefresh.py Split long test files (#7329) 2026-03-13 10:30:25 +01:00
test_downloadermiddleware_retry.py Bump ruff, fix some of rules (#7277) 2026-02-23 11:48:38 +01:00
test_downloadermiddleware_robotstxt.py Enable mypy warn_return_any. (#7492) 2026-05-04 22:24:47 +02:00
test_downloadermiddleware_stats.py Deprecate the spider arg of downloader middleware methods. (#7037) 2025-09-02 21:51:47 +05:00
test_downloadermiddleware_useragent.py Deprecate spider attributes that can be replaced by settings, round 2 (#7039) 2025-12-01 01:26:17 +05:00
test_downloaderslotssettings.py Add more no-reactor tests (#7259) 2026-03-24 15:29:22 +05:00
test_dupefilters.py Enable the flake8-builtins rules. (#6942) 2025-07-05 21:43:18 +05:00
test_engine.py Add more no-reactor tests (#7259) 2026-03-24 15:29:22 +05:00
test_engine_loop.py Add more no-reactor tests (#7259) 2026-03-24 15:29:22 +05:00
test_engine_stop_download_bytes.py Enable in-process HTTP tests without a reactor. (#7254) 2026-02-13 19:08:06 +01:00
test_engine_stop_download_headers.py Enable in-process HTTP tests without a reactor. (#7254) 2026-02-13 19:08:06 +01:00
test_exporters.py Bump ruff, fix some of rules (#7277) 2026-02-23 11:48:38 +01:00
test_extension_periodic_log.py Add more no-reactor tests (#7259) 2026-03-24 15:29:22 +05:00
test_extension_statsmailer.py Deprecate the mail API (#7263) 2026-03-24 21:31:12 +01:00
test_extension_telnet.py Add more no-reactor tests (#7259) 2026-03-24 15:29:22 +05:00
test_extension_throttle.py Preparations for switching to direct pytest. (#6678) 2025-02-16 20:28:58 +01:00
test_feedexport.py Fixes for Python 3.14. (#7460) 2026-04-27 18:47:52 +05:00
test_feedexport_batch.py asyncio alternative to deferToThread() (#7349) 2026-03-24 15:41:15 +01:00
test_feedexport_postprocess.py Split long test files (#7329) 2026-03-13 10:30:25 +01:00
test_feedexport_storages.py asyncio alternative to deferToThread() (#7349) 2026-03-24 15:41:15 +01:00
test_feedexport_uri_params.py Split long test files (#7329) 2026-03-13 10:30:25 +01:00
test_http2_client_protocol.py Enable mypy warn_return_any. (#7492) 2026-05-04 22:24:47 +02:00
test_http_cookies.py Converting tests to plain asserts, part 7. (#6710) 2025-03-09 20:23:51 +01:00
test_http_headers.py Update tool versions (#7127) 2025-10-27 14:11:31 +01:00
test_http_request.py Response now uses less memory (#7374) 2026-04-08 14:25:11 +02:00
test_http_request_form.py Silence deprecation warnings in TestFormRequest. (#7491) 2026-05-04 22:20:21 +02:00
test_http_request_json.py Split long test files (#7329) 2026-03-13 10:30:25 +01:00
test_http_response.py Response now uses less memory (#7374) 2026-04-08 14:25:11 +02:00
test_http_response_text.py Split long test files (#7329) 2026-03-13 10:30:25 +01:00
test_item.py Bump ruff, fix some of rules (#7277) 2026-02-23 11:48:38 +01:00
test_link.py Bump ruff, fix some of rules (#7277) 2026-02-23 11:48:38 +01:00
test_linkextractors.py Fix invalid XML samples in tests that break with lxml 6. (#6919) 2025-06-27 16:24:09 +05:00
test_loader.py Deprecate ScrapyCommand.set_crawler(), remove/fix some dead code. (#7276) 2026-03-24 10:36:48 +01:00
test_logformatter.py Enable in-process HTTP tests without a reactor. (#7254) 2026-02-13 19:08:06 +01:00
test_logstats.py Add more no-reactor tests (#7259) 2026-03-24 15:29:22 +05:00
test_mail.py Deprecate the mail API (#7263) 2026-03-24 21:31:12 +01:00
test_middleware.py Deprecate the spider arg of downloader middleware methods. (#7037) 2025-09-02 21:51:47 +05:00
test_pipeline_crawl.py Enable in-process HTTP tests without a reactor. (#7254) 2026-02-13 19:08:06 +01:00
test_pipeline_files.py Fixes for Python 3.14. (#7460) 2026-04-27 18:47:52 +05:00
test_pipeline_images.py Bump ruff, fix some of rules (#7277) 2026-02-23 11:48:38 +01:00
test_pipeline_media.py Await persist_file() in media pipelines. (#7182) 2026-03-24 10:52:56 +01:00
test_pipelines.py Add more no-reactor tests (#7259) 2026-03-24 15:29:22 +05:00
test_poet.py Fix getting annotations for _parse_sitemap() at the runtime. (#6671) 2025-02-14 20:40:06 +05:00
test_pqueues.py Fix DownloaderAwarePriorityQueue tie-breaking across slots (#7351) 2026-04-08 16:10:21 +02:00
test_request_attribute_binding.py Enable in-process HTTP tests without a reactor. (#7254) 2026-02-13 19:08:06 +01:00
test_request_cb_kwargs.py Enable in-process HTTP tests without a reactor. (#7254) 2026-02-13 19:08:06 +01:00
test_request_dict.py Deprecate FormRequest in favor of form2request (#6438) 2026-05-04 22:38:29 +05:00
test_request_left.py Rename async test decorators. (#7234) 2026-02-02 20:39:43 +01:00
test_responsetypes.py Converting tests to plain asserts, part 5. (#6712) 2025-03-09 20:24:45 +01:00
test_robotstxt_interface.py Add Python 3.14 to CI. (#6604) 2026-05-12 23:49:37 +05:00
test_scheduler.py Enable mypy warn_return_any. (#7492) 2026-05-04 22:24:47 +02:00
test_scheduler_base.py Enable in-process HTTP tests without a reactor. (#7254) 2026-02-13 19:08:06 +01:00
test_scrapy__getattr__.py Remove code deprecated in 2.12.0 (#7126) 2025-10-27 17:14:38 +05:00
test_selector.py Test refactoring, part 2. (#6928) 2025-06-29 23:10:38 +02:00
test_signals.py Enable in-process HTTP tests without a reactor. (#7254) 2026-02-13 19:08:06 +01:00
test_spider.py Remove InitSpider. 2026-05-03 14:12:16 +05:00
test_spider_crawl.py Split long test files (#7329) 2026-03-13 10:30:25 +01:00
test_spider_sitemap.py Optimize SitemapSpider memory usage (#7007) 2026-04-08 13:59:16 +02:00
test_spider_start.py Drop start_requests() support. (#7490) 2026-05-04 17:34:24 +05:00
test_spidermiddleware.py Enable mypy warn_return_any. (#7492) 2026-05-04 22:24:47 +02:00
test_spidermiddleware_base.py Drop start_requests() support. (#7490) 2026-05-04 17:34:24 +05:00
test_spidermiddleware_depth.py Deprecate spider args of middlewares and pipelines. (#7006) 2025-08-21 13:23:10 +05:00
test_spidermiddleware_httperror.py chore: more ruff rules and overall minor improvements (#7386) 2026-04-03 19:00:13 +05:00
test_spidermiddleware_output_chain.py Enable in-process HTTP tests without a reactor. (#7254) 2026-02-13 19:08:06 +01:00
test_spidermiddleware_process_start.py Drop start_requests() support. (#7490) 2026-05-04 17:34:24 +05:00
test_spidermiddleware_referer.py Fix test issues with the no-reactor env 2026-03-12 16:46:32 +01:00
test_spidermiddleware_start.py Drop start_requests() support. (#7490) 2026-05-04 17:34:24 +05:00
test_spidermiddleware_urllength.py Deprecate spider args of middlewares and pipelines. (#7006) 2025-08-21 13:23:10 +05:00
test_spiderstate.py Test refactoring, part 2. (#6928) 2025-06-29 23:10:38 +02:00
test_squeues.py Fixes for Python 3.14. (#7460) 2026-04-27 18:47:52 +05:00
test_squeues_request.py Test refactoring, part 2. (#6928) 2025-06-29 23:10:38 +02:00
test_stats.py Improve handling of time deltas (#7377) 2026-04-29 09:53:40 +02:00
test_toplevel.py Bump tool versions. (#6941) 2025-07-05 10:30:30 +02:00
test_utils_asyncgen.py Rename async test decorators. (#7234) 2026-02-02 20:39:43 +01:00
test_utils_asyncio.py Add more no-reactor tests (#7259) 2026-03-24 15:29:22 +05:00
test_utils_conf.py Update tool versions (#7127) 2025-10-27 14:11:31 +01:00
test_utils_console.py Refactoring of test_utils_*. (#6905) 2025-06-23 23:39:24 +05:00
test_utils_curl.py Update tool versions (#7127) 2025-10-27 14:11:31 +01:00
test_utils_datatypes.py Enable the flake8-builtins rules. (#6942) 2025-07-05 21:43:18 +05:00
test_utils_defer.py Add more no-reactor tests (#7259) 2026-03-24 15:29:22 +05:00
test_utils_deprecate.py Merge pull request #7145 from Icorebleidd/master 2025-11-28 01:16:02 +05:00
test_utils_display.py Enable the flake8-builtins rules. (#6942) 2025-07-05 21:43:18 +05:00
test_utils_gz.py Refactoring of test_utils_*. (#6905) 2025-06-23 23:39:24 +05:00
test_utils_httpobj.py Refactoring of test_utils_*. (#6905) 2025-06-23 23:39:24 +05:00
test_utils_iterators.py Move to mypy --strict with exceptions. (#7300) 2026-03-02 15:47:23 +05:00
test_utils_log.py Refactoring of test_utils_*. (#6905) 2025-06-23 23:39:24 +05:00
test_utils_project.py Refactoring of test_utils_*. (#6905) 2025-06-23 23:39:24 +05:00
test_utils_python.py Rename async test decorators. (#7234) 2026-02-02 20:39:43 +01:00
test_utils_reactor.py Fixes for Python 3.14. (#7460) 2026-04-27 18:47:52 +05:00
test_utils_request.py Remove code deprecated in 2.12.0 (#7126) 2025-10-27 17:14:38 +05:00
test_utils_response.py Fix the substitution pattern in open_in_browser(). (#7459) 2026-04-24 13:54:37 +05:00
test_utils_serialize.py Enable the flake8-builtins rules. (#6942) 2025-07-05 21:43:18 +05:00
test_utils_signal.py Rename async test decorators. (#7234) 2026-02-02 20:39:43 +01:00
test_utils_sitemap.py Optimize SitemapSpider memory usage (#7007) 2026-04-08 13:59:16 +02:00
test_utils_spider.py Bump ruff, fix some of rules (#7277) 2026-02-23 11:48:38 +01:00
test_utils_template.py Refactoring of test_utils_*. (#6905) 2025-06-23 23:39:24 +05:00
test_utils_trackref.py improve trackref (#7375) 2026-04-03 15:15:30 +05:00
test_utils_url.py Drop w3lib.url reexports. 2026-05-03 14:12:18 +05:00
test_zz_resources.py Add more no-reactor tests (#7259) 2026-03-24 15:29:22 +05:00