| .. |
|
AsyncCrawlerProcess
|
Deprecate spider args of middlewares and pipelines. (#7006)
|
2025-08-21 13:23:10 +05:00 |
|
AsyncCrawlerRunner
|
Add `AsyncCrawlerProcess` and `Crawler.crawl_async()` (#6817)
|
2025-05-28 18:55:44 +05:00 |
|
CrawlerProcess
|
Deprecate spider args of middlewares and pipelines. (#7006)
|
2025-08-21 13:23:10 +05:00 |
|
CrawlerRunner
|
Extract in-process test HTTP servers into separate processes (#6960)
|
2025-07-25 12:42:27 +05:00 |
|
keys
|
Update tool versions (#7127)
|
2025-10-27 14:11:31 +01:00 |
|
mocks
|
Enable the flake8-builtins rules. (#6942)
|
2025-07-05 21:43:18 +05:00 |
|
mockserver
|
Add unit tests that check download handlers behave like basic http clients (#6946) (#7059)
|
2025-10-20 13:08:26 +02:00 |
|
sample_data
|
Add support for multiple-compressed responses (#6063)
|
2024-02-22 12:16:24 +01:00 |
|
test_cmdline
|
Converting tests to plain asserts, part 2. (#6699)
|
2025-03-06 20:52:41 +01:00 |
|
test_cmdline_crawl_with_pipeline
|
Update tool versions (#7127)
|
2025-10-27 14:11:31 +01:00 |
|
test_settings
|
Update tool versions (#7127)
|
2025-10-27 14:11:31 +01:00 |
|
test_spiderloader
|
Don't use CrawlerProcess in the commands that don't need it. (#6824)
|
2025-05-28 19:57:33 +05:00 |
|
test_utils_misc
|
Remove code deprecated in 2.12.0 (#7126)
|
2025-10-27 17:14:38 +05:00 |
|
utils
|
Speed up and refactor command tests (#7118)
|
2025-10-27 12:28:16 +01:00 |
|
__init__.py
|
Support asynchronous start requests (#6729)
|
2025-05-07 19:04:03 +02:00 |
|
ignores.txt
|
Remove deprecated classes BaseSgmlLinkExtractor, RegexLinkExtractor and SgmlLinkExtractor (#4356)
|
2020-07-17 12:40:04 +02:00 |
|
pipelines.py
|
Deprecate spider args of middlewares and pipelines. (#7006)
|
2025-08-21 13:23:10 +05:00 |
|
spiders.py
|
Fix invalid XML samples in tests that break with lxml 6. (#6919)
|
2025-06-27 16:24:09 +05:00 |
|
test_addons.py
|
Deprecate scrapy.core.downloader.handlers.http. (#7079)
|
2025-10-16 13:15:07 +02:00 |
|
test_closespider.py
|
Extract in-process test HTTP servers into separate processes (#6960)
|
2025-07-25 12:42:27 +05:00 |
|
test_command_check.py
|
Speed up and refactor command tests (#7118)
|
2025-10-27 12:28:16 +01:00 |
|
test_command_crawl.py
|
Speed up and refactor command tests (#7118)
|
2025-10-27 12:28:16 +01:00 |
|
test_command_fetch.py
|
Speed up and refactor command tests (#7118)
|
2025-10-27 12:28:16 +01:00 |
|
test_command_genspider.py
|
Update tool versions (#7127)
|
2025-10-27 14:11:31 +01:00 |
|
test_command_parse.py
|
Speed up and refactor command tests (#7118)
|
2025-10-27 12:28:16 +01:00 |
|
test_command_runspider.py
|
Speed up and refactor command tests (#7118)
|
2025-10-27 12:28:16 +01:00 |
|
test_command_shell.py
|
Speed up and refactor command tests (#7118)
|
2025-10-27 12:28:16 +01:00 |
|
test_command_startproject.py
|
Update tool versions (#7127)
|
2025-10-27 14:11:31 +01:00 |
|
test_command_version.py
|
Speed up and refactor command tests (#7118)
|
2025-10-27 12:28:16 +01:00 |
|
test_commands.py
|
Speed up and refactor command tests (#7118)
|
2025-10-27 12:28:16 +01:00 |
|
test_contracts.py
|
Extract in-process test HTTP servers into separate processes (#6960)
|
2025-07-25 12:42:27 +05:00 |
|
test_core_downloader.py
|
Allow Crawler.crawl_async() without asyncio. (#7202)
|
2025-12-31 18:33:59 +01:00 |
|
test_core_scraper.py
|
Allow Crawler.crawl_async() without asyncio. (#7202)
|
2025-12-31 18:33:59 +01:00 |
|
test_crawl.py
|
Async API for download handlers. (#7164)
|
2025-12-31 19:03:16 +01:00 |
|
test_crawler.py
|
Allow Crawler.crawl_async() without asyncio. (#7202)
|
2025-12-31 18:33:59 +01:00 |
|
test_dependencies.py
|
Reduce deps on unittest, unify inlineCallbacks imports in tests. (#6873)
|
2025-06-06 22:59:09 +02:00 |
|
test_downloader_handler_twisted_ftp.py
|
Async API for download handlers. (#7164)
|
2025-12-31 19:03:16 +01:00 |
|
test_downloader_handler_twisted_http2.py
|
Async API for download handlers. (#7164)
|
2025-12-31 19:03:16 +01:00 |
|
test_downloader_handler_twisted_http10.py
|
Async API for download handlers. (#7164)
|
2025-12-31 19:03:16 +01:00 |
|
test_downloader_handler_twisted_http11.py
|
Extract in-process test HTTP servers into separate processes (#6960)
|
2025-07-25 12:42:27 +05:00 |
|
test_downloader_handlers.py
|
Async API for download handlers. (#7164)
|
2025-12-31 19:03:16 +01:00 |
|
test_downloader_handlers_http_base.py
|
Async API for download handlers. (#7164)
|
2025-12-31 19:03:16 +01:00 |
|
test_downloadermiddleware.py
|
Add `DownloaderMiddlewareManager.download_async()`, deprecate returning Deferreds from downloader mws (#7069)
|
2025-12-09 20:07:36 +05:00 |
|
test_downloadermiddleware_ajaxcrawlable.py
|
Converting tests to plain asserts, part 3. (#6700)
|
2025-03-06 20:50:14 +01:00 |
|
test_downloadermiddleware_cookies.py
|
Deprecate the spider arg of downloader middleware methods. (#7037)
|
2025-09-02 21:51:47 +05:00 |
|
test_downloadermiddleware_defaultheaders.py
|
Deprecate the spider arg of downloader middleware methods. (#7037)
|
2025-09-02 21:51:47 +05:00 |
|
test_downloadermiddleware_downloadtimeout.py
|
Deprecate spider attributes that can be replaced by settings, round 2 (#7039)
|
2025-12-01 01:26:17 +05:00 |
|
test_downloadermiddleware_httpauth.py
|
Deprecate the spider arg of downloader middleware methods. (#7037)
|
2025-09-02 21:51:47 +05:00 |
|
test_downloadermiddleware_httpcache.py
|
Deprecate the spider arg of downloader middleware methods. (#7037)
|
2025-09-02 21:51:47 +05:00 |
|
test_downloadermiddleware_httpcompression.py
|
Restore brotlicffi support (#7160)
|
2025-11-25 12:06:55 +05:00 |
|
test_downloadermiddleware_httpproxy.py
|
Deprecate the spider arg of downloader middleware methods. (#7037)
|
2025-09-02 21:51:47 +05:00 |
|
test_downloadermiddleware_offsite.py
|
Deprecate the spider arg of downloader middleware methods. (#7037)
|
2025-09-02 21:51:47 +05:00 |
|
test_downloadermiddleware_redirect.py
|
Deprecate the spider arg of downloader middleware methods. (#7037)
|
2025-09-02 21:51:47 +05:00 |
|
test_downloadermiddleware_retry.py
|
Deprecate the spider arg of downloader middleware methods. (#7037)
|
2025-09-02 21:51:47 +05:00 |
|
test_downloadermiddleware_robotstxt.py
|
Deprecate the spider arg of downloader middleware methods. (#7037)
|
2025-09-02 21:51:47 +05:00 |
|
test_downloadermiddleware_stats.py
|
Deprecate the spider arg of downloader middleware methods. (#7037)
|
2025-09-02 21:51:47 +05:00 |
|
test_downloadermiddleware_useragent.py
|
Deprecate spider attributes that can be replaced by settings, round 2 (#7039)
|
2025-12-01 01:26:17 +05:00 |
|
test_downloaderslotssettings.py
|
Allow Crawler.crawl_async() without asyncio. (#7202)
|
2025-12-31 18:33:59 +01:00 |
|
test_dupefilters.py
|
Enable the flake8-builtins rules. (#6942)
|
2025-07-05 21:43:18 +05:00 |
|
test_engine.py
|
Change default priority queue to DownloaderAwarePriorityQueue (#6940)
|
2025-12-11 11:25:17 +01:00 |
|
test_engine_loop.py
|
Allow Crawler.crawl_async() without asyncio. (#7202)
|
2025-12-31 18:33:59 +01:00 |
|
test_engine_stop_download_bytes.py
|
Extract in-process test HTTP servers into separate processes (#6960)
|
2025-07-25 12:42:27 +05:00 |
|
test_engine_stop_download_headers.py
|
Extract in-process test HTTP servers into separate processes (#6960)
|
2025-07-25 12:42:27 +05:00 |
|
test_exporters.py
|
Mark abstract base classes as such. (#6930)
|
2025-06-30 15:14:34 +05:00 |
|
test_extension_periodic_log.py
|
Remove Python 3.9 support (#7121)
|
2025-10-27 12:37:49 +01:00 |
|
test_extension_statsmailer.py
|
Update tool versions (#7127)
|
2025-10-27 14:11:31 +01:00 |
|
test_extension_telnet.py
|
Migrate to pytest-twisted (#6938)
|
2025-07-06 21:27:17 +05:00 |
|
test_extension_throttle.py
|
Preparations for switching to direct pytest. (#6678)
|
2025-02-16 20:28:58 +01:00 |
|
test_feedexport.py
|
Allow Crawler.crawl_async() without asyncio. (#7202)
|
2025-12-31 18:33:59 +01:00 |
|
test_http2_client_protocol.py
|
Remove Python 3.9 support (#7121)
|
2025-10-27 12:37:49 +01:00 |
|
test_http_cookies.py
|
Converting tests to plain asserts, part 7. (#6710)
|
2025-03-09 20:23:51 +01:00 |
|
test_http_headers.py
|
Update tool versions (#7127)
|
2025-10-27 14:11:31 +01:00 |
|
test_http_request.py
|
Update tool versions (#7127)
|
2025-10-27 14:11:31 +01:00 |
|
test_http_response.py
|
Update tool versions (#7127)
|
2025-10-27 14:11:31 +01:00 |
|
test_item.py
|
Update tool versions (#7127)
|
2025-10-27 14:11:31 +01:00 |
|
test_link.py
|
Converting tests to plain asserts, part 6. (#6709)
|
2025-03-09 20:20:24 +01:00 |
|
test_linkextractors.py
|
Fix invalid XML samples in tests that break with lxml 6. (#6919)
|
2025-06-27 16:24:09 +05:00 |
|
test_loader.py
|
Converting tests to plain asserts, part 8. (#6711)
|
2025-03-09 20:24:12 +01:00 |
|
test_logformatter.py
|
Deprecate spider args of middlewares and pipelines. (#7006)
|
2025-08-21 13:23:10 +05:00 |
|
test_logstats.py
|
Converting tests to plain asserts, part 5. (#6712)
|
2025-03-09 20:24:45 +01:00 |
|
test_mail.py
|
Converting tests to plain asserts, part 5. (#6712)
|
2025-03-09 20:24:45 +01:00 |
|
test_middleware.py
|
Deprecate the spider arg of downloader middleware methods. (#7037)
|
2025-09-02 21:51:47 +05:00 |
|
test_pipeline_crawl.py
|
Extract in-process test HTTP servers into separate processes (#6960)
|
2025-07-25 12:42:27 +05:00 |
|
test_pipeline_files.py
|
Refactor MediaPipeline.process_item() to async def (#7177)
|
2025-12-15 10:02:04 +01:00 |
|
test_pipeline_images.py
|
Update tool versions (#7127)
|
2025-10-27 14:11:31 +01:00 |
|
test_pipeline_media.py
|
Refactor MediaPipeline.process_item() to async def (#7177)
|
2025-12-15 10:02:04 +01:00 |
|
test_pipelines.py
|
Allow Crawler.crawl_async() without asyncio. (#7202)
|
2025-12-31 18:33:59 +01:00 |
|
test_poet.py
|
Fix getting annotations for _parse_sitemap() at the runtime. (#6671)
|
2025-02-14 20:40:06 +05:00 |
|
test_pqueues.py
|
Improve the assumption in test_queue_push_pop_priorities(). (#6974)
|
2025-07-28 20:37:45 +02:00 |
|
test_proxy_connect.py
|
Mitigate brotli and deflate decompression bombs DoS (#7134)
|
2025-11-17 14:21:50 +05:00 |
|
test_request_attribute_binding.py
|
Deprecate the spider arg of downloader middleware methods. (#7037)
|
2025-09-02 21:51:47 +05:00 |
|
test_request_cb_kwargs.py
|
Deprecate the spider arg of downloader middleware methods. (#7037)
|
2025-09-02 21:51:47 +05:00 |
|
test_request_dict.py
|
Converting tests to plain asserts, part 5. (#6712)
|
2025-03-09 20:24:45 +01:00 |
|
test_request_left.py
|
Extract in-process test HTTP servers into separate processes (#6960)
|
2025-07-25 12:42:27 +05:00 |
|
test_responsetypes.py
|
Converting tests to plain asserts, part 5. (#6712)
|
2025-03-09 20:24:45 +01:00 |
|
test_robotstxt_interface.py
|
UTF-8 BOM at the beginning of the file ignored (#7095)
|
2025-10-15 18:15:07 +04:00 |
|
test_scheduler.py
|
Deprecate Crawler.stop(). (#6999)
|
2025-08-11 08:32:55 +02:00 |
|
test_scheduler_base.py
|
Update tool versions (#7127)
|
2025-10-27 14:11:31 +01:00 |
|
test_scrapy__getattr__.py
|
Remove code deprecated in 2.12.0 (#7126)
|
2025-10-27 17:14:38 +05:00 |
|
test_selector.py
|
Test refactoring, part 2. (#6928)
|
2025-06-29 23:10:38 +02:00 |
|
test_signals.py
|
Allow Crawler.crawl_async() without asyncio. (#7202)
|
2025-12-31 18:33:59 +01:00 |
|
test_spider.py
|
Allow Crawler.crawl_async() without asyncio. (#7202)
|
2025-12-31 18:33:59 +01:00 |
|
test_spider_start.py
|
Allow Crawler.crawl_async() without asyncio. (#7202)
|
2025-12-31 18:33:59 +01:00 |
|
test_spidermiddleware.py
|
Update tool versions (#7127)
|
2025-10-27 14:11:31 +01:00 |
|
test_spidermiddleware_base.py
|
Extract @_warn_spider_arg. (#7033)
|
2025-09-01 20:17:13 +05:00 |
|
test_spidermiddleware_depth.py
|
Deprecate spider args of middlewares and pipelines. (#7006)
|
2025-08-21 13:23:10 +05:00 |
|
test_spidermiddleware_httperror.py
|
Deprecate spider args of middlewares and pipelines. (#7006)
|
2025-08-21 13:23:10 +05:00 |
|
test_spidermiddleware_output_chain.py
|
Allow Crawler.crawl_async() without asyncio. (#7202)
|
2025-12-31 18:33:59 +01:00 |
|
test_spidermiddleware_process_start.py
|
Allow Crawler.crawl_async() without asyncio. (#7202)
|
2025-12-31 18:33:59 +01:00 |
|
test_spidermiddleware_referer.py
|
Deprecate the spider arg of downloader middleware methods. (#7037)
|
2025-09-02 21:51:47 +05:00 |
|
test_spidermiddleware_start.py
|
Migrate to pytest-twisted (#6938)
|
2025-07-06 21:27:17 +05:00 |
|
test_spidermiddleware_urllength.py
|
Deprecate spider args of middlewares and pipelines. (#7006)
|
2025-08-21 13:23:10 +05:00 |
|
test_spiderstate.py
|
Test refactoring, part 2. (#6928)
|
2025-06-29 23:10:38 +02:00 |
|
test_squeues.py
|
Update tool versions (#7127)
|
2025-10-27 14:11:31 +01:00 |
|
test_squeues_request.py
|
Test refactoring, part 2. (#6928)
|
2025-06-29 23:10:38 +02:00 |
|
test_stats.py
|
Deprecate spider arguments of StatsCollector methods (#7011)
|
2025-08-20 09:52:22 +02:00 |
|
test_toplevel.py
|
Bump tool versions. (#6941)
|
2025-07-05 10:30:30 +02:00 |
|
test_utils_asyncgen.py
|
Migrate to pytest-twisted (#6938)
|
2025-07-06 21:27:17 +05:00 |
|
test_utils_asyncio.py
|
Migrate to pytest-twisted (#6938)
|
2025-07-06 21:27:17 +05:00 |
|
test_utils_conf.py
|
Update tool versions (#7127)
|
2025-10-27 14:11:31 +01:00 |
|
test_utils_console.py
|
Refactoring of test_utils_*. (#6905)
|
2025-06-23 23:39:24 +05:00 |
|
test_utils_curl.py
|
Update tool versions (#7127)
|
2025-10-27 14:11:31 +01:00 |
|
test_utils_datatypes.py
|
Enable the flake8-builtins rules. (#6942)
|
2025-07-05 21:43:18 +05:00 |
|
test_utils_defer.py
|
Deprecate spider args of middlewares and pipelines. (#7006)
|
2025-08-21 13:23:10 +05:00 |
|
test_utils_deprecate.py
|
Merge pull request #7145 from Icorebleidd/master
|
2025-11-28 01:16:02 +05:00 |
|
test_utils_display.py
|
Enable the flake8-builtins rules. (#6942)
|
2025-07-05 21:43:18 +05:00 |
|
test_utils_gz.py
|
Refactoring of test_utils_*. (#6905)
|
2025-06-23 23:39:24 +05:00 |
|
test_utils_httpobj.py
|
Refactoring of test_utils_*. (#6905)
|
2025-06-23 23:39:24 +05:00 |
|
test_utils_iterators.py
|
Enable the flake8-builtins rules. (#6942)
|
2025-07-05 21:43:18 +05:00 |
|
test_utils_log.py
|
Refactoring of test_utils_*. (#6905)
|
2025-06-23 23:39:24 +05:00 |
|
test_utils_project.py
|
Refactoring of test_utils_*. (#6905)
|
2025-06-23 23:39:24 +05:00 |
|
test_utils_python.py
|
Remove code deprecated in 2.12.0 (#7126)
|
2025-10-27 17:14:38 +05:00 |
|
test_utils_reactor.py
|
Migrate to pytest-twisted (#6938)
|
2025-07-06 21:27:17 +05:00 |
|
test_utils_request.py
|
Remove code deprecated in 2.12.0 (#7126)
|
2025-10-27 17:14:38 +05:00 |
|
test_utils_response.py
|
Fix get_meta_refresh to correctly resolve relative URLs using <base> tag (#7047)
|
2025-09-10 15:17:16 +02:00 |
|
test_utils_serialize.py
|
Enable the flake8-builtins rules. (#6942)
|
2025-07-05 21:43:18 +05:00 |
|
test_utils_signal.py
|
Deprecate send_catch_log_deferred(). (#7161)
|
2025-12-10 14:42:49 +05:00 |
|
test_utils_sitemap.py
|
Refactoring of test_utils_*. (#6905)
|
2025-06-23 23:39:24 +05:00 |
|
test_utils_spider.py
|
Bump tool versions. (#6941)
|
2025-07-05 10:30:30 +02:00 |
|
test_utils_template.py
|
Refactoring of test_utils_*. (#6905)
|
2025-06-23 23:39:24 +05:00 |
|
test_utils_trackref.py
|
Refactoring of test_utils_*. (#6905)
|
2025-06-23 23:39:24 +05:00 |
|
test_utils_url.py
|
Bump tool versions. (#6941)
|
2025-07-05 10:30:30 +02:00 |
|
test_webclient.py
|
Extract in-process test HTTP servers into separate processes (#6960)
|
2025-07-25 12:42:27 +05:00 |
|
test_zz_resources.py
|
Deprecate send_catch_log_deferred(). (#7161)
|
2025-12-10 14:42:49 +05:00 |
d1bd8eb49f