..
CrawlerProcess
Small 3.7 and 3.8 cleanup.
2024-10-17 23:22:37 +05:00
CrawlerRunner
Add change reactor test to CrawlerRunner
2024-05-26 19:55:54 -03:00
keys
Commit mitmproxy-dhparam.pem.
2024-11-15 21:08:18 +05:00
mocks
Drop Python 3.8 Support ( #6472 )
2024-10-16 10:03:16 +02:00
sample_data
Add support for multiple-compressed responses ( #6063 )
2024-02-22 12:16:24 +01:00
test_cmdline
flake8-bugbear
2024-06-20 00:27:38 +05:00
test_cmdline_crawl_with_pipeline
sort imports with isort
2023-01-25 14:25:15 -06:00
test_settings
Drop Python 3.8 Support ( #6472 )
2024-10-16 10:03:16 +02:00
test_spiderloader
Filter test-time warnings. ( #6501 )
2024-10-21 12:30:49 +02:00
test_utils_misc
Remove build_from_settings().
2024-11-11 16:44:47 +05:00
__init__.py
adding black formatter to all the code
2022-11-29 11:30:46 -03:00
ftpserver.py
adding black formatter to all the code
2022-11-29 11:30:46 -03:00
ignores.txt
Remove deprecated classes BaseSgmlLinkExtractor, RegexLinkExtractor and SgmlLinkExtractor ( #4356 )
2020-07-17 12:40:04 +02:00
mockserver.py
Drop Python 3.8 Support ( #6472 )
2024-10-16 10:03:16 +02:00
pipelines.py
reaplying black, fixing conflicts and ignoring bandit checks on test directory
2023-01-20 10:55:46 -03:00
spiders.py
Address some previously ignored pylint messages. ( #6531 )
2024-11-11 11:49:52 +01:00
test_addons.py
Drop Python 3.8 Support ( #6472 )
2024-10-16 10:03:16 +02:00
test_closespider.py
add test_closespider_pagecount_no_item_with_pagecount
2024-07-11 14:02:24 -03:00
test_command_check.py
Run black.
2024-03-14 17:44:57 +05:00
test_command_fetch.py
Upgrade CI tools
2023-02-02 06:37:40 +01:00
test_command_parse.py
scrapy parse: fix the signature of callbacks from the CLI ( #6182 )
2024-01-15 13:37:03 +01:00
test_command_shell.py
Merge pull request #6112 from wRAR/test-shutdown-forced
2023-11-16 19:16:52 +04:00
test_command_version.py
flake8-bugbear
2024-06-20 00:27:38 +05:00
test_commands.py
Remove --keep-runtime-typing from pyupgrade.
2024-10-17 21:26:02 +05:00
test_contracts.py
Added failing test cases to tests/test_contracts.py and fixed corresponding methods + removed pylint comments
2024-11-14 10:40:12 -08:00
test_core_downloader.py
Replace Slot.throttle with Request.meta['dont_throttle']
2024-11-05 19:44:30 +01:00
test_crawl.py
Filter test-time warnings. ( #6501 )
2024-10-21 12:30:49 +02:00
test_crawler.py
Address some previously ignored pylint messages. ( #6531 )
2024-11-11 11:49:52 +01:00
test_dependencies.py
Remove obsolete top-level run code in tests.
2023-01-25 22:14:24 +04:00
test_downloader_handlers.py
Deprecation removals. ( #6500 )
2024-10-31 18:06:22 +05:00
test_downloader_handlers_http2.py
create_instance → build_from_crawler, build_from_settings ( #6169 )
2023-12-18 11:51:02 +01:00
test_downloadermiddleware.py
Add parameters to most Deferred in scrapy/core. ( #6395 )
2024-06-10 10:27:50 +02:00
test_downloadermiddleware_ajaxcrawlable.py
sort imports with isort
2023-01-25 14:25:15 -06:00
test_downloadermiddleware_cookies.py
Address some previously ignored pylint messages. ( #6531 )
2024-11-11 11:49:52 +01:00
test_downloadermiddleware_defaultheaders.py
sort imports with isort
2023-01-25 14:25:15 -06:00
test_downloadermiddleware_downloadtimeout.py
sort imports with isort
2023-01-25 14:25:15 -06:00
test_downloadermiddleware_httpauth.py
Fix tests
2024-02-28 16:36:19 -03:00
test_downloadermiddleware_httpcache.py
Add Crawler._load_settings().
2023-09-12 14:44:16 +04:00
test_downloadermiddleware_httpcompression.py
Deprecation removals. ( #6500 )
2024-10-31 18:06:22 +05:00
test_downloadermiddleware_httpproxy.py
Merge remote-tracking branch 'origin/master' into mypy-imports
2023-02-11 22:02:19 +04:00
test_downloadermiddleware_offsite.py
Filter test-time warnings. ( #6501 )
2024-10-21 12:30:49 +02:00
test_downloadermiddleware_redirect.py
Add pyupgrade.
2024-06-05 22:57:18 +05:00
test_downloadermiddleware_retry.py
Deprecation removals. ( #6500 )
2024-10-31 18:06:22 +05:00
test_downloadermiddleware_robotstxt.py
Drop Reppy.
2024-10-17 23:41:23 +05:00
test_downloadermiddleware_stats.py
Removed some deprecated functions and functionalities ( #6116 )
2023-10-30 09:59:11 +01:00
test_downloadermiddleware_useragent.py
sort imports with isort
2023-01-25 14:25:15 -06:00
test_downloaderslotssettings.py
Replace Slot.throttle with Request.meta['dont_throttle']
2024-11-05 19:44:30 +01:00
test_dupefilters.py
Add from_crawler() to components that only had from_settings().
2024-11-12 21:12:32 +05:00
test_engine.py
Remove debug log message from _schedule_request method
2024-09-09 20:26:02 +01:00
test_engine_stop_download_bytes.py
sort imports with isort
2023-01-25 14:25:15 -06:00
test_engine_stop_download_headers.py
sort imports with isort
2023-01-25 14:25:15 -06:00
test_exporters.py
Fix tests
2024-02-28 16:36:19 -03:00
test_extension_periodic_log.py
fix(typo): correct `successfully`
2024-01-05 10:50:45 +01:00
test_extension_telnet.py
Add Crawler._load_settings().
2023-09-12 14:44:16 +04:00
test_extension_throttle.py
dont_throttle → autothrottle_dont_adjust_delay
2024-11-07 16:17:16 +01:00
test_feedexport.py
Deprecation removals. ( #6500 )
2024-10-31 18:06:22 +05:00
test_http2_client_protocol.py
Drop Python 3.8 Support ( #6472 )
2024-10-16 10:03:16 +02:00
test_http_cookies.py
Fix WrappedRequest.get_header raising TypeError if default is None ( #6310 )
2024-04-08 11:47:53 +02:00
test_http_headers.py
sort imports with isort
2023-01-25 14:25:15 -06:00
test_http_request.py
Run and fix linkcheck. ( #6524 )
2024-11-04 11:40:07 +01:00
test_http_response.py
Add pyupgrade.
2024-06-05 22:57:18 +05:00
test_item.py
Bump pylint, cleanup the ignored tags.
2024-02-28 14:31:21 +05:00
test_link.py
adding black formatter to all the code
2022-11-29 11:30:46 -03:00
test_linkextractors.py
Address some previously ignored pylint messages. ( #6531 )
2024-11-11 11:49:52 +01:00
test_loader.py
Remove --keep-runtime-typing from pyupgrade.
2024-10-17 21:26:02 +05:00
test_loader_deprecated.py
Address some previously ignored pylint messages. ( #6531 )
2024-11-11 11:49:52 +01:00
test_logformatter.py
Address some previously ignored pylint messages. ( #6531 )
2024-11-11 11:49:52 +01:00
test_logstats.py
Refactor LogStats extension to log IPM and RPM to stats on spider_close ( #4111 )
2024-02-16 12:25:38 +01:00
test_mail.py
Remove code for unsupported Twisted. ( #6510 )
2024-10-29 10:21:07 +01:00
test_middleware.py
Remove build_from_settings().
2024-11-11 16:44:47 +05:00
test_pipeline_crawl.py
Run and fix linkcheck. ( #6524 )
2024-11-04 11:40:07 +01:00
test_pipeline_files.py
Merge pull request #6540 from wRAR/build_from_settings
2024-11-14 20:40:54 +05:00
test_pipeline_images.py
Prefer crawler.settings over settings in media pipelines.
2024-11-14 02:03:43 +05:00
test_pipeline_media.py
2.12 release notes ( #6226 )
2024-11-18 13:07:32 +05:00
test_pipelines.py
sort imports with isort
2023-01-25 14:25:15 -06:00
test_pqueues.py
sort imports with isort
2023-01-25 14:25:15 -06:00
test_proxy_connect.py
fix: Proxy tests don't use custom certificate authority
2024-02-29 06:41:14 -03:00
test_request_attribute_binding.py
sort imports with isort
2023-01-25 14:25:15 -06:00
test_request_cb_kwargs.py
Drop Python 3.8 Support ( #6472 )
2024-10-16 10:03:16 +02:00
test_request_dict.py
Address some previously ignored pylint messages. ( #6531 )
2024-11-11 11:49:52 +01:00
test_request_left.py
sort imports with isort
2023-01-25 14:25:15 -06:00
test_responsetypes.py
Add pyupgrade.
2024-06-05 22:57:18 +05:00
test_robotstxt_interface.py
Drop Reppy.
2024-10-17 23:41:23 +05:00
test_scheduler.py
Filter test-time warnings. ( #6501 )
2024-10-21 12:30:49 +02:00
test_scheduler_base.py
Remove --keep-runtime-typing from pyupgrade.
2024-10-17 21:26:02 +05:00
test_scrapy__getattr__.py
Deprecate `scrapy.twisted_version` ( #6512 )
2024-10-30 00:28:35 +05:00
test_selector.py
modified string's concat to f-strings ( #6296 )
2024-04-01 15:37:23 +02:00
test_signals.py
sort imports with isort
2023-01-25 14:25:15 -06:00
test_spider.py
flake8-comprehensions
2024-06-19 23:36:36 +05:00
test_spidermiddleware.py
Remove --keep-runtime-typing from pyupgrade.
2024-10-17 21:26:02 +05:00
test_spidermiddleware_depth.py
sort imports with isort
2023-01-25 14:25:15 -06:00
test_spidermiddleware_httperror.py
Drop Python 3.8 Support ( #6472 )
2024-10-16 10:03:16 +02:00
test_spidermiddleware_offsite.py
Fix tests
2024-02-28 16:36:19 -03:00
test_spidermiddleware_output_chain.py
adding black formatter to all the code
2022-11-29 11:30:46 -03:00
test_spidermiddleware_referer.py
Address some previously ignored pylint messages. ( #6531 )
2024-11-11 11:49:52 +01:00
test_spidermiddleware_urllength.py
Add from_crawler() to components that only had from_settings().
2024-11-12 21:12:32 +05:00
test_spiderstate.py
Remove usage of deprecated mktemp ( #5285 )
2024-02-26 19:53:06 +01:00
test_squeues.py
Upgrade CI tools
2023-02-02 06:37:40 +01:00
test_squeues_request.py
Remove usage of deprecated mktemp ( #5285 )
2024-02-26 19:53:06 +01:00
test_stats.py
Remove datetime.utcnow() usage ( #6014 )
2023-08-21 15:51:49 +02:00
test_toplevel.py
sort imports with isort
2023-01-25 14:25:15 -06:00
test_urlparse_monkeypatches.py
sort imports with isort
2023-01-25 14:25:15 -06:00
test_utils_asyncgen.py
Implement spider middleware iterable upgrade/downgrade.
2022-01-11 18:28:32 +05:00
test_utils_asyncio.py
Filter test-time warnings. ( #6501 )
2024-10-21 12:30:49 +02:00
test_utils_conf.py
Deprecation removals. ( #6500 )
2024-10-31 18:06:22 +05:00
test_utils_console.py
Upgrade CI tools
2023-02-02 06:37:40 +01:00
test_utils_curl.py
feat: added test_post_data_raw_with_string_prefix
2023-04-18 22:28:16 -05:00
test_utils_datatypes.py
Address some previously ignored pylint messages. ( #6531 )
2024-11-11 11:49:52 +01:00
test_utils_defer.py
Address some previously ignored pylint messages. ( #6531 )
2024-11-11 11:49:52 +01:00
test_utils_deprecate.py
Merge branch 'master' into addons
2023-06-14 15:37:08 +04:00
test_utils_display.py
sort imports with isort
2023-01-25 14:25:15 -06:00
test_utils_gz.py
IOError and other cleanup ( #4716 )
2023-06-21 20:08:53 +02:00
test_utils_httpobj.py
adding black formatter to all the code
2022-11-29 11:30:46 -03:00
test_utils_iterators.py
Fix tests
2024-02-28 16:36:19 -03:00
test_utils_log.py
Drop Python 3.8 Support ( #6472 )
2024-10-16 10:03:16 +02:00
test_utils_project.py
Merge 2.11.2 changes ( #6363 )
2024-05-14 18:54:11 +02:00
test_utils_python.py
Deprecate unused scrapy utils ( #6519 )
2024-11-04 21:09:45 +05:00
test_utils_request.py
Deprecate build_from_crawler() calling from_settings().
2024-11-13 00:20:10 +05:00
test_utils_response.py
Merge remote-tracking branch 'scrapy/2.11' into 2.11-port
2024-02-15 06:39:50 +01:00
test_utils_serialize.py
Fix and remove most of the entries from the mypy ignore list ( #6137 )
2023-11-07 09:34:35 +01:00
test_utils_signal.py
Bump pylint, cleanup the ignored tags.
2024-02-28 14:31:21 +05:00
test_utils_sitemap.py
adding black formatter to all the code
2022-11-29 11:30:46 -03:00
test_utils_spider.py
Bump pylint, cleanup the ignored tags.
2024-02-28 14:31:21 +05:00
test_utils_template.py
Fix tests
2024-02-28 16:36:19 -03:00
test_utils_trackref.py
adding black formatter to all the code
2022-11-29 11:30:46 -03:00
test_utils_url.py
Fix and remove most of the entries from the mypy ignore list ( #6137 )
2023-11-07 09:34:35 +01:00
test_webclient.py
Remove build_from_settings().
2024-11-11 16:44:47 +05:00
upper-constraints.txt
upper-constraints.txt: restrict botocore further
2021-03-18 23:42:29 +01:00
10089c6fe2