| .. |
|
CrawlerProcess
|
Use twisted.python.log instead of failure.printTraceback().
|
2023-09-13 18:20:42 +04:00 |
|
CrawlerRunner
|
Ignore typing for twisted.internet.reactor globally.
|
2023-01-27 23:19:44 +04:00 |
|
keys
|
Remove datetime.utcnow() usage (#6014)
|
2023-08-21 15:51:49 +02:00 |
|
mocks
|
adding black formatter to all the code
|
2022-11-29 11:30:46 -03:00 |
|
sample_data
|
reaplying black, fixing conflicts and ignoring bandit checks on test directory
|
2023-01-20 10:55:46 -03:00 |
|
test_cmdline
|
Improve finding tests.test_cmdline.settings.
|
2023-06-12 21:50:29 +04:00 |
|
test_cmdline_crawl_with_pipeline
|
sort imports with isort
|
2023-01-25 14:25:15 -06:00 |
|
test_settings
|
Disable pylint for broken code.
|
2023-07-17 00:13:49 +04:00 |
|
test_spiderloader
|
Upgrade CI tools
|
2023-02-02 06:37:40 +01:00 |
|
test_utils_misc
|
Remove unneeded code.
|
2023-06-26 16:57:46 +04:00 |
|
__init__.py
|
adding black formatter to all the code
|
2022-11-29 11:30:46 -03:00 |
|
ftpserver.py
|
adding black formatter to all the code
|
2022-11-29 11:30:46 -03:00 |
|
ignores.txt
|
Remove deprecated classes BaseSgmlLinkExtractor, RegexLinkExtractor and SgmlLinkExtractor (#4356)
|
2020-07-17 12:40:04 +02:00 |
|
mockserver.py
|
Don't rely on get_testenv() for running mockserver.
|
2023-06-04 19:59:58 +04:00 |
|
pipelines.py
|
reaplying black, fixing conflicts and ignoring bandit checks on test directory
|
2023-01-20 10:55:46 -03:00 |
|
requirements.txt
|
Require pyftpdlib that supports Python 3.12.
|
2023-10-02 21:33:02 +04:00 |
|
spiders.py
|
Add Crawler._load_settings().
|
2023-09-12 14:44:16 +04:00 |
|
test_addons.py
|
Rename methods.
|
2023-09-13 15:47:22 +04:00 |
|
test_closespider.py
|
improve tests by having SlowSpider
|
2023-07-18 22:29:15 +08:00 |
|
test_command_check.py
|
Upgrade CI tools
|
2023-02-02 06:37:40 +01:00 |
|
test_command_fetch.py
|
Upgrade CI tools
|
2023-02-02 06:37:40 +01:00 |
|
test_command_parse.py
|
Fix parse command issues with asyncio (#5824)
|
2023-03-10 16:20:15 +01:00 |
|
test_command_shell.py
|
Add Crawler._load_settings().
|
2023-09-12 14:44:16 +04:00 |
|
test_command_version.py
|
Upgrade CI tools
|
2023-02-02 06:37:40 +01:00 |
|
test_commands.py
|
Add integration tests for modifying settings via args.
|
2023-09-12 20:16:26 +04:00 |
|
test_contracts.py
|
Check for async callbacks in contracts.
|
2023-08-06 17:28:34 +04:00 |
|
test_core_downloader.py
|
adding black formatter to all the code
|
2022-11-29 11:30:46 -03:00 |
|
test_crawl.py
|
Improve and simplify tests.
|
2023-09-13 14:17:41 +04:00 |
|
test_crawler.py
|
Rename methods.
|
2023-09-13 15:47:22 +04:00 |
|
test_dependencies.py
|
Remove obsolete top-level run code in tests.
|
2023-01-25 22:14:24 +04:00 |
|
test_downloader_handlers.py
|
Deprecate running Crawler.crawl() twice.
|
2023-09-06 19:29:44 +04:00 |
|
test_downloader_handlers_http2.py
|
Upgrade CI tools
|
2023-02-02 06:37:40 +01:00 |
|
test_downloadermiddleware.py
|
Add Crawler._load_settings().
|
2023-09-12 14:44:16 +04:00 |
|
test_downloadermiddleware_ajaxcrawlable.py
|
sort imports with isort
|
2023-01-25 14:25:15 -06:00 |
|
test_downloadermiddleware_cookies.py
|
sort imports with isort
|
2023-01-25 14:25:15 -06:00 |
|
test_downloadermiddleware_decompression.py
|
Upgrade CI tools
|
2023-02-02 06:37:40 +01:00 |
|
test_downloadermiddleware_defaultheaders.py
|
sort imports with isort
|
2023-01-25 14:25:15 -06:00 |
|
test_downloadermiddleware_downloadtimeout.py
|
sort imports with isort
|
2023-01-25 14:25:15 -06:00 |
|
test_downloadermiddleware_httpauth.py
|
sort imports with isort
|
2023-01-25 14:25:15 -06:00 |
|
test_downloadermiddleware_httpcache.py
|
Add Crawler._load_settings().
|
2023-09-12 14:44:16 +04:00 |
|
test_downloadermiddleware_httpcompression.py
|
Add Crawler._load_settings().
|
2023-09-12 14:44:16 +04:00 |
|
test_downloadermiddleware_httpproxy.py
|
Merge remote-tracking branch 'origin/master' into mypy-imports
|
2023-02-11 22:02:19 +04:00 |
|
test_downloadermiddleware_redirect.py
|
sort imports with isort
|
2023-01-25 14:25:15 -06:00 |
|
test_downloadermiddleware_retry.py
|
Improve the backwards compatibility for RetryMiddleware.EXCEPTIONS_TO_RETRY.
|
2023-09-14 15:51:00 +04:00 |
|
test_downloadermiddleware_robotstxt.py
|
Merge branch 'master' into no-callback
|
2023-01-30 15:43:05 +05:00 |
|
test_downloadermiddleware_stats.py
|
Add Crawler._load_settings().
|
2023-09-12 14:44:16 +04:00 |
|
test_downloadermiddleware_useragent.py
|
sort imports with isort
|
2023-01-25 14:25:15 -06:00 |
|
test_downloaderslotssettings.py
|
per_slot_settings(docs): code style fix 3 (from previous pre-commit check)
|
2023-02-16 18:19:36 +02:00 |
|
test_dupefilters.py
|
Add Crawler._load_settings().
|
2023-09-12 14:44:16 +04:00 |
|
test_engine.py
|
Add Crawler._load_settings().
|
2023-09-12 14:44:16 +04:00 |
|
test_engine_stop_download_bytes.py
|
sort imports with isort
|
2023-01-25 14:25:15 -06:00 |
|
test_engine_stop_download_headers.py
|
sort imports with isort
|
2023-01-25 14:25:15 -06:00 |
|
test_exporters.py
|
Remove deprecated PythonItemExporter.binary (#6007)
|
2023-08-10 07:36:42 +02:00 |
|
test_extension_periodic_log.py
|
Rename methods.
|
2023-09-13 15:47:22 +04:00 |
|
test_extension_telnet.py
|
Add Crawler._load_settings().
|
2023-09-12 14:44:16 +04:00 |
|
test_feedexport.py
|
Require pyftpdlib that supports Python 3.12.
|
2023-10-02 21:33:02 +04:00 |
|
test_http2_client_protocol.py
|
Merge remote-tracking branch 'origin/master' into mypy-imports
|
2023-02-11 22:02:19 +04:00 |
|
test_http_cookies.py
|
sort imports with isort
|
2023-01-25 14:25:15 -06:00 |
|
test_http_headers.py
|
sort imports with isort
|
2023-01-25 14:25:15 -06:00 |
|
test_http_request.py
|
Upgrade CI tools
|
2023-02-02 06:37:40 +01:00 |
|
test_http_response.py
|
fix: test_cache_json_response
|
2023-08-17 10:24:34 -06:00 |
|
test_item.py
|
adding black formatter to all the code
|
2022-11-29 11:30:46 -03:00 |
|
test_link.py
|
adding black formatter to all the code
|
2022-11-29 11:30:46 -03:00 |
|
test_linkextractors.py
|
Skip test_skip_bad_links based on the w3lib version
|
2023-04-12 09:28:28 +02:00 |
|
test_loader.py
|
Upgrade CI tools
|
2023-02-02 06:37:40 +01:00 |
|
test_loader_deprecated.py
|
Upgrade CI tools
|
2023-02-02 06:37:40 +01:00 |
|
test_logformatter.py
|
Upgrade CI tools
|
2023-02-02 06:37:40 +01:00 |
|
test_mail.py
|
Fix charset handling in MailSender #5096 (#5118)
|
2023-09-07 07:47:42 +02:00 |
|
test_middleware.py
|
Improve NotConfigured handling when clspath is a class.
|
2023-08-01 20:20:15 +04:00 |
|
test_pipeline_crawl.py
|
Upgrade CI tools
|
2023-02-02 06:37:40 +01:00 |
|
test_pipeline_files.py
|
Require pyftpdlib that supports Python 3.12.
|
2023-10-02 21:33:02 +04:00 |
|
test_pipeline_images.py
|
Refactor test cases to improve unit test quality (#5986)
|
2023-07-26 13:09:03 +02:00 |
|
test_pipeline_media.py
|
Add Crawler._load_settings().
|
2023-09-12 14:44:16 +04:00 |
|
test_pipelines.py
|
sort imports with isort
|
2023-01-25 14:25:15 -06:00 |
|
test_pqueues.py
|
sort imports with isort
|
2023-01-25 14:25:15 -06:00 |
|
test_proxy_connect.py
|
Don't rely on get_testenv() for running mockserver.
|
2023-06-04 19:59:58 +04:00 |
|
test_request_attribute_binding.py
|
sort imports with isort
|
2023-01-25 14:25:15 -06:00 |
|
test_request_cb_kwargs.py
|
Upgrade CI tools
|
2023-02-02 06:37:40 +01:00 |
|
test_request_dict.py
|
Remove functions deprecated in 2.6.0 (#5996)
|
2023-08-03 17:06:55 +02:00 |
|
test_request_left.py
|
sort imports with isort
|
2023-01-25 14:25:15 -06:00 |
|
test_responsetypes.py
|
chore: add tests
|
2023-05-02 12:53:04 -03:00 |
|
test_robotstxt_interface.py
|
IOError and other cleanup (#4716)
|
2023-06-21 20:08:53 +02:00 |
|
test_scheduler.py
|
Add Crawler._load_settings().
|
2023-09-12 14:44:16 +04:00 |
|
test_scheduler_base.py
|
adding black formatter to all the code
|
2022-11-29 11:30:46 -03:00 |
|
test_selector.py
|
fix: tests/tes_selector.py
|
2023-05-02 19:40:04 -06:00 |
|
test_signals.py
|
sort imports with isort
|
2023-01-25 14:25:15 -06:00 |
|
test_spider.py
|
Add Crawler._load_settings().
|
2023-09-12 14:44:16 +04:00 |
|
test_spidermiddleware.py
|
Merge remote-tracking branch 'origin/master' into mypy-imports
|
2023-02-11 22:02:19 +04:00 |
|
test_spidermiddleware_depth.py
|
sort imports with isort
|
2023-01-25 14:25:15 -06:00 |
|
test_spidermiddleware_httperror.py
|
Add Crawler._load_settings().
|
2023-09-12 14:44:16 +04:00 |
|
test_spidermiddleware_offsite.py
|
Add Crawler._load_settings().
|
2023-09-12 14:44:16 +04:00 |
|
test_spidermiddleware_output_chain.py
|
adding black formatter to all the code
|
2022-11-29 11:30:46 -03:00 |
|
test_spidermiddleware_referer.py
|
Upgrade CI tools
|
2023-02-02 06:37:40 +01:00 |
|
test_spidermiddleware_urllength.py
|
Add Crawler._load_settings().
|
2023-09-12 14:44:16 +04:00 |
|
test_spiderstate.py
|
Remove datetime.utcnow() usage (#6014)
|
2023-08-21 15:51:49 +02:00 |
|
test_squeues.py
|
Upgrade CI tools
|
2023-02-02 06:37:40 +01:00 |
|
test_squeues_request.py
|
sort imports with isort
|
2023-01-25 14:25:15 -06:00 |
|
test_stats.py
|
Remove datetime.utcnow() usage (#6014)
|
2023-08-21 15:51:49 +02:00 |
|
test_toplevel.py
|
sort imports with isort
|
2023-01-25 14:25:15 -06:00 |
|
test_urlparse_monkeypatches.py
|
sort imports with isort
|
2023-01-25 14:25:15 -06:00 |
|
test_utils_asyncgen.py
|
Implement spider middleware iterable upgrade/downgrade.
|
2022-01-11 18:28:32 +05:00 |
|
test_utils_asyncio.py
|
Actually run test_set_asyncio_event_loop().
|
2023-06-14 18:23:29 +04:00 |
|
test_utils_conf.py
|
Deprecate the custom attribute of build_component_list(). (#5993)
|
2023-08-02 14:21:06 +02:00 |
|
test_utils_console.py
|
Upgrade CI tools
|
2023-02-02 06:37:40 +01:00 |
|
test_utils_curl.py
|
feat: added test_post_data_raw_with_string_prefix
|
2023-04-18 22:28:16 -05:00 |
|
test_utils_datatypes.py
|
Merge branch 'master' into case-insensitive-dict
|
2023-06-21 22:12:44 +04:00 |
|
test_utils_defer.py
|
sort imports with isort
|
2023-01-25 14:25:15 -06:00 |
|
test_utils_deprecate.py
|
Merge branch 'master' into addons
|
2023-06-14 15:37:08 +04:00 |
|
test_utils_display.py
|
sort imports with isort
|
2023-01-25 14:25:15 -06:00 |
|
test_utils_gz.py
|
IOError and other cleanup (#4716)
|
2023-06-21 20:08:53 +02:00 |
|
test_utils_httpobj.py
|
adding black formatter to all the code
|
2022-11-29 11:30:46 -03:00 |
|
test_utils_iterators.py
|
Fixes for scrapy/utils/iterators.py typing.
|
2023-08-06 23:05:02 +04:00 |
|
test_utils_log.py
|
Add Crawler._load_settings().
|
2023-09-12 14:44:16 +04:00 |
|
test_utils_project.py
|
sort imports with isort
|
2023-01-25 14:25:15 -06:00 |
|
test_utils_python.py
|
Improve get_func_args (#5885)
|
2023-04-13 11:44:20 +02:00 |
|
test_utils_request.py
|
Add Crawler._load_settings().
|
2023-09-12 14:44:16 +04:00 |
|
test_utils_response.py
|
sort imports with isort
|
2023-01-25 14:25:15 -06:00 |
|
test_utils_serialize.py
|
sort imports with isort
|
2023-01-25 14:25:15 -06:00 |
|
test_utils_signal.py
|
adding black formatter to all the code
|
2022-11-29 11:30:46 -03:00 |
|
test_utils_sitemap.py
|
adding black formatter to all the code
|
2022-11-29 11:30:46 -03:00 |
|
test_utils_spider.py
|
sort imports with isort
|
2023-01-25 14:25:15 -06:00 |
|
test_utils_template.py
|
Upgrade CI tools
|
2023-02-02 06:37:40 +01:00 |
|
test_utils_trackref.py
|
adding black formatter to all the code
|
2022-11-29 11:30:46 -03:00 |
|
test_utils_url.py
|
sort imports with isort
|
2023-01-25 14:25:15 -06:00 |
|
test_webclient.py
|
sort imports with isort
|
2023-01-25 14:25:15 -06:00 |
|
upper-constraints.txt
|
upper-constraints.txt: restrict botocore further
|
2021-03-18 23:42:29 +01:00 |
1ed9ed4f92