RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
scrapy/docs/topics
History
Felipe Benevolo 89f53f0555
Added download_async() to ExecutionEngine and test cases for download() and download_async() (#6842) 
* added async_download()

* add case tests for ExecutionEngine download() and async_download()

* change async_download() to download_async() in Engine class and subsequent tests

* fixed reactor import in test_engine.py

* Simplify TestEngineDownloadAsync.

* replaced tearDown by self.engine.downloader.close in test_engine.py and replace @defer.inlineCallbacks by @inlineCallbacks

* Simplify ExecutionEngine.download().

* Remove an unneeded import.

* Refactor ExecutionEngine.download{,_async}() tests.

* Deprecate ExecutionEngine.download().

* Update doc examples to use download_async().

* Replace uses of download() with download_async().

* Fix test_downloadermiddleware_robotstxt.py.

* Remove a stray file.

---------

Co-authored-by: Andrey Rakhmatullin <wrar@wrar.name>
 		2025-07-27 23:17:51 +05:00
..
_images Removed obsolete firebug-images 2018-08-23 16:19:13 +02:00
addons.rst Cover the current master in the release notes (up to daf9db7). 2025-04-25 19:43:29 +05:00
api.rst Don't use CrawlerProcess in the commands that don't need it. (#6824) 2025-05-28 19:57:33 +05:00
architecture.rst Support asynchronous start requests (#6729) 2025-05-07 19:04:03 +02:00
asyncio.rst Generic improvements related to reactorless tests (#6968) 2025-07-25 13:35:00 +05:00
autothrottle.rst Deprecate CONCURRENT_REQUESTS_PER_IP setting (#6921) 2025-06-30 16:51:05 +05:00
benchmarking.rst Add sphinx-lint. (#6920) 2025-06-28 01:37:20 +02:00
broad-crawls.rst Deprecate CONCURRENT_REQUESTS_PER_IP setting (#6921) 2025-06-30 16:51:05 +05:00
commands.rst Use AsyncCrawlerProcess in commands. (#6845) 2025-06-03 17:47:52 +05:00
components.rst Support asynchronous start requests (#6729) 2025-05-07 19:04:03 +02:00
contracts.rst Merge branch 'master' of github.com:Laerte/scrapy 2024-08-27 07:16:10 -03:00
coroutines.rst Added download_async() to ExecutionEngine and test cases for download() and download_async() (#6842) 2025-07-27 23:17:51 +05:00
debug.rst Mention open_in_browser in the release notes 2023-11-29 12:13:04 +01:00
deploy.rst Run and fix linkcheck. (#6524) 2024-11-04 11:40:07 +01:00
developer-tools.rst Add sphinx-lint. (#6920) 2025-06-28 01:37:20 +02:00
djangoitem.rst Update documentation links 2016-03-03 16:28:33 +00:00
downloader-middleware.rst Centralize from_crawler docs (and somewhat related changes) (#6723) 2025-03-11 14:53:04 +01:00
dynamic-content.rst Add sphinx-lint. (#6920) 2025-06-28 01:37:20 +02:00
email.rst Centralize from_crawler docs (and somewhat related changes) (#6723) 2025-03-11 14:53:04 +01:00
exceptions.rst Improve internal refs to scrapy.Request and scrapy.Selector (#6526) 2025-01-07 16:18:18 +05:00
exporters.rst Add sphinx-lint. (#6920) 2025-06-28 01:37:20 +02:00
extensions.rst Centralize from_crawler docs (and somewhat related changes) (#6723) 2025-03-11 14:53:04 +01:00
feed-exports.rst Document default values set by startproject (#6775) 2025-05-05 18:51:15 +02:00
item-pipeline.rst Added download_async() to ExecutionEngine and test cases for download() and download_async() (#6842) 2025-07-27 23:17:51 +05:00
items.rst Remove the chdir fixture, re-enable fancy pytest asserts (#6888) 2025-06-14 14:01:20 +05:00
jobs.rst Support asynchronous start requests (#6729) 2025-05-07 19:04:03 +02:00
leaks.rst Add sphinx-lint. (#6920) 2025-06-28 01:37:20 +02:00
link-extractors.rst Removing empty example reference (#6402) 2024-06-17 11:37:11 +02:00
loaders.rst Remove the chdir fixture, re-enable fancy pytest asserts (#6888) 2025-06-14 14:01:20 +05:00
logging.rst Remove trailing whitespace 2025-03-11 11:56:44 +01:00
media-pipeline.rst Enable AsyncioSelectorReactor by default. (#6713) 2025-03-12 01:18:30 +05:00
practices.rst Add `AsyncCrawlerProcess` and `Crawler.crawl_async()` (#6817) 2025-05-28 18:55:44 +05:00
request-response.rst Add sphinx-lint. (#6920) 2025-06-28 01:37:20 +02:00
scheduler.rst Support asynchronous start requests (#6729) 2025-05-07 19:04:03 +02:00
scrapyd.rst Use https:// for readthedocs links 2017-06-01 16:41:52 +02:00
selectors.rst Remove the chdir fixture, re-enable fancy pytest asserts (#6888) 2025-06-14 14:01:20 +05:00
settings.rst Generic improvements related to reactorless tests (#6968) 2025-07-25 13:35:00 +05:00
shell.rst Remove the chdir fixture, re-enable fancy pytest asserts (#6888) 2025-06-14 14:01:20 +05:00
signals.rst Skip the doctest. 2025-05-15 22:17:37 +05:00
spider-middleware.rst Mark abstract base classes as such. (#6930) 2025-06-30 15:14:34 +05:00
spiders.rst Fix typo in documentation and code: 'needs_backoff' -> 'needs_backout' (#6815) 2025-05-20 07:51:31 +02:00
stats.rst Remove the chdir fixture, re-enable fancy pytest asserts (#6888) 2025-06-14 14:01:20 +05:00
telnetconsole.rst Remove the chdir fixture, re-enable fancy pytest asserts (#6888) 2025-06-14 14:01:20 +05:00