scrapy/docs
Felipe Benevolo 89f53f0555
Added download_async() to ExecutionEngine and test cases for download() and download_async() (#6842)
* added async_download()

* add case tests for ExecutionEngine download() and async_download()

* change async_download() to download_async() in Engine class and subsequent tests

* fixed reactor import in test_engine.py

* Simplify TestEngineDownloadAsync.

* replaced tearDown by self.engine.downloader.close in test_engine.py and replace @defer.inlineCallbacks by @inlineCallbacks

* Simplify ExecutionEngine.download().

* Remove an unneeded import.

* Refactor ExecutionEngine.download{,_async}() tests.

* Deprecate ExecutionEngine.download().

* Update doc examples to use download_async().

* Replace uses of download() with download_async().

* Fix test_downloadermiddleware_robotstxt.py.

* Remove a stray file.

---------

Co-authored-by: Andrey Rakhmatullin <wrar@wrar.name>
2025-07-27 23:17:51 +05:00
..
_ext Upgrade Sphinx (#6624) 2025-01-22 18:09:42 +01:00
_static Feature the new logo in the README (#6831) 2025-06-06 12:43:56 +05:00
_templates Link to scrapy.org from the docs (#6780) 2025-05-07 16:11:22 +02:00
_tests Remove trailing whitespace 2025-03-11 11:56:44 +01:00
intro Support asynchronous start requests (#6729) 2025-05-07 19:04:03 +02:00
topics Added download_async() to ExecutionEngine and test cases for download() and download_async() (#6842) 2025-07-27 23:17:51 +05:00
utils IOError and other cleanup (#4716) 2023-06-21 20:08:53 +02:00
Makefile chore(docs): refactor config (#6623) 2025-01-20 12:18:30 +01:00
README.rst Typo: cleanup (verb) → clean up (#5538) 2022-06-20 11:54:05 +02:00
conf.py Remove the deprecated sphinx-hoverxref (#6922) 2025-06-28 18:04:06 +05:00
conftest.py adding black formatter to all the code 2022-11-29 11:30:46 -03:00
contributing.rst Replace Black with Ruff in contributing.rst. (#6903) 2025-06-23 22:25:56 +05:00
faq.rst Support asynchronous start requests (#6729) 2025-05-07 19:04:03 +02:00
index.rst Run and fix linkcheck. (#6524) 2024-11-04 11:40:07 +01:00
news.rst Merge remote-tracking branch 'origin/2.13' 2025-07-02 20:46:02 +05:00
requirements.txt Remove the deprecated sphinx-hoverxref (#6922) 2025-06-28 18:04:06 +05:00
versioning.rst Fix typos 2021-10-11 22:32:42 +08:00

README.rst

<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en"> <head> </head>
orphan:

Scrapy documentation quick start guide

This file provides a quick guide on how to compile the Scrapy documentation.

Setup the environment

To compile the documentation you need Sphinx Python library. To install it and all its dependencies run the following command from this dir

pip install -r requirements.txt

Compile the documentation

To compile the documentation (to classic HTML output) run the following command from this dir:

make html

Documentation will be generated (in HTML format) inside the build/html dir.

View the documentation

To view the documentation run the following command:

make htmlview

This command will fire up your default browser and open the main page of your (previously generated) HTML documentation.

Start over

To clean up all generated documentation files and start from scratch run:

make clean

Keep in mind that this command won't touch any documentation source files.

Recreating documentation on the fly

There is a way to recreate the doc automatically when you make changes, you need to install watchdog (pip install watchdog) and then use:

make watch

Alternative method using tox

To compile the documentation to HTML run the following command:

tox -e docs

Documentation will be generated (in HTML format) inside the .tox/docs/tmp/html dir.

</html>