scrapy/docs
Andrey Rakhmatullin b9be5ce053
Reactorless shell and other small shell improvements (#7395)
* Use AsyncCrawlerProcess if TWISTED_REACTOR_ENABLED=False.

* defer.Deferred -> Deferred.

* Allow Shell with TWISTED_REACTOR_ENABLED=False.

* Shell workflow notes.

* Remove an unused argument.

* Shell.fetch_available.

* Shell._use_reactor.

* Some more comments.

* Simplify _schedule() and fix the spider shell var.

* More async def.

* Reactorless shell support.

* Add pragma: no cover.

* More notes.

* Remove a TODO.
2026-04-08 18:24:51 +05:00
..
_ext Add llms.txt and llms-full.txt generation (#7380) 2026-04-06 10:24:21 +02:00
_static Feature the new logo in the README (#6831) 2025-06-06 12:43:56 +05:00
_templates Link to scrapy.org from the docs (#6780) 2025-05-07 16:11:22 +02:00
_tests Remove trailing whitespace 2025-03-11 11:56:44 +01:00
intro Remove Python 3.9 support (#7121) 2025-10-27 12:37:49 +01:00
topics Reactorless shell and other small shell improvements (#7395) 2026-04-08 18:24:51 +05:00
utils IOError and other cleanup (#4716) 2023-06-21 20:08:53 +02:00
Makefile chore(docs): refactor config (#6623) 2025-01-20 12:18:30 +01:00
README.rst Add llms.txt and llms-full.txt generation (#7380) 2026-04-06 10:24:21 +02:00
conf.py Add llms.txt and llms-full.txt generation (#7380) 2026-04-06 10:24:21 +02:00
conftest.py adding black formatter to all the code 2022-11-29 11:30:46 -03:00
contributing.rst Replace Black with Ruff in contributing.rst. (#6903) 2025-06-23 22:25:56 +05:00
faq.rst Rename DNS_RESOLVER to TWISTED_DNS_RESOLVER (#7361) 2026-04-08 13:58:35 +02:00
index.rst Deprecate the mail API (#7263) 2026-03-24 21:31:12 +01:00
news.rst Response now uses less memory (#7374) 2026-04-08 14:25:11 +02:00
requirements.in Use sphinx-scrapy 0.7.1 (#7406) 2026-04-06 15:29:59 +02:00
requirements.txt Use sphinx-scrapy 0.7.1 (#7406) 2026-04-06 15:29:59 +02:00
versioning.rst Update tool versions (#7127) 2025-10-27 14:11:31 +01:00

README.rst

<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en"> <head> </head>
orphan:

Scrapy documentation quick start guide

This file provides a quick guide on how to compile the Scrapy documentation.

Setup the environment

To compile the documentation you need Sphinx Python library. To install it and all its dependencies run the following command from this dir

pip install -r requirements.txt

Compile the documentation

To compile the documentation (to classic HTML output) run the following command from this dir:

make html

Documentation will be generated (in HTML format) inside the build/html dir.

View the documentation

To view the documentation run the following command:

make htmlview

This command will fire up your default browser and open the main page of your (previously generated) HTML documentation.

Start over

To clean up all generated documentation files and start from scratch run:

make clean

Keep in mind that this command won't touch any documentation source files.

Recreating documentation on the fly

There is a way to recreate the doc automatically when you make changes, you need to install watchdog (pip install watchdog) and then use:

make watch

Alternative method using tox

To compile the documentation to HTML run the following command:

tox -e docs

Documentation will be generated inside the docs/_build/all dir.

</html>