scrapy/docs
Adrián Chaves 98ba61256d
Deprecate BaseDupeFilter.log() and improve dupefilter docs (#4151)
* Remove BaseDupeFilter.log()

It is never called because request_seen() always returns False

* Document the interface of DUPEFILTER_CLASS classes

* Remove unnecessary BaseDupeFilter comments and add a short class description

* Improve the documentation related to the DUPEFILTER_CLASS setting

* Deprecate BaseDupeFilter.log

* Update the docs

* Fix the new code example

* Remove typing to keep the example short

Otherwise, it would have required yet another import line (from __future__ or typing).

---------

Co-authored-by: Andrey Rakhmatullin <wrar@wrar.name>
2025-01-14 19:36:56 +05:00
..
_ext Split ruff and pylint ignores into two categories, some pylint cleanup. 2025-01-02 01:03:42 +05:00
_static HTML Conventions 2022-03-17 20:09:56 +01:00
_tests Update quotes.toscrape.com page copies (#6190) 2024-01-01 22:58:34 +04:00
intro Run and fix linkcheck. (#6524) 2024-11-04 11:40:07 +01:00
topics Deprecate BaseDupeFilter.log() and improve dupefilter docs (#4151) 2025-01-14 19:36:56 +05:00
utils IOError and other cleanup (#4716) 2023-06-21 20:08:53 +02:00
Makefile Fixed Docs Makefile to open build/html/index.html in browser(#5878) 2023-03-28 23:23:32 +05:30
README.rst Typo: cleanup (verb) → clean up (#5538) 2022-06-20 11:54:05 +02:00
conf.py Deprecate BaseDupeFilter.log() and improve dupefilter docs (#4151) 2025-01-14 19:36:56 +05:00
conftest.py adding black formatter to all the code 2022-11-29 11:30:46 -03:00
contributing.rst Contributing: add a section on finding work (#6575) 2024-12-12 11:38:30 +01:00
faq.rst Run and fix linkcheck. (#6524) 2024-11-04 11:40:07 +01:00
index.rst Run and fix linkcheck. (#6524) 2024-11-04 11:40:07 +01:00
news.rst Improve internal refs to scrapy.Request and scrapy.Selector (#6526) 2025-01-07 16:18:18 +05:00
requirements.txt chore(docs): update `sphinx` dependencies (#6200) 2024-01-15 14:11:33 +01:00
versioning.rst Fix typos 2021-10-11 22:32:42 +08:00

README.rst

<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en"> <head> </head>
orphan:

Scrapy documentation quick start guide

This file provides a quick guide on how to compile the Scrapy documentation.

Setup the environment

To compile the documentation you need Sphinx Python library. To install it and all its dependencies run the following command from this dir

pip install -r requirements.txt

Compile the documentation

To compile the documentation (to classic HTML output) run the following command from this dir:

make html

Documentation will be generated (in HTML format) inside the build/html dir.

View the documentation

To view the documentation run the following command:

make htmlview

This command will fire up your default browser and open the main page of your (previously generated) HTML documentation.

Start over

To clean up all generated documentation files and start from scratch run:

make clean

Keep in mind that this command won't touch any documentation source files.

Recreating documentation on the fly

There is a way to recreate the doc automatically when you make changes, you need to install watchdog (pip install watchdog) and then use:

make watch

Alternative method using tox

To compile the documentation to HTML run the following command:

tox -e docs

Documentation will be generated (in HTML format) inside the .tox/docs/tmp/html dir.

</html>