Scrapy, a fast high-level web crawling & scraping framework for Python.
Go to file
Adrian 58ed9fdccc
Document urlparse_cached (#7777)
2026-07-24 20:08:58 +05:00
.github
docs Document urlparse_cached (#7777) 2026-07-24 20:08:58 +05:00
extras
scrapy Document urlparse_cached (#7777) 2026-07-24 20:08:58 +05:00
sep
tests Support iterable values in BaseSettings.update() (#7763) 2026-07-23 12:37:21 +02:00
tests_typing
.git-blame-ignore-revs
.gitattributes
.gitignore
.pre-commit-config.yaml
.readthedocs.yml
AUTHORS
CITATION.cff
CODE_OF_CONDUCT.md
CONTRIBUTING.md
INSTALL.md
LICENSE
NEWS
README.rst
SECURITY.md
codecov.yml
conftest.py Use httpx2 as a preferred alternative to httpx. (#7762) 2026-07-23 10:29:22 +02:00
pyproject.toml Use httpx2 as a preferred alternative to httpx. (#7762) 2026-07-23 10:29:22 +02:00
tox.ini Use httpx2 as a preferred alternative to httpx. (#7762) 2026-07-23 10:29:22 +02:00

README.rst

<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en"> <head> </head>

Scrapy is a web scraping framework to extract structured data from websites. It is cross-platform, and requires Python 3.10+. It is maintained by Zyte (formerly Scrapinghub) and many other contributors.

Install with:

System Message: WARNING/2 (<stdin>, line 52)

Cannot analyze code. Pygments package not found.

.. code:: bash

    pip install scrapy

And follow the documentation to learn how to use it.

If you wish to contribute, see Contributing.

</html>