Scrapy, a fast high-level web crawling & scraping framework for Python.
Go to file
Andrey Rakhmatullin 2f62ab532d Bump version: 2.13.3 → 2.13.4 2025-11-17 16:30:37 +05:00
.github Cherry-pick: Mitigate brotli and deflate decompression bombs DoS (#7134) 2025-11-17 16:25:00 +05:00
docs Bump version: 2.13.3 → 2.13.4 2025-11-17 16:30:37 +05:00
extras Support asynchronous start requests (#6729) 2025-05-07 19:04:03 +02:00
scrapy Bump version: 2.13.3 → 2.13.4 2025-11-17 16:30:37 +05:00
sep Support asynchronous start requests (#6729) 2025-05-07 19:04:03 +02:00
tests Cherry-pick: Mitigate brotli and deflate decompression bombs DoS (#7134) 2025-11-17 16:25:00 +05:00
tests_typing Drop Python 3.8 Support (#6472) 2024-10-16 10:03:16 +02:00
.git-blame-ignore-revs chore: fix some typos in comments (#6317) 2024-04-17 10:56:26 +02:00
.gitattributes Maybe the problem is not in the code after all 2020-08-13 06:35:09 +02:00
.gitignore Add .vscode to .gitignore. (#6907) 2025-06-23 22:26:13 +05:00
.pre-commit-config.yaml Remove trailing whitespace 2025-03-11 11:56:44 +01:00
.readthedocs.yml chore(docs): refactor config (#6623) 2025-01-20 12:18:30 +01:00
AUTHORS Scrapinghub → Zyte 2021-02-02 15:03:20 +01:00
CODE_OF_CONDUCT.md Update Code of Conduct to Contributor Covenant v2.1 2022-10-28 02:13:37 +02:00
CONTRIBUTING.md Be consistent with domain used for links to documentation website 2019-01-31 01:28:53 -03:00
INSTALL.md Update and rename INSTALL to INSTALL.md 2022-10-06 19:58:48 +02:00
LICENSE added oxford commas to LICENSE 2018-06-01 21:48:43 -03:00
NEWS added NEWS file pointing to docs/news.rst 2012-04-28 23:32:51 -03:00
README.rst Avoid raw HTML in the README (#6839) 2025-06-06 12:44:06 +05:00
SECURITY.md Bump version: 2.12.0 → 2.13.0 2025-05-08 14:43:34 +05:00
codecov.yml codecov config: disable project check, tweak PR comments 2017-05-19 00:01:27 +05:00
conftest.py Cherry-pick: Mitigate brotli and deflate decompression bombs DoS (#7134) 2025-11-17 16:25:00 +05:00
pyproject.toml Bump version: 2.13.3 → 2.13.4 2025-11-17 16:30:37 +05:00
tox.ini Cherry-pick: Mitigate brotli and deflate decompression bombs DoS (#7134) 2025-11-17 16:25:00 +05:00

README.rst

<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en"> <head> </head>

Scrapy is a web scraping framework to extract structured data from websites. It is cross-platform, and requires Python 3.9+. It is maintained by Zyte (formerly Scrapinghub) and many other contributors.

Install with:

System Message: WARNING/2 (<stdin>, line 52)

Cannot analyze code. Pygments package not found.

.. code:: bash

    pip install scrapy

And follow the documentation to learn how to use it.

If you wish to contribute, see Contributing.

</html>