RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Update docs/topics/downloader-middleware.rst 

Co-authored-by: Adrián Chaves <adrian@chaves.io>
This commit is contained in:
umair ansari 2021-08-16 18:00:06 +05:30 committed by GitHub
parent cc1cb2de0c
commit 013ac90f61
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
docs/topics/downloader-middleware.rst
View File

@ -1068,10 +1068,10 @@ Native implementation, provides better speed than Protego.
In order to use this parser:
.. warning:: Does not support Python 3.9+
* Install `Reppy <https://github.com/seomoz/reppy/>`_ by running ``pip install reppy``
.. warning:: Does not support Python 3.9+
* Set :setting:`ROBOTSTXT_PARSER` setting to
``scrapy.robotstxt.ReppyRobotParser``