mirror of https://github.com/scrapy/scrapy.git
Merge pull request #5231 from umairnsr87/umairnsr87/issues/5226
updated documentation for python version for reppy
This commit is contained in:
commit
bdf8355ce1
|
|
@ -1070,9 +1070,13 @@ In order to use this parser:
|
|||
|
||||
* Install `Reppy <https://github.com/seomoz/reppy/>`_ by running ``pip install reppy``
|
||||
|
||||
.. warning:: `Upstream issue #122
|
||||
<https://github.com/seomoz/reppy/issues/122>`_ prevents reppy usage in Python 3.9+.
|
||||
|
||||
* Set :setting:`ROBOTSTXT_PARSER` setting to
|
||||
``scrapy.robotstxt.ReppyRobotParser``
|
||||
|
||||
|
||||
.. _rerp-parser:
|
||||
|
||||
Robotexclusionrulesparser
|
||||
|
|
|
|||
Loading…
Reference in New Issue