mirror of https://github.com/scrapy/scrapy.git
updated documentation for python version for reppy
This commit is contained in:
parent
47a281d231
commit
8bbaea9892
|
|
@ -1073,6 +1073,8 @@ In order to use this parser:
|
|||
* Set :setting:`ROBOTSTXT_PARSER` setting to
|
||||
``scrapy.robotstxt.ReppyRobotParser``
|
||||
|
||||
* only works with python 3.8 and earlier
|
||||
|
||||
.. _rerp-parser:
|
||||
|
||||
Robotexclusionrulesparser
|
||||
|
|
|
|||
Loading…
Reference in New Issue