updated documentation for python version for reppy

This commit is contained in:
databender 2021-08-16 16:57:43 +05:30
parent 47a281d231
commit 8bbaea9892
1 changed files with 2 additions and 0 deletions

View File

@ -1073,6 +1073,8 @@ In order to use this parser:
* Set :setting:`ROBOTSTXT_PARSER` setting to
``scrapy.robotstxt.ReppyRobotParser``
* only works with python 3.8 and earlier
.. _rerp-parser:
Robotexclusionrulesparser