mirror of https://github.com/scrapy/scrapy.git
Update docs/topics/downloader-middleware.rst
Co-Authored-By: Adrián Chaves <adrian@chaves.io>
This commit is contained in:
parent
57e6f4c750
commit
d1d0bf8491
|
|
@ -1066,7 +1066,7 @@ Based on `RobotFileParser
|
|||
|
||||
* doesn't use the length based rule
|
||||
|
||||
It is faster than Protego and backward-compatible with versions of Scrapy before 1.8.0 .
|
||||
It is faster than Protego and backward-compatible with versions of Scrapy before 1.8.0.
|
||||
|
||||
In order to use this parser, set:
|
||||
|
||||
|
|
|
|||
Loading…
Reference in New Issue