RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Fix RobotsTxtMiddleware reference in doc

This commit is contained in:
Ismael Carnales 2009-12-04 15:37:24 -02:00
parent f86f62c5d9
commit 4ecc909bc1
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
docs/topics/downloader-middleware.rst
View File

@ -234,8 +234,6 @@ HttpCacheMiddleware
* :setting:`HTTPCACHE_EXPIRATION_SECS` - how many secs until the cache is
considered out of date
.. _topics-dlmw-robots:
HttpCompressionMiddleware
-------------------------
@ -293,6 +291,8 @@ RetryMiddleware
HTTP protocol. It's included by default because it's a common code used
to indicate server overload, which would be something we want to retry.
.. _topics-dlmw-robots:
RobotsTxtMiddleware
-------------------