RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

added 502 to RETRY_HTTP_CODES

This commit is contained in:
Pablo Hoffman 2013-02-22 19:12:59 -02:00
parent e3f50b97b2
commit 7400ceb1ed
2 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
docs/topics/downloader-middleware.rst
View File

@ -724,7 +724,7 @@ Maximum number of times to retry, in addition to the first download.
RETRY_HTTP_CODES
^^^^^^^^^^^^^^^^
Default: ``[500, 503, 504, 400, 408]``
Default: ``[500, 502, 503, 504, 400, 408]``
Which HTTP response codes to retry. Other errors (DNS lookup issues,
connections lost, etc) are always retried.

2
scrapy/settings/default_settings.py
View File

@ -192,7 +192,7 @@ REFERER_ENABLED = True
RETRY_ENABLED = True
RETRY_TIMES = 2 # initial response + 2 retries = 3 requests
RETRY_HTTP_CODES = [500, 503, 504, 400, 408]
RETRY_HTTP_CODES = [500, 502, 503, 504, 400, 408]
RETRY_PRIORITY_ADJUST = -1
ROBOTSTXT_OBEY = False