RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Added documentation for CLOSESPIDER_ERRORCOUNT setting. Refs #254

This commit is contained in:
Pablo Hoffman 2010-10-18 22:36:30 -02:00
parent c96f17c43d
commit 7d8f922df9
1 changed files with 21 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

23
docs/topics/extensions.rst
View File

@ -276,7 +276,12 @@ Closes a spider automatically when some conditions are met, using a specific
closing reason for each condition.
The conditions for closing a spider can be configured through the following
settings. Other conditions will be supported in the future.
settings:
* :setting:`CLOSESPIDER_TIMEOUT`
* :setting:`CLOSESPIDER_ITEMPASSED`
* :setting:`CLOSESPIDER_PAGECOUNT`
* :setting:`CLOSESPIDER_ERRORCOUNT`
.. setting:: CLOSESPIDER_TIMEOUT
@ -305,7 +310,9 @@ non set), spiders won't be closed by number of passed items.
.. setting:: CLOSESPIDER_PAGECOUNT
CLOSESPIDER_PAGECOUNT
""""""""""""""""""""""
"""""""""""""""""""""
.. versionadded:: 0.11
Default: ``0``
@ -314,8 +321,20 @@ crawls more than that, the spider will be closed with the reason
``closespider_pagecount``. If zero (or non set), spiders won't be closed by
number of crawled responses.
.. setting:: CLOSESPIDER_ERRORCOUNT
CLOSESPIDER_ERRORCOUNT
""""""""""""""""""""""
.. versionadded:: 0.11
Default: ``0``
An integer which specifies the maximum number of errors to receive before
closing the spider. If the spider generates more than that number of errors,
it will be closed with the reason ``closespider_errorcount``. If zero (or non
set), spiders won't be closed by number of errors.
StatsMailer extension
~~~~~~~~~~~~~~~~~~~~~