From 3f8542eb566dd06d35b17574d65955de2682a29e Mon Sep 17 00:00:00 2001 From: Chuan Jin Date: Mon, 5 Jun 2017 23:31:37 +0200 Subject: [PATCH 1/3] Update extensions.rst #2759 --- docs/topics/extensions.rst | 7 ++++--- 1 file changed, 4 insertions(+), 3 deletions(-) diff --git a/docs/topics/extensions.rst b/docs/topics/extensions.rst index 6036db0f5..d24f579ee 100644 --- a/docs/topics/extensions.rst +++ b/docs/topics/extensions.rst @@ -277,9 +277,10 @@ CLOSESPIDER_ITEMCOUNT Default: ``0`` An integer which specifies a number of items. If the spider scrapes more than -that amount if items and those items are passed by the item pipeline, the -spider will be closed with the reason ``closespider_itemcount``. If zero (or -non set), spiders won't be closed by number of passed items. +that amount and those items are passed by the item pipeline, the +spider will be closed with the reason ``closespider_itemcount``, requests which +are currently in the downloader queue (up to CONCURRENT_REQUEST requests) are still processed. +If zero (or non set), spiders won't be closed by number of passed items. .. setting:: CLOSESPIDER_PAGECOUNT From e7061f7a4193ea4bd7587c6cac5c9a52f847bb58 Mon Sep 17 00:00:00 2001 From: Paul Tremberth Date: Tue, 6 Jun 2017 10:47:43 +0200 Subject: [PATCH 2/3] Reformat a bit --- docs/topics/extensions.rst | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/docs/topics/extensions.rst b/docs/topics/extensions.rst index d24f579ee..03c5f2316 100644 --- a/docs/topics/extensions.rst +++ b/docs/topics/extensions.rst @@ -278,8 +278,9 @@ Default: ``0`` An integer which specifies a number of items. If the spider scrapes more than that amount and those items are passed by the item pipeline, the -spider will be closed with the reason ``closespider_itemcount``, requests which -are currently in the downloader queue (up to CONCURRENT_REQUEST requests) are still processed. +spider will be closed with the reason ``closespider_itemcount``. +Requests which are currently in the downloader queue (up to +:setting:`CONCURRENT_REQUEST` requests) are still processed. If zero (or non set), spiders won't be closed by number of passed items. .. setting:: CLOSESPIDER_PAGECOUNT From 39ad0d0bddbc3d15b4186598bc69386e7321e17b Mon Sep 17 00:00:00 2001 From: Paul Tremberth Date: Tue, 6 Jun 2017 10:48:30 +0200 Subject: [PATCH 3/3] Fix setting name reference --- docs/topics/extensions.rst | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/topics/extensions.rst b/docs/topics/extensions.rst index 03c5f2316..7a67cf295 100644 --- a/docs/topics/extensions.rst +++ b/docs/topics/extensions.rst @@ -280,7 +280,7 @@ An integer which specifies a number of items. If the spider scrapes more than that amount and those items are passed by the item pipeline, the spider will be closed with the reason ``closespider_itemcount``. Requests which are currently in the downloader queue (up to -:setting:`CONCURRENT_REQUEST` requests) are still processed. +:setting:`CONCURRENT_REQUESTS` requests) are still processed. If zero (or non set), spiders won't be closed by number of passed items. .. setting:: CLOSESPIDER_PAGECOUNT