From e6a0baa8fe775c78ddc043f1087acaf1481c89e9 Mon Sep 17 00:00:00 2001 From: Konstantin Lopuhin Date: Fri, 27 May 2016 10:47:57 +0300 Subject: [PATCH] Use "url" variable in the example Instead of hardcoded http://www.example.com: without it url variable is unused and only one request will make it past dupefilter. --- docs/topics/downloader-middleware.rst | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/topics/downloader-middleware.rst b/docs/topics/downloader-middleware.rst index 59a73493d..31545d548 100644 --- a/docs/topics/downloader-middleware.rst +++ b/docs/topics/downloader-middleware.rst @@ -200,7 +200,7 @@ There is support for keeping multiple cookie sessions per spider by using the For example:: for i, url in enumerate(urls): - yield scrapy.Request("http://www.example.com", meta={'cookiejar': i}, + yield scrapy.Request(url, meta={'cookiejar': i}, callback=self.parse_page) Keep in mind that the :reqmeta:`cookiejar` meta key is not "sticky". You need to keep