3 Commits

Author	SHA1	Message	Date
Mikhail Korobov	9a999daa2a	DOWNLOAD_DELAY docs clarification: ... * delay is enforced per website, not per spider; * document download_delay attribute (it was previously documented only in FAQ about 999 error codes); * document how CONCURRENT_REQUESTS_PER_IP affects download delays.	2013-12-28 06:30:34 +06:00
Daniel Graña	d7daf836d5	Altering delay is enough to auto throttle downloads	2012-12-17 16:08:49 -02:00
Pablo Hoffman	b46b5a6ef0	Documented AutoThrottle extension and added to extensions available by ... default. Also deprecated concurrency and delay settings, in favour of using the standard Scrapy ones.	2012-09-20 18:52:57 -03:00