3 Commits

Author	SHA1	Message	Date
Pablo Hoffman	ffad8e08e7	Support passing all keyword arguments to ExecutionQueue append_spider_name and append_url	2010-08-27 13:45:14 -03:00
Pablo Hoffman	f6c11af4c2	Moved module: scrapy.core.queue to scrapy.queue ... --HG-- rename : scrapy/core/queue.py => scrapy/queue.py	2010-08-26 21:15:32 -03:00
Pablo Hoffman	cae22930c8	Added ExecutionQueue class for feeding spiders and requests to scrape. This ... class can (and is meant to) be subclassed by projects that want to use a custom mechanism for feeding spiders to crawl. For example, a queue that pulls spiders to scrape from Amazon SQS (an example will be added soon). Also introduced a rather big core refactoring of Scrapy manager and Scrapy engine.	2010-05-26 10:29:32 -03:00