8 Commits

Author	SHA1	Message	Date
Pablo Hoffman	5ded8251d2	Fixed bug with deferred spider queues. Closes #288	2010-11-16 02:36:18 -02:00
Pablo Hoffman	1ef2cd400c	Fixed issue with unicode keyword arguments bug in earlier Python versions (see http://bugs.python.org/issue2646). Closes #250	2010-09-25 21:17:36 -03:00
Pablo Hoffman	d0081290f2	Improve error logging when failing to create a spider in the execution queue	2010-09-07 10:07:47 -03:00
Pablo Hoffman	a66bef7925	Make execution queue poll interval configurable through a new QUEUE_POLL_INTERVAL setting	2010-09-05 02:23:08 -03:00
Pablo Hoffman	1b766877f1	Added ISpiderManager interface and a test to verify the default SpiderManager comforms to it	2010-09-03 14:29:27 -03:00
Pablo Hoffman	7cfc379230	Execution Queue refactoring by taking out the queue backend to a new Spider ... Queue API. Also ported SQS Execution Queue to Spider Queue API, and make the scrapy queue command use the Spider Queue directly, with deferreds support. Closes #220.	2010-09-03 14:29:27 -03:00
Pablo Hoffman	ffad8e08e7	Support passing all keyword arguments to ExecutionQueue append_spider_name and append_url	2010-08-27 13:45:14 -03:00
Pablo Hoffman	f6c11af4c2	Moved module: scrapy.core.queue to scrapy.queue ... --HG-- rename : scrapy/core/queue.py => scrapy/queue.py	2010-08-26 21:15:32 -03:00