scrapy/scrapy
Daniel Grana 8e5ede7179 shell command was broken by recent commits because scrapyengine.crawl does not returns a deferred anymore, now we use scrapyengine.schedule that returns the deferred of the download response 2009-07-07 16:22:23 -03:00
..
command shell command was broken by recent commits because scrapyengine.crawl does not returns a deferred anymore, now we use scrapyengine.schedule that returns the deferred of the download response 2009-07-07 16:22:23 -03:00
conf rewrite RequestLimitMiddleware spidermw so it does not consume spider output at once 2009-07-06 15:35:36 -03:00
contrib added missing comment for non-trivial code 2009-07-06 20:38:39 -03:00
contrib_exp decompressionmw: use a temporal filename because None is failing in some cases 2009-06-17 05:01:04 -03:00
core Added flow control mechanism to new Scraper component, to prevent cases where memory fills because of requests being downloaded much faster than they can be processed (by the spiders) 2009-07-06 15:31:50 -03:00
extension mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
fetcher mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
http Added 'priority' attribute to Requests and removed old 'priority' argument passed through engine, scheduler and scheduler middleware calls 2009-06-11 22:25:47 -03:00
item Move itempipeline functionality outside of engine as a spidermiddleware 2009-07-06 15:31:50 -03:00
link removed code from scrapy.link to avoid cyclic imports from scrapy.contrib.linkextractors.sgml 2009-05-18 19:27:51 -03:00
log added scrapy.log.logmessage_received signal 2009-06-26 12:27:03 -03:00
mail mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
management added web console docstring pointing to documentation, improved telnet console docstring 2009-06-23 16:11:23 -03:00
patches mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
spider Cleanup scrapyengine.crawl by moving functionality inside a new component named Scraper 2009-07-06 15:31:50 -03:00
stats Added reasons when closing domains ('reason' argument to engine close_domain method), replaced old 'status' parameter by new 'reason' parameter in domain_closed signal. updated and improved signals doc 2009-06-21 22:00:16 -03:00
store mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
templates/project mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
tests test.test_utils_url: update parameter name; utils.url: minor code clean up 2009-07-07 12:35:24 -03:00
utils test.test_utils_url: update parameter name; utils.url: minor code clean up 2009-07-07 12:35:24 -03:00
xlib mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
xpath fixed docstring 2009-05-18 20:59:26 -03:00
__init__.py mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00