RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
scrapy/scrapy
History
Pablo Hoffman dcc28b7186 added setting: AUTOTHROTTLE_ENABLED 2011-05-22 18:31:36 -03:00
..
commands added support for -a option to runspider command (like it works with crawl command) 2011-05-17 22:07:49 -03:00
contrib added setting: AUTOTHROTTLE_ENABLED 2011-05-22 18:31:36 -03:00
contrib_exp ported internal scrapy.utils imports to w3lib 2011-04-19 01:33:52 -03:00
core fix error messages due to fetching pages during shutdown process 2011-05-20 14:35:37 +01:00
http make sure Request.method is always str 2011-05-02 01:11:19 -03:00
selector avoid stripping trailing spaces on lxml-based selectors. closes #270 2010-10-27 21:39:28 -02:00
settings dump stats to log by default (ie. change default value of STATS_DUMP to True) 2011-05-17 22:42:05 -03:00
templates The xmlfeed.tmpl file didn't use the naming convention specific of the XMLFeedSpider. Namely, it used parse_item (which has been deprecated) instead of parse_node and it didn't show the iterator and itertag attributes. 2011-01-11 17:23:46 -02:00
tests Removed support for default values in Scrapy items, which have proven confusing in the past 2011-05-19 21:42:46 -03:00
utils fix error messages due to fetching pages during shutdown process 2011-05-20 14:35:37 +01:00
xlib Removed scrapy.xlib.simplejson module. Scrapy now requires simplejson if running on Python 2.5. Closes #289 2010-11-16 03:11:12 -02:00
__init__.py Bumped version to 0.13 2011-01-02 17:21:31 -02:00
cmdline.py A couple of changes to fix #303: 2011-01-05 15:59:43 -02:00
command.py Added support for setting exit code in Scrapy commands. Closes #248 2010-09-23 13:43:21 -03:00
conf.py Removed hacky SCRAPY_SETTINGS_DISABLED environment variable 2010-09-22 16:08:18 -03:00
crawler.py Added support for unifying access to per-spider settings. Refs #245 2010-09-22 16:09:13 -03:00
exceptions.py A couple of changes to fix #303: 2011-01-05 15:59:43 -02:00
extension.py Made ExtensionManager a subclass of MiddlewareManager 2010-08-22 05:33:08 -03:00
interfaces.py Added ISpiderManager interface and a test to verify the default SpiderManager comforms to it 2010-09-03 14:29:27 -03:00
item.py Removed support for default values in Scrapy items, which have proven confusing in the past 2011-05-19 21:42:46 -03:00
link.py add nofollow to Link object 2011-02-25 12:55:51 -02:00
linkextractor.py Some Link extractor improvements: 2011-05-18 12:32:34 -03:00
log.py Don't silence warnings after log is started. Closes #246 2010-09-22 01:00:34 -03:00
logformatter.py Fixed encoding error with some item dropped messages. Closes #232 2010-09-08 15:34:13 -03:00
mail.py removed (somewhat hacky) MAIL_DEBUG setting 2010-08-22 22:42:00 -03:00
middleware.py A couple of changes to fix #303: 2011-01-05 15:59:43 -02:00
project.py Refactoring of Crawler, Commands, Execution Queue and Spider Manager: 2010-08-25 19:24:36 -03:00
queue.py Fixed bug with deferred spider queues. Closes #288 2010-11-16 02:36:18 -02:00
shell.py ported internal scrapy.utils imports to w3lib 2011-04-19 01:33:52 -03:00
signals.py remove request_uploaded signal and move response_received and response_downloaded to downloader manager. closes #228 2010-09-06 23:23:14 -03:00
spider.py Added support for unifying access to per-spider settings. Refs #245 2010-09-22 16:09:13 -03:00
spidermanager.py Added ISpiderManager interface and a test to verify the default SpiderManager comforms to it 2010-09-03 14:29:27 -03:00
spiderqueue.py * Added support for project data storage (closes #276) 2010-10-31 03:25:37 -02:00
stats.py Splitted stats collector classes from stats collection facility (#204) 2010-08-22 01:24:07 -03:00
statscol.py Splitted stats collector classes from stats collection facility (#204) 2010-08-22 01:24:07 -03:00
telnet.py Automated merge with http://hg.scrapy.org/scrapy-0.10 2010-11-10 13:36:05 -02:00
webservice.py Fixed bug in addversion.json with old Twisted versions. Closes #293 2010-11-25 12:12:42 -02:00