scrapy/scrapy
Pablo Hoffman f5b188b179 Make RetryMiddleware obey Request.meta 'dont_retry' key when processing exceptions. Closes #259 2010-10-11 21:28:42 -02:00
..
commands Added ISpiderManager interface and a test to verify the default SpiderManager comforms to it 2010-09-03 14:29:27 -03:00
conf Added SpiderContext extension. Closes #203 2010-09-08 15:52:35 -03:00
contrib Make RetryMiddleware obey Request.meta 'dont_retry' key when processing exceptions. Closes #259 2010-10-11 21:28:42 -02:00
contrib_exp Make url/body attributes of Request/Response objects read-only - use replace() to change them. Deprecation warning left for backwards compatibilty. 2010-09-08 00:15:11 -03:00
core Fixed issue with non-standard line ending in HTTP headers. Closes #258 2010-10-09 20:43:05 -02:00
http Removed forked cookielib tests, because Python cookielib has been suffering several changes and maintaining a fork of the tests has become a pain. Instead, we've added specific tests for the urllib2 request/response wrappers 2010-09-27 07:55:27 -03:00
selector Improved encoding support by explicitly passing encoding to all str_to_unicode() and unicode_to_str() calls 2010-03-24 12:14:07 -03:00
templates Changed format of scrapy.cfg file to contain a [settings] section and a 'default' key inside it, instead of the other way around 2010-09-02 21:22:17 -03:00
tests Make RetryMiddleware obey Request.meta 'dont_retry' key when processing exceptions. Closes #259 2010-10-11 21:28:42 -02:00
utils Fixed listen_tcp function when receiving None or 0 in portrange argument. Closes #252 2010-09-27 12:27:32 -03:00
xlib monkeypatch urlparse if s3 netloc parsing fails (python issue7904). closes #223 2010-09-04 01:02:52 -03:00
__init__.py Don't fail if twisted is not available on scrapy/__init__.py, to avoid making setup.py depend on Twisted. Closes #256 2010-10-05 12:43:34 -02:00
cmdline.py Make custom project commands discovery work with eggified projects. Fixes #247 2010-09-22 15:42:31 -03:00
command.py Yet another scrapy.cmdline code refactoring by removing --settings and --version options, adding a version command and adding a UsageError exception for signaling usage errors. Updated all commands accordingly 2010-08-28 18:06:51 -03:00
crawler.py Make execution queue poll interval configurable through a new QUEUE_POLL_INTERVAL setting 2010-09-05 02:23:08 -03:00
exceptions.py Yet another scrapy.cmdline code refactoring by removing --settings and --version options, adding a version command and adding a UsageError exception for signaling usage errors. Updated all commands accordingly 2010-08-28 18:06:51 -03:00
extension.py Made ExtensionManager a subclass of MiddlewareManager 2010-08-22 05:33:08 -03:00
interfaces.py Added ISpiderManager interface and a test to verify the default SpiderManager comforms to it 2010-09-03 14:29:27 -03:00
item.py Raise when trying to set an item field value using setattr api, and added tests. 2010-06-22 14:00:31 -03:00
link.py updated some documentation references in source code 2009-08-19 22:41:26 -03:00
log.py Don't silence warnings after log is started. Closes #246 2010-09-22 01:00:34 -03:00
logformatter.py Fixed encoding error with some item dropped messages. Closes #232 2010-09-08 15:34:13 -03:00
mail.py removed (somewhat hacky) MAIL_DEBUG setting 2010-08-22 22:42:00 -03:00
middleware.py Made ExtensionManager a subclass of MiddlewareManager 2010-08-22 05:33:08 -03:00
project.py Refactoring of Crawler, Commands, Execution Queue and Spider Manager: 2010-08-25 19:24:36 -03:00
queue.py Fixed issue with unicode keyword arguments bug in earlier Python versions (see http://bugs.python.org/issue2646). Closes #250 2010-09-25 21:17:36 -03:00
shell.py Fixed bug with thread unsafety calls from Scrapy shell 2010-09-09 15:26:46 -03:00
signals.py remove request_uploaded signal and move response_received and response_downloaded to downloader manager. closes #228 2010-09-06 23:23:14 -03:00
spider.py Don't set allowed_domains attribute in BaseSpider constructor 2010-09-04 03:20:05 -03:00
spidermanager.py Added ISpiderManager interface and a test to verify the default SpiderManager comforms to it 2010-09-03 14:29:27 -03:00
spiderqueue.py SqliteSpiderQueue: failback to in-memory SQLite if database cannot be opened (typically due to missing write permissions) 2010-09-04 03:49:46 -03:00
stats.py Splitted stats collector classes from stats collection facility (#204) 2010-08-22 01:24:07 -03:00
statscol.py Splitted stats collector classes from stats collection facility (#204) 2010-08-22 01:24:07 -03:00
telnet.py Make telnet console and web service try a range of ports for binding, instead of just one. Closes #226 2010-09-05 06:48:08 -03:00
webservice.py Make telnet console and web service try a range of ports for binding, instead of just one. Closes #226 2010-09-05 06:48:08 -03:00