| .. |
|
commands
|
Added ISpiderManager interface and a test to verify the default SpiderManager comforms to it
|
2010-09-03 14:29:27 -03:00 |
|
contrib
|
Removed RequestLimitMiddleware
|
2010-09-22 16:09:13 -03:00 |
|
contrib_exp
|
Make url/body attributes of Request/Response objects read-only - use replace() to change them. Deprecation warning left for backwards compatibilty.
|
2010-09-08 00:15:11 -03:00 |
|
core
|
Ported code to use new unified access to spider settings, keeping backwards compatibility for old spider attributes. Refs #245
|
2010-09-22 16:09:13 -03:00 |
|
http
|
Added formname parameter for FormRequest.from_response
|
2010-09-20 08:33:24 -03:00 |
|
selector
|
Improved encoding support by explicitly passing encoding to all str_to_unicode() and unicode_to_str() calls
|
2010-03-24 12:14:07 -03:00 |
|
settings
|
Fixed CrawlerSettings.__str__() method when settings_module is None
|
2010-09-23 12:32:49 -03:00 |
|
templates
|
Splitted settings classes from settings singleton. Closes #244
|
2010-09-22 15:47:33 -03:00 |
|
tests
|
Added tests for CrawlerSettings and SpiderSettings classes
|
2010-09-22 16:09:13 -03:00 |
|
utils
|
Ported code to use new unified access to spider settings, keeping backwards compatibility for old spider attributes. Refs #245
|
2010-09-22 16:09:13 -03:00 |
|
xlib
|
monkeypatch urlparse if s3 netloc parsing fails (python issue7904). closes #223
|
2010-09-04 01:02:52 -03:00 |
|
__init__.py
|
Bumped version to 0.10.3
|
2010-09-15 21:03:21 -03:00 |
|
cmdline.py
|
Fixed access to settings module name, broken after recent changes to Settings classes
|
2010-09-22 22:21:29 -03:00 |
|
command.py
|
Yet another scrapy.cmdline code refactoring by removing --settings and --version options, adding a version command and adding a UsageError exception for signaling usage errors. Updated all commands accordingly
|
2010-08-28 18:06:51 -03:00 |
|
conf.py
|
Removed hacky SCRAPY_SETTINGS_DISABLED environment variable
|
2010-09-22 16:08:18 -03:00 |
|
crawler.py
|
Added support for unifying access to per-spider settings. Refs #245
|
2010-09-22 16:09:13 -03:00 |
|
exceptions.py
|
Yet another scrapy.cmdline code refactoring by removing --settings and --version options, adding a version command and adding a UsageError exception for signaling usage errors. Updated all commands accordingly
|
2010-08-28 18:06:51 -03:00 |
|
extension.py
|
Made ExtensionManager a subclass of MiddlewareManager
|
2010-08-22 05:33:08 -03:00 |
|
interfaces.py
|
Added ISpiderManager interface and a test to verify the default SpiderManager comforms to it
|
2010-09-03 14:29:27 -03:00 |
|
item.py
|
Raise when trying to set an item field value using setattr api, and added tests.
|
2010-06-22 14:00:31 -03:00 |
|
link.py
|
updated some documentation references in source code
|
2009-08-19 22:41:26 -03:00 |
|
log.py
|
Don't silence warnings after log is started. Closes #246
|
2010-09-22 01:00:34 -03:00 |
|
logformatter.py
|
Fixed encoding error with some item dropped messages. Closes #232
|
2010-09-08 15:34:13 -03:00 |
|
mail.py
|
removed (somewhat hacky) MAIL_DEBUG setting
|
2010-08-22 22:42:00 -03:00 |
|
middleware.py
|
Made ExtensionManager a subclass of MiddlewareManager
|
2010-08-22 05:33:08 -03:00 |
|
project.py
|
Refactoring of Crawler, Commands, Execution Queue and Spider Manager:
|
2010-08-25 19:24:36 -03:00 |
|
queue.py
|
Improve error logging when failing to create a spider in the execution queue
|
2010-09-07 10:07:47 -03:00 |
|
shell.py
|
Fixed unbounded spider error in shell, and enclosed fetch() method in a try/except block for logging errors more reliably
|
2010-09-23 12:33:24 -03:00 |
|
signals.py
|
remove request_uploaded signal and move response_received and response_downloaded to downloader manager. closes #228
|
2010-09-06 23:23:14 -03:00 |
|
spider.py
|
Added support for unifying access to per-spider settings. Refs #245
|
2010-09-22 16:09:13 -03:00 |
|
spidermanager.py
|
Added ISpiderManager interface and a test to verify the default SpiderManager comforms to it
|
2010-09-03 14:29:27 -03:00 |
|
spiderqueue.py
|
SqliteSpiderQueue: failback to in-memory SQLite if database cannot be opened (typically due to missing write permissions)
|
2010-09-04 03:49:46 -03:00 |
|
stats.py
|
Splitted stats collector classes from stats collection facility (#204)
|
2010-08-22 01:24:07 -03:00 |
|
statscol.py
|
Splitted stats collector classes from stats collection facility (#204)
|
2010-08-22 01:24:07 -03:00 |
|
telnet.py
|
Make telnet console and web service try a range of ports for binding, instead of just one. Closes #226
|
2010-09-05 06:48:08 -03:00 |
|
webservice.py
|
Make telnet console and web service try a range of ports for binding, instead of just one. Closes #226
|
2010-09-05 06:48:08 -03:00 |
754d0f53f9