| .. |
|
commands
|
Added ISpiderManager interface and a test to verify the default SpiderManager comforms to it
|
2010-09-03 14:29:27 -03:00 |
|
conf
|
Added SpiderContext extension. Closes #203
|
2010-09-08 15:52:35 -03:00 |
|
contrib
|
Force recalculating the encoding on HTTPCompression middleware until we are sure the responsetypes guessing is reliable. Refs #239, #240
|
2010-09-15 13:57:17 -03:00 |
|
contrib_exp
|
Make url/body attributes of Request/Response objects read-only - use replace() to change them. Deprecation warning left for backwards compatibilty.
|
2010-09-08 00:15:11 -03:00 |
|
core
|
Fixed bug in HTTP Compression middleware which was failing to properly discover the encoding when the encoding was declared inside the response body. Closes #239. Also changed responsetypes to return Response class (instead of HtmlResponse) when the response has a Content-Encoding header
|
2010-09-14 20:22:25 -03:00 |
|
http
|
Changed TextResponse.replace() behaviour by keeping previous encoding when not specified
|
2010-09-09 18:01:00 -03:00 |
|
selector
|
Improved encoding support by explicitly passing encoding to all str_to_unicode() and unicode_to_str() calls
|
2010-03-24 12:14:07 -03:00 |
|
templates
|
Changed format of scrapy.cfg file to contain a [settings] section and a 'default' key inside it, instead of the other way around
|
2010-09-02 21:22:17 -03:00 |
|
tests
|
Force recalculating the encoding on HTTPCompression middleware until we are sure the responsetypes guessing is reliable. Refs #239, #240
|
2010-09-15 13:57:17 -03:00 |
|
utils
|
Added 'inthread' decorator
|
2010-09-14 14:36:35 -03:00 |
|
xlib
|
monkeypatch urlparse if s3 netloc parsing fails (python issue7904). closes #223
|
2010-09-04 01:02:52 -03:00 |
|
__init__.py
|
Bumped version to 0.10.2
|
2010-09-15 14:04:33 -03:00 |
|
cmdline.py
|
Changed format of scrapy.cfg file to contain a [settings] section and a 'default' key inside it, instead of the other way around
|
2010-09-02 21:22:17 -03:00 |
|
command.py
|
Yet another scrapy.cmdline code refactoring by removing --settings and --version options, adding a version command and adding a UsageError exception for signaling usage errors. Updated all commands accordingly
|
2010-08-28 18:06:51 -03:00 |
|
crawler.py
|
Make execution queue poll interval configurable through a new QUEUE_POLL_INTERVAL setting
|
2010-09-05 02:23:08 -03:00 |
|
exceptions.py
|
Yet another scrapy.cmdline code refactoring by removing --settings and --version options, adding a version command and adding a UsageError exception for signaling usage errors. Updated all commands accordingly
|
2010-08-28 18:06:51 -03:00 |
|
extension.py
|
Made ExtensionManager a subclass of MiddlewareManager
|
2010-08-22 05:33:08 -03:00 |
|
interfaces.py
|
Added ISpiderManager interface and a test to verify the default SpiderManager comforms to it
|
2010-09-03 14:29:27 -03:00 |
|
item.py
|
Raise when trying to set an item field value using setattr api, and added tests.
|
2010-06-22 14:00:31 -03:00 |
|
link.py
|
updated some documentation references in source code
|
2009-08-19 22:41:26 -03:00 |
|
log.py
|
Print Scrapy on first log line
|
2010-08-27 00:53:26 -03:00 |
|
logformatter.py
|
Fixed encoding error with some item dropped messages. Closes #232
|
2010-09-08 15:34:13 -03:00 |
|
mail.py
|
removed (somewhat hacky) MAIL_DEBUG setting
|
2010-08-22 22:42:00 -03:00 |
|
middleware.py
|
Made ExtensionManager a subclass of MiddlewareManager
|
2010-08-22 05:33:08 -03:00 |
|
project.py
|
Refactoring of Crawler, Commands, Execution Queue and Spider Manager:
|
2010-08-25 19:24:36 -03:00 |
|
queue.py
|
Improve error logging when failing to create a spider in the execution queue
|
2010-09-07 10:07:47 -03:00 |
|
shell.py
|
Fixed bug with thread unsafety calls from Scrapy shell
|
2010-09-09 15:26:46 -03:00 |
|
signals.py
|
remove request_uploaded signal and move response_received and response_downloaded to downloader manager. closes #228
|
2010-09-06 23:23:14 -03:00 |
|
spider.py
|
Don't set allowed_domains attribute in BaseSpider constructor
|
2010-09-04 03:20:05 -03:00 |
|
spidermanager.py
|
Added ISpiderManager interface and a test to verify the default SpiderManager comforms to it
|
2010-09-03 14:29:27 -03:00 |
|
spiderqueue.py
|
SqliteSpiderQueue: failback to in-memory SQLite if database cannot be opened (typically due to missing write permissions)
|
2010-09-04 03:49:46 -03:00 |
|
stats.py
|
Splitted stats collector classes from stats collection facility (#204)
|
2010-08-22 01:24:07 -03:00 |
|
statscol.py
|
Splitted stats collector classes from stats collection facility (#204)
|
2010-08-22 01:24:07 -03:00 |
|
telnet.py
|
Make telnet console and web service try a range of ports for binding, instead of just one. Closes #226
|
2010-09-05 06:48:08 -03:00 |
|
webservice.py
|
Make telnet console and web service try a range of ports for binding, instead of just one. Closes #226
|
2010-09-05 06:48:08 -03:00 |
c01b8651ff