| .. |
|
commands
|
Added ISpiderManager interface and a test to verify the default SpiderManager comforms to it
|
2010-09-03 14:29:27 -03:00 |
|
conf
|
Renamed Request Handlers to Download Handlers
|
2010-09-05 19:35:53 -03:00 |
|
contrib
|
Removed settings.disabled hack used in some tests. Closes #143
|
2010-09-06 11:04:27 -03:00 |
|
contrib_exp
|
removed old unsupported SpiderProfiler extension
|
2010-08-10 17:23:22 -03:00 |
|
core
|
Simplified SpiderMiddlewareManager by making it inherit from MiddlewareManager
|
2010-09-06 10:40:33 -03:00 |
|
http
|
allow passing custom headers in FormRequest.from_response()
|
2010-07-08 14:02:28 -03:00 |
|
selector
|
Improved encoding support by explicitly passing encoding to all str_to_unicode() and unicode_to_str() calls
|
2010-03-24 12:14:07 -03:00 |
|
templates
|
Changed format of scrapy.cfg file to contain a [settings] section and a 'default' key inside it, instead of the other way around
|
2010-09-02 21:22:17 -03:00 |
|
tests
|
Removed settings.disabled hack used in some tests. Closes #143
|
2010-09-06 11:04:27 -03:00 |
|
utils
|
Added SpiderQueue tests. SQS spider queue not tested because operations take too long to complete and it's not easy to know when they have. Closes #227
|
2010-09-06 09:47:45 -03:00 |
|
xlib
|
monkeypatch urlparse if s3 netloc parsing fails (python issue7904). closes #223
|
2010-09-04 01:02:52 -03:00 |
|
__init__.py
|
monkeypatch urlparse if s3 netloc parsing fails (python issue7904). closes #223
|
2010-09-04 01:02:52 -03:00 |
|
cmdline.py
|
Changed format of scrapy.cfg file to contain a [settings] section and a 'default' key inside it, instead of the other way around
|
2010-09-02 21:22:17 -03:00 |
|
command.py
|
Yet another scrapy.cmdline code refactoring by removing --settings and --version options, adding a version command and adding a UsageError exception for signaling usage errors. Updated all commands accordingly
|
2010-08-28 18:06:51 -03:00 |
|
crawler.py
|
Make execution queue poll interval configurable through a new QUEUE_POLL_INTERVAL setting
|
2010-09-05 02:23:08 -03:00 |
|
exceptions.py
|
Yet another scrapy.cmdline code refactoring by removing --settings and --version options, adding a version command and adding a UsageError exception for signaling usage errors. Updated all commands accordingly
|
2010-08-28 18:06:51 -03:00 |
|
extension.py
|
Made ExtensionManager a subclass of MiddlewareManager
|
2010-08-22 05:33:08 -03:00 |
|
interfaces.py
|
Added ISpiderManager interface and a test to verify the default SpiderManager comforms to it
|
2010-09-03 14:29:27 -03:00 |
|
item.py
|
Raise when trying to set an item field value using setattr api, and added tests.
|
2010-06-22 14:00:31 -03:00 |
|
link.py
|
updated some documentation references in source code
|
2009-08-19 22:41:26 -03:00 |
|
log.py
|
Print Scrapy on first log line
|
2010-08-27 00:53:26 -03:00 |
|
logformatter.py
|
Added pluggable log formatter
|
2010-08-26 23:19:35 -03:00 |
|
mail.py
|
removed (somewhat hacky) MAIL_DEBUG setting
|
2010-08-22 22:42:00 -03:00 |
|
middleware.py
|
Made ExtensionManager a subclass of MiddlewareManager
|
2010-08-22 05:33:08 -03:00 |
|
project.py
|
Refactoring of Crawler, Commands, Execution Queue and Spider Manager:
|
2010-08-25 19:24:36 -03:00 |
|
queue.py
|
Make execution queue poll interval configurable through a new QUEUE_POLL_INTERVAL setting
|
2010-09-05 02:23:08 -03:00 |
|
shell.py
|
Added ISpiderManager interface and a test to verify the default SpiderManager comforms to it
|
2010-09-03 14:29:27 -03:00 |
|
signals.py
|
Splitted stats collector classes from stats collection facility (#204)
|
2010-08-22 01:24:07 -03:00 |
|
spider.py
|
Don't set allowed_domains attribute in BaseSpider constructor
|
2010-09-04 03:20:05 -03:00 |
|
spidermanager.py
|
Added ISpiderManager interface and a test to verify the default SpiderManager comforms to it
|
2010-09-03 14:29:27 -03:00 |
|
spiderqueue.py
|
SqliteSpiderQueue: failback to in-memory SQLite if database cannot be opened (typically due to missing write permissions)
|
2010-09-04 03:49:46 -03:00 |
|
stats.py
|
Splitted stats collector classes from stats collection facility (#204)
|
2010-08-22 01:24:07 -03:00 |
|
statscol.py
|
Splitted stats collector classes from stats collection facility (#204)
|
2010-08-22 01:24:07 -03:00 |
|
telnet.py
|
Make telnet console and web service try a range of ports for binding, instead of just one. Closes #226
|
2010-09-05 06:48:08 -03:00 |
|
webservice.py
|
Make telnet console and web service try a range of ports for binding, instead of just one. Closes #226
|
2010-09-05 06:48:08 -03:00 |
3a72e5c051