| .. |
|
command
|
added runspider command to run spiders directly, without having to create a project
|
2009-09-14 22:05:14 -03:00 |
|
conf
|
renamed REQUESTS_PER_SPIDER setting to CONCURRENT_REQUESTS_PER_SPIDER
|
2009-11-13 14:38:22 -02:00 |
|
contrib
|
StatsCollector: ported methods to receive spider instances (closes #113), removed list_domains() method, added iter_spider_stats() method
|
2009-11-14 20:28:59 -02:00 |
|
contrib_exp
|
StatsCollector: ported methods to receive spider instances (closes #113), removed list_domains() method, added iter_spider_stats() method
|
2009-11-14 20:28:59 -02:00 |
|
core
|
StatsCollector: ported methods to receive spider instances (closes #113), removed list_domains() method, added iter_spider_stats() method
|
2009-11-14 20:28:59 -02:00 |
|
http
|
changed odd logic in if statement
|
2009-10-29 13:35:32 -02:00 |
|
management
|
adapted web console to use unix timestamps for uptime instead of datetime
|
2009-09-14 20:35:07 -03:00 |
|
selector
|
fixed bug caused when instantiating selectors with responses containing empty bodies
|
2009-10-21 16:37:30 -02:00 |
|
spider
|
replaced remaining uses of log.msg() 'domain' argument to use 'spider' instead
|
2009-11-06 16:11:37 -02:00 |
|
stats
|
StatsCollector: ported methods to receive spider instances (closes #113), removed list_domains() method, added iter_spider_stats() method
|
2009-11-14 20:28:59 -02:00 |
|
templates
|
remove unused line from project settings template
|
2009-09-23 14:53:40 -03:00 |
|
tests
|
StatsCollector: ported methods to receive spider instances (closes #113), removed list_domains() method, added iter_spider_stats() method
|
2009-11-14 20:28:59 -02:00 |
|
utils
|
fix get_meta_refresh bug raised for TextResponses without encoding
|
2009-10-21 13:57:06 -02:00 |
|
xlib
|
renamed file missing from previous commit
|
2009-11-19 11:23:36 -02:00 |
|
__init__.py
|
Automated merge with http://hg.scrapy.org/scrapy-stable/
|
2009-11-19 10:44:02 -02:00 |
|
crawler.py
|
added missing colon
|
2009-09-12 19:33:16 -03:00 |
|
extension.py
|
added support for defining EXTENSIONS setting using dicts, like middleware settings
|
2009-08-18 11:05:36 -03:00 |
|
item.py
|
removed deprecated ScrapedItem (previously kept for backwards compatibility)
|
2009-11-06 16:39:15 -02:00 |
|
link.py
|
updated some documentation references in source code
|
2009-08-19 22:41:26 -03:00 |
|
log.py
|
deprecated 'domain' argument in log.msg()
|
2009-11-06 16:02:12 -02:00 |
|
mail.py
|
updated some documentation references in source code
|
2009-08-19 22:41:26 -03:00 |
|
shell.py
|
fixed exception when running scrapy shell on a non-textual response (fixes #116)
|
2009-11-13 17:21:59 -02:00 |
8c14abadbb