| .. |
|
downloadermiddleware
|
Do not raise PartialDownloadError if Content-Length doesn't match the body size. This fixes the error reported in: https://groups.google.com/d/topic/scrapy-users/FQ25O3KPQuU/discussion
|
2011-10-25 13:04:58 -02:00 |
|
exporter
|
fixed PickeItemExporter bug, added unittest, and added pickle to suported feed exports formats
|
2011-10-25 02:36:51 -02:00 |
|
linkextractors
|
_extract_links requires extra parameter base_url in order to avoid
|
2011-09-14 10:58:09 -03:00 |
|
loader
|
improved errors of ItemLoader.load_item() so that it shows the field name and value of the output processor that failed
|
2011-06-23 12:39:51 -03:00 |
|
pipeline
|
fixed backwards compability with images/media pipeline, after crawler singleton removal in r2758
|
2011-08-08 17:16:32 -03:00 |
|
spidermiddleware
|
updated documentation about DEPTH_PRIORITY and DFO/BFO crawls
|
2011-09-23 13:22:25 -03:00 |
|
spiders
|
fixed crawlspider bug introduced after scheduler refactoring
|
2011-08-03 20:25:14 -03:00 |
|
webservice
|
Another step towards singleton removal: deprecated crawler singleton import (from scrapy.project import crawler) by a new class method that extensions can implement to receive the crawler
|
2011-08-08 11:42:44 -03:00 |
|
__init__.py
|
mv scrapy/trunk to root as part of svn2hg migration
|
2009-05-06 15:55:17 -03:00 |
|
closespider.py
|
Another step towards singleton removal: deprecated crawler singleton import (from scrapy.project import crawler) by a new class method that extensions can implement to receive the crawler
|
2011-08-08 11:42:44 -03:00 |
|
corestats.py
|
simplified CoreStats extension
|
2011-06-05 19:57:38 -03:00 |
|
debug.py
|
use log for dumping stack trace and engine status, in StackTraceDump extension
|
2011-06-13 14:28:03 -03:00 |
|
feedexport.py
|
feed exports: removed dependency on file.tell() method, so that stdout output works
|
2011-10-23 03:05:06 -02:00 |
|
httpcache.py
|
moved module scrapy.core.downloader.responsetypes to scrapy.responsetypes
|
2011-08-07 02:49:57 -03:00 |
|
logstats.py
|
LogStats extension: fixed KeyError bug caused with spiders that don't scrape any items
|
2011-06-17 16:50:02 -03:00 |
|
memdebug.py
|
simplified MemoryDebugger extension to use stats for dumping memory debugging info
|
2011-06-06 03:13:28 -03:00 |
|
memusage.py
|
fixed bug in MEMUSAGE_NOTIFY_MAIL setting
|
2011-11-08 11:51:26 -02:00 |
|
spiderstate.py
|
make SpiderState extension always available, regardless of whether there is a job dir, and make sure it always set spider.state attribute, for consistency between in-memory and on-disk runs
|
2011-09-23 12:56:44 -03:00 |
|
statsmailer.py
|
Splitted stats collector classes from stats collection facility (#204)
|
2010-08-22 01:24:07 -03:00 |
|
throttle.py
|
fix autothrottle extension for working with new downloader
|
2011-09-21 17:07:21 -03:00 |
6cc40dc062