| .. |
|
downloadermiddleware
|
Force recalculating the encoding on HTTPCompression middleware until we are sure the responsetypes guessing is reliable. Refs #239, #240
|
2010-09-15 13:57:17 -03:00 |
|
exporter
|
Added JSON item exporter with doc and unittests (closes #192), and also:
|
2010-08-07 15:52:59 -03:00 |
|
ibl
|
Added class constructors scrapy.contrib.ibl FieldDescriptor and ItemDescriptor
|
2010-09-07 14:26:50 -03:00 |
|
linkextractors
|
LinkExtractor: split _process_links from _extract_links
|
2010-04-27 14:58:11 +08:00 |
|
loader
|
Fixed Item Loader bug that was preventing values that evaluate to False from being loaded. Patch contributed by Anibal Pacheco. Closes #174
|
2010-08-22 22:07:44 -03:00 |
|
pipeline
|
Removed settings.disabled hack used in some tests. Closes #143
|
2010-09-06 11:04:27 -03:00 |
|
schedulermiddleware
|
moved scrapy.core.exceptions to scrapy.exceptions, keeping backwards compatibility
|
2010-08-10 17:36:48 -03:00 |
|
spidermiddleware
|
Removed UrlFilterMiddleware from scrapy.contrib - see this snippet for an alternative: http://snippets.scrapy.org/snippets/12/
|
2010-09-07 17:51:02 -03:00 |
|
spiders
|
moved scrapy.core.exceptions to scrapy.exceptions, keeping backwards compatibility
|
2010-08-10 17:36:48 -03:00 |
|
webservice
|
Replaced old manager references with crawler
|
2010-08-25 19:31:04 -03:00 |
|
__init__.py
|
mv scrapy/trunk to root as part of svn2hg migration
|
2009-05-06 15:55:17 -03:00 |
|
closespider.py
|
Moved scrapymanager singleton to scrapy.project module. Refs #189
|
2010-08-22 02:10:53 -03:00 |
|
corestats.py
|
Splitted stats collector classes from stats collection facility (#204)
|
2010-08-22 01:24:07 -03:00 |
|
debug.py
|
added Debugger extension, removed StackTraceDump from extensions available by default
|
2009-09-08 22:32:17 -03:00 |
|
dupefilter.py
|
Changed (unstable) scheduler middleware API to receive spider (instead of domain) in enqueue_request method
|
2009-09-13 20:51:43 -03:00 |
|
feedexport.py
|
Added IFeedStorage interface and test all Feed Storages conform to it. Also added test for StdoutFeedStorage
|
2010-09-06 10:22:28 -03:00 |
|
memdebug.py
|
moved scrapy.core.signals to scrapy.signals, keeping backwards compatibility
|
2010-08-10 17:40:53 -03:00 |
|
memusage.py
|
Fixed exception thrown when in FreeBSD when /proc exists but it's not mounted. Closes #235
|
2010-09-10 15:17:36 -03:00 |
|
resolver.py
|
moved scrapy.core.signals to scrapy.signals, keeping backwards compatibility
|
2010-08-10 17:40:53 -03:00 |
|
spiderclosedelay.py
|
Moved scrapymanager singleton to scrapy.project module. Refs #189
|
2010-08-22 02:10:53 -03:00 |
|
spidercontext.py
|
Added SpiderContext extension. Closes #203
|
2010-09-08 15:52:35 -03:00 |
|
spiderqueue.py
|
Make execution queue poll interval configurable through a new QUEUE_POLL_INTERVAL setting
|
2010-09-05 02:23:08 -03:00 |
|
statscol.py
|
Splitted stats collector classes from stats collection facility (#204)
|
2010-08-22 01:24:07 -03:00 |
|
statsmailer.py
|
Splitted stats collector classes from stats collection facility (#204)
|
2010-08-22 01:24:07 -03:00 |
5fe9a49e51