| .. |
|
command
|
added BaseItem as base item class, and moved extra functionality of ScrapedItem to RobustScrapedItem
|
2009-07-21 16:11:21 -03:00 |
|
conf
|
finished cleaning up closedomain documentation, and updated default settings
|
2009-07-27 15:42:35 -03:00 |
|
contrib
|
CloseDomain extension: fixed bug on domain close when not using CLOSEDOMAIN_TIMEOUT
|
2009-07-28 12:23:13 -03:00 |
|
contrib_exp
|
moved newitem from scrapy.contrib_exp to scrapy.newitem
|
2009-07-22 15:13:36 -03:00 |
|
core
|
Some changes to logging of scraped items:
|
2009-07-23 11:49:48 -03:00 |
|
extension
|
mv scrapy/trunk to root as part of svn2hg migration
|
2009-05-06 15:55:17 -03:00 |
|
fetcher
|
fixed bug in fetcher caused by recent spider manager changes (thanks andres)
|
2009-07-13 00:04:00 -03:00 |
|
http
|
moved httprepr() method (from Request and Response objects) to scrapy.utils functions
|
2009-07-25 18:56:12 -03:00 |
|
item
|
added BaseItem as base item class, and moved extra functionality of ScrapedItem to RobustScrapedItem
|
2009-07-21 16:11:21 -03:00 |
|
link
|
removed code from scrapy.link to avoid cyclic imports from scrapy.contrib.linkextractors.sgml
|
2009-05-18 19:27:51 -03:00 |
|
log
|
remove xlib hack that appends scrapy/xlib to sys.path
|
2009-07-09 14:37:59 -03:00 |
|
mail
|
mv scrapy/trunk to root as part of svn2hg migration
|
2009-05-06 15:55:17 -03:00 |
|
management
|
remove xlib hack that appends scrapy/xlib to sys.path
|
2009-07-09 14:37:59 -03:00 |
|
newitem
|
another minor fix to exporters
|
2009-07-29 08:23:38 -03:00 |
|
patches
|
mv scrapy/trunk to root as part of svn2hg migration
|
2009-05-06 15:55:17 -03:00 |
|
spider
|
simplified implementation of spider manager by removing knowledge of enabled spiders
|
2009-07-10 16:41:02 -03:00 |
|
stats
|
fixed stats collector bug which wasn't throwing the stats_domain_closing signal (on subclasses) before the persisting stage
|
2009-07-23 13:03:25 -03:00 |
|
templates/project
|
adapted project template to use the new Link Extractors location
|
2009-07-28 12:27:25 -03:00 |
|
tests
|
moved httprepr() method (from Request and Response objects) to scrapy.utils functions
|
2009-07-25 18:56:12 -03:00 |
|
utils
|
moved httprepr() method (from Request and Response objects) to scrapy.utils functions
|
2009-07-25 18:56:12 -03:00 |
|
xlib
|
remove xlib hack that appends scrapy/xlib to sys.path
|
2009-07-09 14:37:59 -03:00 |
|
xpath
|
some improvement to Libxml2Document cleanup: avoid noisy errors, and make sure both cleaning up functions are called
|
2009-07-14 12:41:25 -03:00 |
|
__init__.py
|
remove xlib hack that appends scrapy/xlib to sys.path
|
2009-07-09 14:37:59 -03:00 |
d57c0100db