scrapy/scrapy/utils
Pablo Hoffman e741a807d2 Added new Feed exports extension with documentation and storage tests. Closes #197.
Also deprecated File export pipeline (to be removed in Scrapy 0.11).

Still need to add tests for FeedExport main extension code.
2010-08-17 14:27:48 -03:00
..
__init__.py mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
conf.py added support for defining EXTENSIONS setting using dicts, like middleware settings 2009-08-18 11:05:36 -03:00
datatypes.py added some unittests to make sure certain objects are using __slots__ and are also weak-referenceable 2009-08-18 20:40:04 -03:00
decorator.py pylinted decorators utils 2009-08-25 16:50:40 -03:00
defer.py Improve spider errors logging which were previously logged as confusing "Unhandled errors" - closes #196 2010-08-13 01:45:47 -03:00
display.py fixed bug in parse command with requests which don't have __dict__ attribute 2009-10-02 09:20:22 -03:00
encoding.py Some improvements to Response encoding support: 2010-03-25 15:47:10 -03:00
engine.py * Added Scrapy Web Service with documentation and tests. 2010-06-09 13:46:22 -03:00
ftp.py Added new Feed exports extension with documentation and storage tests. Closes #197. 2010-08-17 14:27:48 -03:00
http.py mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
httpobj.py remove Url class and use str instead for Request and Response urls. Also added urlparse_cached function for achieving the same caching functionality provided by old Url class 2009-08-17 21:16:55 -03:00
iterators.py improve csviter memeory usage by use of a generator instead of splitlines 2009-10-15 16:26:05 +01:00
jsonrpc.py a couple of fixes to make tests pass on win32 2010-06-14 09:11:35 -03:00
markup.py remove_tags: add keep argument 2010-04-24 19:08:01 +08:00
memory.py make sure get_vmvalue_from_procfs returns int 2009-08-18 00:59:32 -03:00
misc.py Rewritten walk_modules function to support eggs, and added tests 2010-07-30 17:05:55 -03:00
ossignal.py Some enhancements to Scrapy core: 2009-09-03 08:27:48 -03:00
py26.py Added scrapy.utils.py26.json to use python2.6 json module when available, otherwise failback to simplejson module or scrapy.xlib.simplejson. This way we can always assume json and avoid conditional code. 2010-04-12 10:44:07 -03:00
python.py moved copytree() function from utils.python to utils.py26 2010-04-11 03:47:48 -03:00
request.py bugfix in request_httprepr() function 2010-07-15 12:04:55 -03:00
response.py Fixed bug with float values in meta refresh 2010-07-01 11:46:06 -03:00
serialize.py utils.serialize: added support for encoding Deferreds, and to refer spiders by name using 'spider::name' 2010-06-11 18:16:09 -03:00
signal.py Added support for returning deferreds from (some) signal handlers. Closes #193 2010-08-14 21:10:37 -03:00
simpledb.py simpledb collector: moved to_sdb_value function to utils.simpledb, and added unittests 2009-08-30 12:37:30 -03:00
spider.py cleanup and refactor of parse & fetch commands 2010-04-01 17:16:38 -03:00
template.py add missing future import for python 2.5 2009-08-17 21:42:37 -03:00
test.py moved scrapy.xpath to scrapy.selector 2009-08-19 21:50:52 -03:00
trackref.py added iter_all() function to scrapy.util.trackref module and improved memory leaks documentation. also added a new FAQ antry about memory issues 2009-11-28 16:21:59 -02:00
url.py fixed bug in url_is_from_spider() when no allowed_domains class attribute is present 2010-08-16 12:25:51 -03:00