scrapy/scrapy/utils
Pablo Hoffman dff763c683 Removed Scrapy engine singleton from scrapy.core.engine.scrapyengine. Now
engine can only be accesed through Scrapy Manager 'engine' attribute - ie.
scrapy.core.manager.engine.
2010-05-26 10:29:32 -03:00
..
__init__.py mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
conf.py added support for defining EXTENSIONS setting using dicts, like middleware settings 2009-08-18 11:05:36 -03:00
datatypes.py added some unittests to make sure certain objects are using __slots__ and are also weak-referenceable 2009-08-18 20:40:04 -03:00
decorator.py pylinted decorators utils 2009-08-25 16:50:40 -03:00
defer.py Added hack to speed up processing of IgnoreRequest errors (#125) 2009-11-25 22:28:59 -02:00
display.py fixed bug in parse command with requests which don't have __dict__ attribute 2009-10-02 09:20:22 -03:00
encoding.py Some improvements to Response encoding support: 2010-03-25 15:47:10 -03:00
engine.py Removed Scrapy engine singleton from scrapy.core.engine.scrapyengine. Now 2010-05-26 10:29:32 -03:00
http.py mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
httpobj.py remove Url class and use str instead for Request and Response urls. Also added urlparse_cached function for achieving the same caching functionality provided by old Url class 2009-08-17 21:16:55 -03:00
iterators.py improve csviter memeory usage by use of a generator instead of splitlines 2009-10-15 16:26:05 +01:00
markup.py remove_tags: add keep argument 2010-04-24 19:08:01 +08:00
memory.py make sure get_vmvalue_from_procfs returns int 2009-08-18 00:59:32 -03:00
misc.py arg_to_iter: return [arg] if arg is a dict 2010-04-24 21:20:23 +08:00
mysql.py more simplifications to scrapy engine: removed addtasks method 2009-08-31 12:04:01 -03:00
ossignal.py Some enhancements to Scrapy core: 2009-09-03 08:27:48 -03:00
py26.py Added scrapy.utils.py26.json to use python2.6 json module when available, otherwise failback to simplejson module or scrapy.xlib.simplejson. This way we can always assume json and avoid conditional code. 2010-04-12 10:44:07 -03:00
python.py moved copytree() function from utils.python to utils.py26 2010-04-11 03:47:48 -03:00
request.py switched request_fingerprint to use WeakKeyDictionary for caching (instead of Request.cache) 2009-08-24 08:45:23 -03:00
response.py fix handling of relative base urls in get_base_url util 2010-03-25 15:50:34 -03:00
signal.py send_catch_log: pass through results from sendRobust 2009-08-22 16:38:25 -03:00
simpledb.py simpledb collector: moved to_sdb_value function to utils.simpledb, and added unittests 2009-08-30 12:37:30 -03:00
spider.py cleanup and refactor of parse & fetch commands 2010-04-01 17:16:38 -03:00
template.py add missing future import for python 2.5 2009-08-17 21:42:37 -03:00
test.py moved scrapy.xpath to scrapy.selector 2009-08-19 21:50:52 -03:00
trackref.py added iter_all() function to scrapy.util.trackref module and improved memory leaks documentation. also added a new FAQ antry about memory issues 2009-11-28 16:21:59 -02:00
url.py avoid different behaviour in urljoin between pytho2.5 and python2.6+. see http://bugs.python.org/issue1432 2010-05-14 20:09:07 +01:00