RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
scrapy/scrapy/utils
History
Pablo Hoffman 048044c1f8 A couple of changes to fix #303: 
* improved detection of inside-project environments
* make list command faster (by only instantiating the spider manger)
* print a warning when extensions (middlewares, etc) are disabled with a message on NotConfigured exception
* assert that scrapy configuration hasn't been loaded in scrapyd.runner
* simplified IgnoreRequest exception, to avoid loading settings when importing scrapy.exceptions
* added test to make sure certain modules don't cause scrapy.conf module to be
  loaded, to ensure the scrapyd runner bootstraping performs properly
 		2011-01-05 15:59:43 -02:00
..
__init__.py mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
conf.py Reversed scrapy.cfg lookup order so that the one in the current project has more precedence. Also added alternative system-wide location for windows. 2010-10-18 03:18:54 -02:00
console.py Scrapy shell: moved python console starting code to scrapy.utils.console and get rid of noisy console banners 2010-08-20 01:33:02 -03:00
datatypes.py added some unittests to make sure certain objects are using __slots__ and are also weak-referenceable 2009-08-18 20:40:04 -03:00
decorator.py Added 'inthread' decorator 2010-09-14 14:36:35 -03:00
defer.py Improve spider errors logging which were previously logged as confusing "Unhandled errors" - closes #196 2010-08-13 01:45:47 -03:00
deprecate.py Ported code to use new unified access to spider settings, keeping backwards compatibility for old spider attributes. Refs #245 2010-09-22 16:09:13 -03:00
display.py "parse" command refactoring. This fixes #173 and renders #106 invalid. 2010-08-22 05:04:17 -03:00
encoding.py Some improvements to Response encoding support: 2010-03-25 15:47:10 -03:00
engine.py Restored wrongly removed import 2010-09-09 17:42:54 -03:00
ftp.py Added new Feed exports extension with documentation and storage tests. Closes #197. 2010-08-17 14:27:48 -03:00
http.py Added a weak key factory based cache 2010-09-06 00:50:56 -03:00
httpobj.py remove Url class and use str instead for Request and Response urls. Also added urlparse_cached function for achieving the same caching functionality provided by old Url class 2009-08-17 21:16:55 -03:00
iterators.py fixed csviter bug when called with a Response, not TextResponse 2010-12-14 18:21:07 -02:00
jsonrpc.py Check that arguments and keyword arguments are not passed simultaneously in jsonrpc_client_call() 2010-08-27 13:45:52 -03:00
markup.py remove_tags: add keep argument 2010-04-24 19:08:01 +08:00
memory.py fixed compatibility with python 2.5 and removed unused code 2011-01-05 12:03:54 -02:00
misc.py Rewritten walk_modules function to support eggs, and added tests 2010-07-30 17:05:55 -03:00
multipart.py Added new 'deploy' command. Closes #261 2010-10-18 22:38:46 -02:00
ossignal.py Some enhancements to Scrapy core: 2009-09-03 08:27:48 -03:00
project.py A couple of changes to fix #303: 2011-01-05 15:59:43 -02:00
py26.py Removed scrapy.xlib.simplejson module. Scrapy now requires simplejson if running on Python 2.5. Closes #289 2010-11-16 03:11:12 -02:00
python.py * Added support for project data storage (closes #276) 2010-10-31 03:25:37 -02:00
reactor.py Bind the web server and telnet server to a configurable interface (WEBSERVICE_HOST). The default is to bind to all interfaces. Also add documentation for WEBSERVICE_HOST and TELNETCONSOLE_HOST. 2010-11-01 00:59:04 -02:00
request.py Added a weak key factory based cache 2010-09-06 00:50:56 -03:00
response.py make trial run doctests 2010-10-26 20:50:41 -02:00
serialize.py Replaced old manager references with crawler 2010-08-25 19:31:04 -03:00
signal.py Added support for returning deferreds from (some) signal handlers. Closes #193 2010-08-14 21:10:37 -03:00
simpledb.py simpledb collector: moved to_sdb_value function to utils.simpledb, and added unittests 2009-08-30 12:37:30 -03:00
spider.py Added ISpiderManager interface and a test to verify the default SpiderManager comforms to it 2010-09-03 14:29:27 -03:00
sqlite.py Fixed bugs with SQLiteDict and added tests 2010-09-08 14:32:28 -03:00
template.py add missing future import for python 2.5 2009-08-17 21:42:37 -03:00
test.py * Added lxml backend for XPath selectors. Closes #147 2010-10-25 14:47:10 -02:00
testproc.py utils.testproc: make spawned process use the original CWD, instead of the temporary one created by twisted trial 2010-11-29 09:56:14 -02:00
testsite.py * Added tests for shell/fetch/version commands (closes #255) 2010-11-28 18:14:45 -02:00
trackref.py added trackref stats to memory debugger report. closes #272 2010-10-27 21:18:58 -02:00
txweb.py Added new Scrapy service with support for: 2010-09-03 15:54:42 -03:00
url.py use safe_url_string in canonicalize_url, to avoid to convert safe characters into percent representation. Lead to errors with many sites (RFC3986). closes #297 2010-12-08 16:28:38 -02:00