| .. |
|
__init__.py
|
mv scrapy/trunk to root as part of svn2hg migration
|
2009-05-06 15:55:17 -03:00 |
|
conf.py
|
Reversed scrapy.cfg lookup order so that the one in the current project has more precedence. Also added alternative system-wide location for windows.
|
2010-10-18 03:18:54 -02:00 |
|
console.py
|
Scrapy shell: moved python console starting code to scrapy.utils.console and get rid of noisy console banners
|
2010-08-20 01:33:02 -03:00 |
|
datatypes.py
|
added some unittests to make sure certain objects are using __slots__ and are also weak-referenceable
|
2009-08-18 20:40:04 -03:00 |
|
decorator.py
|
Added 'inthread' decorator
|
2010-09-14 14:36:35 -03:00 |
|
defer.py
|
Improve spider errors logging which were previously logged as confusing "Unhandled errors" - closes #196
|
2010-08-13 01:45:47 -03:00 |
|
deprecate.py
|
Ported code to use new unified access to spider settings, keeping backwards compatibility for old spider attributes. Refs #245
|
2010-09-22 16:09:13 -03:00 |
|
display.py
|
"parse" command refactoring. This fixes #173 and renders #106 invalid.
|
2010-08-22 05:04:17 -03:00 |
|
encoding.py
|
Some improvements to Response encoding support:
|
2010-03-25 15:47:10 -03:00 |
|
engine.py
|
Restored wrongly removed import
|
2010-09-09 17:42:54 -03:00 |
|
ftp.py
|
Added new Feed exports extension with documentation and storage tests. Closes #197.
|
2010-08-17 14:27:48 -03:00 |
|
http.py
|
Added a weak key factory based cache
|
2010-09-06 00:50:56 -03:00 |
|
httpobj.py
|
remove Url class and use str instead for Request and Response urls. Also added urlparse_cached function for achieving the same caching functionality provided by old Url class
|
2009-08-17 21:16:55 -03:00 |
|
iterators.py
|
fixed csviter bug when called with a Response, not TextResponse
|
2010-12-14 18:21:07 -02:00 |
|
jsonrpc.py
|
Check that arguments and keyword arguments are not passed simultaneously in jsonrpc_client_call()
|
2010-08-27 13:45:52 -03:00 |
|
markup.py
|
remove_tags: add keep argument
|
2010-04-24 19:08:01 +08:00 |
|
memory.py
|
fixed compatibility with python 2.5 and removed unused code
|
2011-01-05 12:03:54 -02:00 |
|
misc.py
|
Rewritten walk_modules function to support eggs, and added tests
|
2010-07-30 17:05:55 -03:00 |
|
multipart.py
|
Added new 'deploy' command. Closes #261
|
2010-10-18 22:38:46 -02:00 |
|
ossignal.py
|
Some enhancements to Scrapy core:
|
2009-09-03 08:27:48 -03:00 |
|
project.py
|
A couple of changes to fix #303:
|
2011-01-05 15:59:43 -02:00 |
|
py26.py
|
Removed scrapy.xlib.simplejson module. Scrapy now requires simplejson if running on Python 2.5. Closes #289
|
2010-11-16 03:11:12 -02:00 |
|
python.py
|
Replace unknown characters in sgml link extractor, to deal more gracefully with encoding errors in the page. Closes #309
|
2011-02-10 17:12:03 -02:00 |
|
reactor.py
|
Bind the web server and telnet server to a configurable interface (WEBSERVICE_HOST). The default is to bind to all interfaces. Also add documentation for WEBSERVICE_HOST and TELNETCONSOLE_HOST.
|
2010-11-01 00:59:04 -02:00 |
|
request.py
|
Added a weak key factory based cache
|
2010-09-06 00:50:56 -03:00 |
|
response.py
|
make trial run doctests
|
2010-10-26 20:50:41 -02:00 |
|
serialize.py
|
Replaced old manager references with crawler
|
2010-08-25 19:31:04 -03:00 |
|
signal.py
|
Added support for returning deferreds from (some) signal handlers. Closes #193
|
2010-08-14 21:10:37 -03:00 |
|
simpledb.py
|
simpledb collector: moved to_sdb_value function to utils.simpledb, and added unittests
|
2009-08-30 12:37:30 -03:00 |
|
spider.py
|
Added ISpiderManager interface and a test to verify the default SpiderManager comforms to it
|
2010-09-03 14:29:27 -03:00 |
|
sqlite.py
|
Silenced confusing sqlite3.ProgrammingError exception. For more info see: http://twistedmatrix.com/trac/ticket/4040
|
2011-03-09 12:39:24 -02:00 |
|
template.py
|
add missing future import for python 2.5
|
2009-08-17 21:42:37 -03:00 |
|
test.py
|
* Added lxml backend for XPath selectors. Closes #147
|
2010-10-25 14:47:10 -02:00 |
|
testproc.py
|
utils.testproc: make spawned process use the original CWD, instead of the temporary one created by twisted trial
|
2010-11-29 09:56:14 -02:00 |
|
testsite.py
|
* Added tests for shell/fetch/version commands (closes #255)
|
2010-11-28 18:14:45 -02:00 |
|
trackref.py
|
added trackref stats to memory debugger report. closes #272
|
2010-10-27 21:18:58 -02:00 |
|
txweb.py
|
Added new Scrapy service with support for:
|
2010-09-03 15:54:42 -03:00 |
|
url.py
|
use safe_url_string in canonicalize_url, to avoid to convert safe characters into percent representation. Lead to errors with many sites (RFC3986). closes #297
|
2010-12-08 16:28:38 -02:00 |