| .. |
|
__init__.py
|
mv scrapy/trunk to root as part of svn2hg migration
|
2009-05-06 15:55:17 -03:00 |
|
conf.py
|
Reversed scrapy.cfg lookup order so that the one in the current project has more precedence. Also added alternative system-wide location for windows.
|
2010-10-18 03:18:54 -02:00 |
|
console.py
|
Scrapy shell: moved python console starting code to scrapy.utils.console and get rid of noisy console banners
|
2010-08-20 01:33:02 -03:00 |
|
datatypes.py
|
fix error messages due to fetching pages during shutdown process
|
2011-05-20 14:35:37 +01:00 |
|
decorator.py
|
Added 'inthread' decorator
|
2010-09-14 14:36:35 -03:00 |
|
defer.py
|
Improve spider errors logging which were previously logged as confusing "Unhandled errors" - closes #196
|
2010-08-13 01:45:47 -03:00 |
|
deprecate.py
|
Ported code to use new unified access to spider settings, keeping backwards compatibility for old spider attributes. Refs #245
|
2010-09-22 16:09:13 -03:00 |
|
display.py
|
"parse" command refactoring. This fixes #173 and renders #106 invalid.
|
2010-08-22 05:04:17 -03:00 |
|
encoding.py
|
Some improvements to Response encoding support:
|
2010-03-25 15:47:10 -03:00 |
|
engine.py
|
Restored wrongly removed import
|
2010-09-09 17:42:54 -03:00 |
|
ftp.py
|
Added new Feed exports extension with documentation and storage tests. Closes #197.
|
2010-08-17 14:27:48 -03:00 |
|
http.py
|
Moved several functions from scrapy.utils.{http,markup,multipart,response,url} (and their tests) to a new library called 'w3lib'. Scrapy will now depend on w3lib.
|
2011-04-18 22:37:19 -03:00 |
|
httpobj.py
|
remove Url class and use str instead for Request and Response urls. Also added urlparse_cached function for achieving the same caching functionality provided by old Url class
|
2009-08-17 21:16:55 -03:00 |
|
iterators.py
|
fixed csviter bug when called with a Response, not TextResponse
|
2010-12-14 18:21:07 -02:00 |
|
jsonrpc.py
|
Check that arguments and keyword arguments are not passed simultaneously in jsonrpc_client_call()
|
2010-08-27 13:45:52 -03:00 |
|
markup.py
|
Moved several functions from scrapy.utils.{http,markup,multipart,response,url} (and their tests) to a new library called 'w3lib'. Scrapy will now depend on w3lib.
|
2011-04-18 22:37:19 -03:00 |
|
memory.py
|
fixed compatibility with python 2.5 and removed unused code
|
2011-01-05 12:03:54 -02:00 |
|
misc.py
|
ported internal scrapy.utils imports to w3lib
|
2011-04-19 01:33:52 -03:00 |
|
multipart.py
|
Moved several functions from scrapy.utils.{http,markup,multipart,response,url} (and their tests) to a new library called 'w3lib'. Scrapy will now depend on w3lib.
|
2011-04-18 22:37:19 -03:00 |
|
ossignal.py
|
Some enhancements to Scrapy core:
|
2009-09-03 08:27:48 -03:00 |
|
project.py
|
A couple of changes to fix #303:
|
2011-01-05 15:59:43 -02:00 |
|
py26.py
|
Removed scrapy.xlib.simplejson module. Scrapy now requires simplejson if running on Python 2.5. Closes #289
|
2010-11-16 03:11:12 -02:00 |
|
python.py
|
Downloader: Added support for dynamically adjusting download delay and maximum concurrent requests
|
2011-05-14 21:35:46 -03:00 |
|
reactor.py
|
Bind the web server and telnet server to a configurable interface (WEBSERVICE_HOST). The default is to bind to all interfaces. Also add documentation for WEBSERVICE_HOST and TELNETCONSOLE_HOST.
|
2010-11-01 00:59:04 -02:00 |
|
request.py
|
ported internal scrapy.utils imports to w3lib
|
2011-04-19 01:33:52 -03:00 |
|
response.py
|
Moved several functions from scrapy.utils.{http,markup,multipart,response,url} (and their tests) to a new library called 'w3lib'. Scrapy will now depend on w3lib.
|
2011-04-18 22:37:19 -03:00 |
|
serialize.py
|
Replaced old manager references with crawler
|
2010-08-25 19:31:04 -03:00 |
|
signal.py
|
Added support for returning deferreds from (some) signal handlers. Closes #193
|
2010-08-14 21:10:37 -03:00 |
|
simpledb.py
|
simpledb collector: moved to_sdb_value function to utils.simpledb, and added unittests
|
2009-08-30 12:37:30 -03:00 |
|
spider.py
|
Added ISpiderManager interface and a test to verify the default SpiderManager comforms to it
|
2010-09-03 14:29:27 -03:00 |
|
sqlite.py
|
Silenced confusing sqlite3.ProgrammingError exception. For more info see: http://twistedmatrix.com/trac/ticket/4040
|
2011-03-09 12:39:24 -02:00 |
|
template.py
|
add missing future import for python 2.5
|
2009-08-17 21:42:37 -03:00 |
|
test.py
|
* Added lxml backend for XPath selectors. Closes #147
|
2010-10-25 14:47:10 -02:00 |
|
testproc.py
|
utils.testproc: make spawned process use the original CWD, instead of the temporary one created by twisted trial
|
2010-11-29 09:56:14 -02:00 |
|
testsite.py
|
* Added tests for shell/fetch/version commands (closes #255)
|
2010-11-28 18:14:45 -02:00 |
|
trackref.py
|
added trackref stats to memory debugger report. closes #272
|
2010-10-27 21:18:58 -02:00 |
|
txweb.py
|
Added new Scrapy service with support for:
|
2010-09-03 15:54:42 -03:00 |
|
url.py
|
Some Link extractor improvements:
|
2011-05-18 12:32:34 -03:00 |
88dbe2ae87