| .. |
|
__init__.py
|
mv scrapy/trunk to root as part of svn2hg migration
|
2009-05-06 15:55:17 -03:00 |
|
conf.py
|
Reversed scrapy.cfg lookup order so that the one in the current project has more precedence. Also added alternative system-wide location for windows.
|
2010-10-18 03:18:54 -02:00 |
|
console.py
|
Avoid IPython warning. thanks @bryant1410. closes #623
|
2014-06-03 15:11:20 -03:00 |
|
datatypes.py
|
Drop Python 2.6 support
|
2013-10-29 13:44:00 -02:00 |
|
decorator.py
|
Deprecate body_or_str helper function only used by xml iterators
|
2013-11-19 19:21:54 -02:00 |
|
defer.py
|
process_parallel was leaking the failures on its internal deferreds. closes #458
|
2013-11-09 02:12:52 -02:00 |
|
deprecate.py
|
Merge pull request #582 from kmike/inspect-workaround
|
2014-02-06 19:41:32 -08:00 |
|
display.py
|
Added "from __future__ import print_function" in all relevant places except xlib
|
2013-10-20 11:55:07 +06:00 |
|
engine.py
|
fix a reference to unexistent engine.slots. closes #593
|
2014-02-14 15:31:05 -02:00 |
|
ftp.py
|
Added new Feed exports extension with documentation and storage tests. Closes #197.
|
2010-08-17 14:27:48 -03:00 |
|
gz.py
|
fixed scrapy.utils.gz.gunzip() broken after changes from Python 2.7.3 to 2.7.4
|
2013-08-09 18:20:04 -03:00 |
|
http.py
|
added new downloader middleware: ChunkedTransferMiddleware
|
2011-08-09 03:03:25 -03:00 |
|
httpobj.py
|
remove Url class and use str instead for Request and Response urls. Also added urlparse_cached function for achieving the same caching functionality provided by old Url class
|
2009-08-17 21:16:55 -03:00 |
|
iterators.py
|
Do not call body_as_unicode on non text responses. closes #462
|
2013-11-19 20:13:34 -02:00 |
|
job.py
|
Initial support for a persistent scheduler, to support pausing and resuming
|
2011-08-02 11:57:55 -03:00 |
|
jsonrpc.py
|
Python 3 compatible syntax: print, except, raise, octal numbers; removed Python 2.2 boolean compatibility code in xlib/pydispatch/dispatcher.py
|
2013-10-20 01:59:35 +06:00 |
|
markup.py
|
Moved several functions from scrapy.utils.{http,markup,multipart,response,url} (and their tests) to a new library called 'w3lib'. Scrapy will now depend on w3lib.
|
2011-04-18 22:37:19 -03:00 |
|
misc.py
|
Use w3lib.html.replace_entities() (remove_entities() is deprecated)
|
2014-08-08 19:06:49 -03:00 |
|
multipart.py
|
Moved several functions from scrapy.utils.{http,markup,multipart,response,url} (and their tests) to a new library called 'w3lib'. Scrapy will now depend on w3lib.
|
2011-04-18 22:37:19 -03:00 |
|
ossignal.py
|
Some enhancements to Scrapy core:
|
2009-09-03 08:27:48 -03:00 |
|
project.py
|
get_project_settings now returns a Settings instance
|
2014-06-10 11:26:50 -03:00 |
|
python.py
|
get_func_args maximum recursion fix #728
|
2014-08-08 18:51:15 -03:00 |
|
reactor.py
|
more core refactoring including moving engine next request call logic to a separate class
|
2011-07-25 10:46:00 -03:00 |
|
reqser.py
|
Initial support for a persistent scheduler, to support pausing and resuming
|
2011-08-02 11:57:55 -03:00 |
|
request.py
|
Added "from __future__ import print_function" in all relevant places except xlib
|
2013-10-20 11:55:07 +06:00 |
|
response.py
|
Deprecate body_or_str helper function only used by xml iterators
|
2013-11-19 19:21:54 -02:00 |
|
serialize.py
|
Rename BaseSpider to Spider. See GH-495.
|
2013-12-30 19:46:41 +06:00 |
|
signal.py
|
format log lines lazily in case they are dropped by loglevels
|
2012-08-31 17:14:35 -03:00 |
|
sitemap.py
|
Fixed XXE flaw in sitemap reader
|
2014-04-01 23:54:04 +08:00 |
|
spider.py
|
Rename BaseSpider to Spider. See GH-495.
|
2013-12-30 19:46:41 +06:00 |
|
template.py
|
Dropped support for Python 2.5. See: http://blog.scrapy.org/scrapy-dropping-support-for-python-25
|
2012-03-01 08:18:12 -02:00 |
|
test.py
|
Update get_crawler method in utils/test.py with new Settings interface
|
2014-06-10 11:26:50 -03:00 |
|
testproc.py
|
Raise error when settings module is missing.
|
2012-10-03 12:31:19 -03:00 |
|
testsite.py
|
Test the parse command locally instead of against an external url
|
2015-01-20 13:56:35 -02:00 |
|
trackref.py
|
python3: scrapy.__version__, NoneType, urlparse_monkeypatches
|
2013-11-03 22:20:33 +06:00 |
|
txweb.py
|
allow remote ajax requests to the webservice
|
2013-03-19 12:00:49 +01:00 |
|
url.py
|
fix tests after changes introduced by scrapy/w3lib#21
|
2014-06-02 20:29:12 +00:00 |