| .. |
|
keys
|
Adds HTTPS support to the MockServer.
|
2013-10-02 17:35:28 -03:00 |
|
mocks
|
Python 3 compatible syntax: print, except, raise, octal numbers; removed Python 2.2 boolean compatibility code in xlib/pydispatch/dispatcher.py
|
2013-10-20 01:59:35 +06:00 |
|
sample_data
|
httpcompression middleware improvement
|
2012-10-10 20:20:13 +03:00 |
|
test_cmdline
|
Fix start_requests lazyness and early hangs
|
2013-10-09 22:58:10 -02:00 |
|
test_djangoitem
|
Django 1.6 form validation errors now include ValidationError exception instances instead of just strings
|
2013-11-07 02:32:10 -02:00 |
|
test_spidermanager
|
from_crawler added to spiders
|
2013-06-27 15:06:18 -03:00 |
|
test_utils_misc
|
remove unused imports and some assorted pylint-ing
|
2013-08-23 13:03:34 -03:00 |
|
__init__.py
|
Added scrapy.utils.py26.json to use python2.6 json module when available, otherwise failback to simplejson module or scrapy.xlib.simplejson. This way we can always assume json and avoid conditional code.
|
2010-04-12 10:44:07 -03:00 |
|
mockserver.py
|
Added "from __future__ import print_function" in all relevant places except xlib
|
2013-10-20 11:55:07 +06:00 |
|
spiders.py
|
Fix start_requests lazyness and early hangs
|
2013-10-09 22:58:10 -02:00 |
|
test_closespider.py
|
test_closespider fixed for python 2.6
|
2013-05-30 10:57:06 -03:00 |
|
test_command_fetch.py
|
fixed some tests accidentally broken in previous commit
|
2011-06-06 16:11:43 -03:00 |
|
test_command_shell.py
|
use `sel` name for Selector's instances in docs, internals and shell
|
2013-10-15 15:58:42 -02:00 |
|
test_command_version.py
|
* Added tests for shell/fetch/version commands (closes #255)
|
2010-11-28 18:14:45 -02:00 |
|
test_commands.py
|
Make ITEM_PIPELINE setting a dict
|
2013-09-23 17:50:43 -03:00 |
|
test_contracts.py
|
Converted map() to list comprehension or generator for Python 3 compatibility
|
2013-10-22 13:18:26 +06:00 |
|
test_contrib_exporter.py
|
Do not fail on when json exporter are instanciated with extra keywords. closes #379
|
2013-09-05 16:57:27 -03:00 |
|
test_contrib_feedexport.py
|
changed feed exports storage api so that file/stdio outputs directly without using a temporary file
|
2011-10-23 02:49:17 -02:00 |
|
test_contrib_linkextractors.py
|
do not unquote slash and question mark in url paths. fix #24
|
2013-01-30 11:22:03 -02:00 |
|
test_contrib_loader.py
|
Python 3 compatible syntax: print, except, raise, octal numbers; removed Python 2.2 boolean compatibility code in xlib/pydispatch/dispatcher.py
|
2013-10-20 01:59:35 +06:00 |
|
test_contrib_spiderstate.py
|
make SpiderState extension always available, regardless of whether there is a job dir, and make sure it always set spider.state attribute, for consistency between in-memory and on-disk runs
|
2011-09-23 12:56:44 -03:00 |
|
test_crawl.py
|
Fix start_requests lazyness and early hangs
|
2013-10-09 22:58:10 -02:00 |
|
test_dependencies.py
|
Replaced remaning __import__(module) calls.
|
2013-10-27 19:10:25 -04:00 |
|
test_downloader_handlers.py
|
Twisted pre 10.2 (lucid) can not setup the required ftp server for tests
|
2013-07-16 00:49:35 -03:00 |
|
test_downloadermiddleware.py
|
Split redirection into status and metarefresh middlewares, also changes httpcompression priority. closes #78
|
2013-01-08 09:59:38 -02:00 |
|
test_downloadermiddleware_cookies.py
|
Skipping cookie retrieval for non http requests
|
2013-07-22 11:33:26 -03:00 |
|
test_downloadermiddleware_decompression.py
|
fixed tests to work on windows
|
2012-08-30 11:24:29 -03:00 |
|
test_downloadermiddleware_defaultheaders.py
|
Removed per-spider settings concept, and scrapy.conf.settings singleton from many extensions and middlewares. There are some still remaining, that will be removed in future commits
|
2012-08-21 17:27:45 -03:00 |
|
test_downloadermiddleware_downloadtimeout.py
|
downloadtimeout mid multi spider support removed
|
2013-10-08 19:03:26 -02:00 |
|
test_downloadermiddleware_httpauth.py
|
httpauth mid multispider support removed
|
2013-10-08 18:00:25 -02:00 |
|
test_downloadermiddleware_httpcache.py
|
Added "from __future__ import print_function" in all relevant places except xlib
|
2013-10-20 11:55:07 +06:00 |
|
test_downloadermiddleware_httpcompression.py
|
Dropped support for Python 2.5. See: http://blog.scrapy.org/scrapy-dropping-support-for-python-25
|
2012-03-01 08:18:12 -02:00 |
|
test_downloadermiddleware_httpproxy.py
|
Drop Python 2.6 support
|
2013-10-29 13:44:00 -02:00 |
|
test_downloadermiddleware_redirect.py
|
Split redirection into status and metarefresh middlewares, also changes httpcompression priority. closes #78
|
2013-01-08 09:59:38 -02:00 |
|
test_downloadermiddleware_retry.py
|
do no include ResponseFailed if http11 handler is not enabled
|
2013-08-21 19:04:12 -03:00 |
|
test_downloadermiddleware_stats.py
|
Removed signals/stats singletons
|
2012-08-21 18:32:30 -03:00 |
|
test_downloadermiddleware_useragent.py
|
useragent mid multi spider support removed
|
2013-10-08 18:18:49 -02:00 |
|
test_dupefilter.py
|
fixed unittest broken by previous commit
|
2011-08-24 11:31:52 -03:00 |
|
test_engine.py
|
Added "from __future__ import print_function" in all relevant places except xlib
|
2013-10-20 11:55:07 +06:00 |
|
test_http_cookies.py
|
Removed forked cookielib tests, because Python cookielib has been suffering several changes and maintaining a fork of the tests has become a pain. Instead, we've added specific tests for the urllib2 request/response wrappers
|
2010-09-27 07:55:27 -03:00 |
|
test_http_headers.py
|
persistent scheduler: use pickle (instead of marshal) as the default serialization format, to support serializing more objects out of the box. also removed __slots__ from Request/Response objects to make them serializable by default.
|
2011-09-01 14:27:29 -03:00 |
|
test_http_request.py
|
forms: do not submit reset inputs
|
2013-09-07 21:53:27 -03:00 |
|
test_http_response.py
|
url/body attributes of Request/Response objects are now immutable
|
2013-08-23 12:43:22 -03:00 |
|
test_item.py
|
added copy method to item
|
2013-04-19 13:23:53 -03:00 |
|
test_link.py
|
warn if Link objects are instantiated with unicode urls
|
2012-05-16 13:12:25 -03:00 |
|
test_log.py
|
- removed scrapy.conf singleton from scrapy.log, scrapy.responsetypes,
|
2012-09-19 03:03:34 -03:00 |
|
test_logformatter.py
|
format log lines lazily in case they are dropped by loglevels
|
2012-08-31 17:14:35 -03:00 |
|
test_mail.py
|
refactored MailSender to get rid of scrapy.conf singleton, also removed ill-designed scrapy.mail.mail_sent signal
|
2012-09-11 16:27:19 -03:00 |
|
test_middleware.py
|
Splitted settings classes from settings singleton. Closes #244
|
2010-09-22 15:47:33 -03:00 |
|
test_pipeline_files.py
|
Converted map() to list comprehension or generator for Python 3 compatibility
|
2013-10-22 13:18:26 +06:00 |
|
test_pipeline_images.py
|
Python 3 compatible syntax: print, except, raise, octal numbers; removed Python 2.2 boolean compatibility code in xlib/pydispatch/dispatcher.py
|
2013-10-20 01:59:35 +06:00 |
|
test_pipeline_media.py
|
Added "from __future__ import print_function" in all relevant places except xlib
|
2013-10-20 11:55:07 +06:00 |
|
test_responsetypes.py
|
Handle as html standard mimetype defined by Open Mobile Alliance
|
2012-02-24 16:16:35 -02:00 |
|
test_selector.py
|
Python 3 compatible syntax: print, except, raise, octal numbers; removed Python 2.2 boolean compatibility code in xlib/pydispatch/dispatcher.py
|
2013-10-20 01:59:35 +06:00 |
|
test_selector_csstranslator.py
|
use `sel` name for Selector's instances in docs, internals and shell
|
2013-10-15 15:58:42 -02:00 |
|
test_selector_lxmldocument.py
|
remove more references to libxml2
|
2013-10-14 16:37:14 -02:00 |
|
test_settings.py
|
added support generic python literals in settings, and for explicitly
|
2013-03-19 16:02:53 -02:00 |
|
test_spider.py
|
remove internal references to old selector classes and api
|
2013-10-14 10:51:16 -02:00 |
|
test_spidermiddleware_depth.py
|
Removed signals/stats singletons
|
2012-08-21 18:32:30 -03:00 |
|
test_spidermiddleware_httperror.py
|
silence HttpError exceptions raised by httperror spidermiddleware if not handled by spider
|
2010-05-21 17:54:32 -03:00 |
|
test_spidermiddleware_offsite.py
|
offsite multispider support removed
|
2013-07-03 17:55:20 -03:00 |
|
test_spidermiddleware_referer.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_spidermiddleware_urllength.py
|
Removed settings.disabled hack used in some tests. Closes #143
|
2010-09-06 11:04:27 -03:00 |
|
test_squeue.py
|
ported code to use queuelib
|
2013-04-23 17:48:09 -03:00 |
|
test_stats.py
|
major Stats Collection refactoring: removed separation of global/per-spider stats, removed stats-related signals (stats_spider_opened, etc). Stats are much simpler now, backwards compatibility is kept on the Stats Collector API.
|
2012-09-14 12:31:33 -03:00 |
|
test_urlparse_monkeypatches.py
|
Correctly handle query parameters on s3:// urls
|
2011-08-08 13:23:45 -03:00 |
|
test_utils_conf.py
|
Support passing spider arguments in crawl command with -a option. Closes #216
|
2010-08-28 14:43:28 -03:00 |
|
test_utils_datatypes.py
|
Initial support for a persistent scheduler, to support pausing and resuming
|
2011-08-02 11:57:55 -03:00 |
|
test_utils_defer.py
|
Python 3 compatible syntax: print, except, raise, octal numbers; removed Python 2.2 boolean compatibility code in xlib/pydispatch/dispatcher.py
|
2013-10-20 01:59:35 +06:00 |
|
test_utils_gz.py
|
httpcompression middleware improvement
|
2012-10-10 20:20:13 +03:00 |
|
test_utils_http.py
|
added new downloader middleware: ChunkedTransferMiddleware
|
2011-08-09 03:03:25 -03:00 |
|
test_utils_httpobj.py
|
remove Url class and use str instead for Request and Response urls. Also added urlparse_cached function for achieving the same caching functionality provided by old Url class
|
2009-08-17 21:16:55 -03:00 |
|
test_utils_iterators.py
|
Using next() for Python 3 compatibility
|
2013-10-22 13:54:22 +06:00 |
|
test_utils_jsonrpc.py
|
Python 3 compatible syntax: print, except, raise, octal numbers; removed Python 2.2 boolean compatibility code in xlib/pydispatch/dispatcher.py
|
2013-10-20 01:59:35 +06:00 |
|
test_utils_python.py
|
Using next() for Python 3 compatibility
|
2013-10-22 13:54:22 +06:00 |
|
test_utils_reqser.py
|
Initial support for a persistent scheduler, to support pausing and resuming
|
2011-08-02 11:57:55 -03:00 |
|
test_utils_request.py
|
Added "from __future__ import print_function" in all relevant places except xlib
|
2013-10-20 11:55:07 +06:00 |
|
test_utils_response.py
|
ignore meta-refresh redirects embedded in <script> tags. related to issue 18
|
2011-11-14 16:54:13 -02:00 |
|
test_utils_serialize.py
|
Dropped support for Python 2.5. See: http://blog.scrapy.org/scrapy-dropping-support-for-python-25
|
2012-03-01 08:18:12 -02:00 |
|
test_utils_signal.py
|
Added support for returning deferreds from (some) signal handlers. Closes #193
|
2010-08-14 21:10:37 -03:00 |
|
test_utils_sitemap.py
|
added test case for comments, see #363
|
2013-09-14 12:17:34 +02:00 |
|
test_utils_spider.py
|
Fixed bug with runspider command that appeared after the introduction of new spider manager in r2121. Also factored out common code shared by new spider manager and runspider command, with tests included.
|
2010-08-19 01:58:10 -03:00 |
|
test_utils_template.py
|
make trial run doctests
|
2010-10-26 20:50:41 -02:00 |
|
test_utils_url.py
|
remove over-testing and dict testing for test_utils_url.py
|
2013-03-10 18:30:49 -06:00 |
|
test_webclient.py
|
Do not raise PartialDownloadError if Content-Length doesn't match the body size. This fixes the error reported in: https://groups.google.com/d/topic/scrapy-users/FQ25O3KPQuU/discussion
|
2011-10-25 13:04:58 -02:00 |