| .. |
|
sample_data
|
fixed bug handling truncated gzipped responses. closes #319
|
2011-06-06 18:25:14 -03:00 |
|
test_cmdline
|
updated documentation and code to use -s instead of --set option
|
2011-09-01 14:35:37 -03:00 |
|
test_djangoitem
|
updated settings.py for djangoitem tests to new django multi-db format
|
2011-07-25 00:49:54 -03:00 |
|
test_spidermanager
|
Added ISpiderManager interface and a test to verify the default SpiderManager comforms to it
|
2010-09-03 14:29:27 -03:00 |
|
test_utils_misc
|
make trial run doctests
|
2010-10-26 20:50:41 -02:00 |
|
__init__.py
|
Added scrapy.utils.py26.json to use python2.6 json module when available, otherwise failback to simplejson module or scrapy.xlib.simplejson. This way we can always assume json and avoid conditional code.
|
2010-04-12 10:44:07 -03:00 |
|
test_clientform.py
|
Applied patch to ClientForm to fix bug with wrong entities. Also added tests and left patch in repo in case we upgrade ClientForm in the future and need to re-apply it
|
2010-07-13 19:46:53 -03:00 |
|
test_command_fetch.py
|
fixed some tests accidentally broken in previous commit
|
2011-06-06 16:11:43 -03:00 |
|
test_command_shell.py
|
Changed default representation of items to pretty-printed dicts. This improves
|
2011-06-03 01:13:01 -03:00 |
|
test_command_version.py
|
* Added tests for shell/fetch/version commands (closes #255)
|
2010-11-28 18:14:45 -02:00 |
|
test_commands.py
|
More core changes:
|
2011-07-15 15:18:39 -03:00 |
|
test_contrib_exporter.py
|
fixed PickeItemExporter bug, added unittest, and added pickle to suported feed exports formats
|
2011-10-25 02:36:51 -02:00 |
|
test_contrib_feedexport.py
|
changed feed exports storage api so that file/stdio outputs directly without using a temporary file
|
2011-10-23 02:49:17 -02:00 |
|
test_contrib_linkextractors.py
|
Some Link extractor improvements:
|
2011-05-18 12:32:34 -03:00 |
|
test_contrib_loader.py
|
improved errors of ItemLoader.load_item() so that it shows the field name and value of the output processor that failed
|
2011-06-23 12:39:51 -03:00 |
|
test_contrib_spiderstate.py
|
make SpiderState extension always available, regardless of whether there is a job dir, and make sure it always set spider.state attribute, for consistency between in-memory and on-disk runs
|
2011-09-23 12:56:44 -03:00 |
|
test_dependencies.py
|
fixed bug in OpenSSL depedency test which was comparing versions alphabetically, instead of numerically
|
2009-12-02 13:59:58 -02:00 |
|
test_downloader_handlers.py
|
Do not raise PartialDownloadError if Content-Length doesn't match the body size. This fixes the error reported in: https://groups.google.com/d/topic/scrapy-users/FQ25O3KPQuU/discussion
|
2011-10-25 13:04:58 -02:00 |
|
test_downloadermiddleware_cookies.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_downloadermiddleware_decompression.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_downloadermiddleware_defaultheaders.py
|
Ported code to use new unified access to spider settings, keeping backwards compatibility for old spider attributes. Refs #245
|
2010-09-22 16:09:13 -03:00 |
|
test_downloadermiddleware_downloadtimeout.py
|
Ported code to use new unified access to spider settings, keeping backwards compatibility for old spider attributes. Refs #245
|
2010-09-22 16:09:13 -03:00 |
|
test_downloadermiddleware_httpauth.py
|
Added a weak key factory based cache
|
2010-09-06 00:50:56 -03:00 |
|
test_downloadermiddleware_httpcache.py
|
tests: fixed httpcache testcase.
|
2011-12-30 23:11:16 -04:00 |
|
test_downloadermiddleware_httpcompression.py
|
fixed httpcompression middleware tests
|
2011-07-04 21:31:05 -03:00 |
|
test_downloadermiddleware_httpproxy.py
|
removed unused import
|
2010-08-10 18:26:40 -03:00 |
|
test_downloadermiddleware_redirect.py
|
* Made Response.meta attribute map to Request.meta attribute. Closes #290
|
2010-11-18 12:51:54 -02:00 |
|
test_downloadermiddleware_retry.py
|
Make RetryMiddleware obey Request.meta 'dont_retry' key when processing exceptions. Closes #259
|
2010-10-11 21:28:42 -02:00 |
|
test_downloadermiddleware_stats.py
|
fixed wrong code in test
|
2011-06-10 18:27:39 -03:00 |
|
test_downloadermiddleware_useragent.py
|
Ported code to use new unified access to spider settings, keeping backwards compatibility for old spider attributes. Refs #245
|
2010-09-22 16:09:13 -03:00 |
|
test_dupefilter.py
|
fixed unittest broken by previous commit
|
2011-08-24 11:31:52 -03:00 |
|
test_engine.py
|
More core changes:
|
2011-07-15 15:18:39 -03:00 |
|
test_http_cookies.py
|
Removed forked cookielib tests, because Python cookielib has been suffering several changes and maintaining a fork of the tests has become a pain. Instead, we've added specific tests for the urllib2 request/response wrappers
|
2010-09-27 07:55:27 -03:00 |
|
test_http_headers.py
|
persistent scheduler: use pickle (instead of marshal) as the default serialization format, to support serializing more objects out of the box. also removed __slots__ from Request/Response objects to make them serializable by default.
|
2011-09-01 14:27:29 -03:00 |
|
test_http_request.py
|
ajax crawling wasn't expanding for unicode urls
|
2012-02-07 14:44:06 -02:00 |
|
test_http_response.py
|
persistent scheduler: use pickle (instead of marshal) as the default serialization format, to support serializing more objects out of the box. also removed __slots__ from Request/Response objects to make them serializable by default.
|
2011-09-01 14:27:29 -03:00 |
|
test_item.py
|
Changed default representation of items to pretty-printed dicts. This improves
|
2011-06-03 01:13:01 -03:00 |
|
test_libxml2.py
|
* Added lxml backend for XPath selectors. Closes #147
|
2010-10-25 14:47:10 -02:00 |
|
test_link.py
|
added fragment attribute ot Link object
|
2011-07-27 12:28:36 -03:00 |
|
test_log.py
|
Added support for logging twisted errors generated outside of Scrapy - refs #188
|
2010-08-05 20:46:54 -03:00 |
|
test_logformatter.py
|
logformatter: support non-ascii characters in custom implementations of Item.__str__()
|
2011-07-12 01:16:06 -03:00 |
|
test_mail.py
|
removed (somewhat hacky) MAIL_DEBUG setting
|
2010-08-22 22:42:00 -03:00 |
|
test_middleware.py
|
Splitted settings classes from settings singleton. Closes #244
|
2010-09-22 15:47:33 -03:00 |
|
test_pipeline_images.py
|
disconnect signals before uninstalling crawler in image tests
|
2010-10-23 05:10:52 -02:00 |
|
test_pipeline_media.py
|
fixed wrong code in test
|
2011-06-10 18:27:39 -03:00 |
|
test_responsetypes.py
|
moved module scrapy.core.downloader.responsetypes to scrapy.responsetypes
|
2011-08-07 02:49:57 -03:00 |
|
test_selector.py
|
avoid stripping trailing spaces on lxml-based selectors. closes #270
|
2010-10-27 21:39:28 -02:00 |
|
test_selector_dummy.py
|
some refactoring to selectors code, to reuse more code between lxml and libxml2 backends (refs #147). also added tests for dummy backend
|
2010-10-27 06:19:49 -02:00 |
|
test_selector_libxml2.py
|
moved all similar selector tests to common selector tests, to reuse them among all backends
|
2010-10-27 08:54:32 -02:00 |
|
test_selector_lxml.py
|
moved all similar selector tests to common selector tests, to reuse them among all backends
|
2010-10-27 08:54:32 -02:00 |
|
test_settings.py
|
Added tests for CrawlerSettings and SpiderSettings classes
|
2010-09-22 16:09:13 -03:00 |
|
test_spider.py
|
SitemapSpider: added support for sitemap urls ending in .xml and .xml.gz, even if they have a wrong content type
|
2012-01-03 12:17:17 -02:00 |
|
test_spidermiddleware_depth.py
|
removed deprecated stat 'envinfo/request_depth_limit'. we should instead support dumping settings, for these cases
|
2011-06-06 01:02:58 -03:00 |
|
test_spidermiddleware_httperror.py
|
silence HttpError exceptions raised by httperror spidermiddleware if not handled by spider
|
2010-05-21 17:54:32 -03:00 |
|
test_spidermiddleware_offsite.py
|
Do not filter requests with dont_filter attribute set in OffsiteMiddleware
|
2011-09-08 15:18:10 -03:00 |
|
test_spidermiddleware_referer.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_spidermiddleware_urllength.py
|
Removed settings.disabled hack used in some tests. Closes #143
|
2010-09-06 11:04:27 -03:00 |
|
test_squeue.py
|
Some changes to persistent scheduler after some initial usage feedback:
|
2011-09-23 13:03:07 -03:00 |
|
test_stats.py
|
Splitted stats collector classes from stats collection facility (#204)
|
2010-08-22 01:24:07 -03:00 |
|
test_urlparse_monkeypatches.py
|
Correctly handle query parameters on s3:// urls
|
2011-08-08 13:23:45 -03:00 |
|
test_utils_conf.py
|
Support passing spider arguments in crawl command with -a option. Closes #216
|
2010-08-28 14:43:28 -03:00 |
|
test_utils_datatypes.py
|
Initial support for a persistent scheduler, to support pausing and resuming
|
2011-08-02 11:57:55 -03:00 |
|
test_utils_defer.py
|
Improve spider errors logging which were previously logged as confusing "Unhandled errors" - closes #196
|
2010-08-13 01:45:47 -03:00 |
|
test_utils_encoding.py
|
Some improvements to Response encoding support:
|
2010-03-25 15:47:10 -03:00 |
|
test_utils_gz.py
|
fixed bug handling truncated gzipped responses. closes #319
|
2011-06-06 18:25:14 -03:00 |
|
test_utils_http.py
|
added new downloader middleware: ChunkedTransferMiddleware
|
2011-08-09 03:03:25 -03:00 |
|
test_utils_httpobj.py
|
remove Url class and use str instead for Request and Response urls. Also added urlparse_cached function for achieving the same caching functionality provided by old Url class
|
2009-08-17 21:16:55 -03:00 |
|
test_utils_iterators.py
|
Fix xmliter_lxml
|
2011-02-11 11:41:44 -02:00 |
|
test_utils_jsonrpc.py
|
Check that arguments and keyword arguments are not passed simultaneously in jsonrpc_client_call()
|
2010-08-27 13:45:52 -03:00 |
|
test_utils_memory.py
|
Fixed exception thrown when in FreeBSD when /proc exists but it's not mounted. Closes #235
|
2010-09-10 15:17:36 -03:00 |
|
test_utils_pqueue.py
|
Some changes to persistent scheduler after some initial usage feedback:
|
2011-09-23 13:03:07 -03:00 |
|
test_utils_python.py
|
Fixed scrapy.utils.python unittests
|
2011-02-10 17:27:40 -02:00 |
|
test_utils_queue.py
|
remove usage of assertLess() which is only available on python 2.7+
|
2011-09-26 12:21:52 -03:00 |
|
test_utils_reqser.py
|
Initial support for a persistent scheduler, to support pausing and resuming
|
2011-08-02 11:57:55 -03:00 |
|
test_utils_request.py
|
Make url/body attributes of Request/Response objects read-only - use replace() to change them. Deprecation warning left for backwards compatibilty.
|
2010-09-08 00:15:11 -03:00 |
|
test_utils_response.py
|
ignore meta-refresh redirects embedded in <script> tags. related to issue 18
|
2011-11-14 16:54:13 -02:00 |
|
test_utils_serialize.py
|
Replaced old manager references with crawler
|
2010-08-25 19:31:04 -03:00 |
|
test_utils_signal.py
|
Added support for returning deferreds from (some) signal handlers. Closes #193
|
2010-08-14 21:10:37 -03:00 |
|
test_utils_sitemap.py
|
scrapy.utils.sitemap: added one more case of parsing invalid sitemaps
|
2011-08-07 03:24:32 -03:00 |
|
test_utils_spider.py
|
Fixed bug with runspider command that appeared after the introduction of new spider manager in r2121. Also factored out common code shared by new spider manager and runspider command, with tests included.
|
2010-08-19 01:58:10 -03:00 |
|
test_utils_template.py
|
make trial run doctests
|
2010-10-26 20:50:41 -02:00 |
|
test_utils_url.py
|
use netloc instead of hostname in url_is_from_any_domain(). closes #50
|
2012-02-24 02:09:02 -02:00 |
|
test_webclient.py
|
Do not raise PartialDownloadError if Content-Length doesn't match the body size. This fixes the error reported in: https://groups.google.com/d/topic/scrapy-users/FQ25O3KPQuU/discussion
|
2011-10-25 13:04:58 -02:00 |
b1f011d740