| .. |
|
sample_data
|
fixed bug handling truncated gzipped responses. closes #319
|
2011-06-06 18:25:14 -03:00 |
|
test_cmdline
|
Removed hacky SCRAPY_SETTINGS_DISABLED environment variable
|
2010-09-22 16:08:18 -03:00 |
|
test_djangoitem
|
Removed support for default values in Scrapy items, which have proven confusing in the past
|
2011-05-19 21:42:46 -03:00 |
|
test_spidermanager
|
Added ISpiderManager interface and a test to verify the default SpiderManager comforms to it
|
2010-09-03 14:29:27 -03:00 |
|
test_utils_misc
|
make trial run doctests
|
2010-10-26 20:50:41 -02:00 |
|
__init__.py
|
Added scrapy.utils.py26.json to use python2.6 json module when available, otherwise failback to simplejson module or scrapy.xlib.simplejson. This way we can always assume json and avoid conditional code.
|
2010-04-12 10:44:07 -03:00 |
|
test_clientform.py
|
Applied patch to ClientForm to fix bug with wrong entities. Also added tests and left patch in repo in case we upgrade ClientForm in the future and need to re-apply it
|
2010-07-13 19:46:53 -03:00 |
|
test_command_fetch.py
|
fixed some tests accidentally broken in previous commit
|
2011-06-06 16:11:43 -03:00 |
|
test_command_shell.py
|
Changed default representation of items to pretty-printed dicts. This improves
|
2011-06-03 01:13:01 -03:00 |
|
test_command_version.py
|
* Added tests for shell/fetch/version commands (closes #255)
|
2010-11-28 18:14:45 -02:00 |
|
test_commands.py
|
Removed hacky SCRAPY_SETTINGS_DISABLED environment variable
|
2010-09-22 16:08:18 -03:00 |
|
test_contrib_exporter.py
|
added join_multivalued parameter to CsvItemExporter
|
2011-03-24 13:15:52 -03:00 |
|
test_contrib_feedexport.py
|
ported internal scrapy.utils imports to w3lib
|
2011-04-19 01:33:52 -03:00 |
|
test_contrib_linkextractors.py
|
Some Link extractor improvements:
|
2011-05-18 12:32:34 -03:00 |
|
test_contrib_loader.py
|
Fixed Item Loader bug that was preventing values that evaluate to False from being loaded. Patch contributed by Anibal Pacheco. Closes #174
|
2010-08-22 22:07:44 -03:00 |
|
test_contrib_spidercontext.py
|
Added SpiderContext extension. Closes #203
|
2010-09-08 15:52:35 -03:00 |
|
test_contrib_spiderqueue.py
|
Added SpiderQueue tests. SQS spider queue not tested because operations take too long to complete and it's not easy to know when they have. Closes #227
|
2010-09-06 09:47:45 -03:00 |
|
test_dependencies.py
|
fixed bug in OpenSSL depedency test which was comparing versions alphabetically, instead of numerically
|
2009-12-02 13:59:58 -02:00 |
|
test_downloader_handlers.py
|
ported internal scrapy.utils imports to w3lib
|
2011-04-19 01:33:52 -03:00 |
|
test_downloadermiddleware_cookies.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_downloadermiddleware_decompression.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_downloadermiddleware_defaultheaders.py
|
Ported code to use new unified access to spider settings, keeping backwards compatibility for old spider attributes. Refs #245
|
2010-09-22 16:09:13 -03:00 |
|
test_downloadermiddleware_downloadtimeout.py
|
Ported code to use new unified access to spider settings, keeping backwards compatibility for old spider attributes. Refs #245
|
2010-09-22 16:09:13 -03:00 |
|
test_downloadermiddleware_httpauth.py
|
Added a weak key factory based cache
|
2010-09-06 00:50:56 -03:00 |
|
test_downloadermiddleware_httpcache.py
|
Some changes to HTTP Cache middleware:
|
2010-11-01 02:38:15 -02:00 |
|
test_downloadermiddleware_httpcompression.py
|
Force recalculating the encoding on HTTPCompression middleware until we are sure the responsetypes guessing is reliable. Refs #239, #240
|
2010-09-15 13:57:17 -03:00 |
|
test_downloadermiddleware_httpproxy.py
|
removed unused import
|
2010-08-10 18:26:40 -03:00 |
|
test_downloadermiddleware_redirect.py
|
* Made Response.meta attribute map to Request.meta attribute. Closes #290
|
2010-11-18 12:51:54 -02:00 |
|
test_downloadermiddleware_retry.py
|
Make RetryMiddleware obey Request.meta 'dont_retry' key when processing exceptions. Closes #259
|
2010-10-11 21:28:42 -02:00 |
|
test_downloadermiddleware_stats.py
|
fixed wrong code in test
|
2011-06-10 18:27:39 -03:00 |
|
test_downloadermiddleware_useragent.py
|
Ported code to use new unified access to spider settings, keeping backwards compatibility for old spider attributes. Refs #245
|
2010-09-22 16:09:13 -03:00 |
|
test_dupefilter.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_engine.py
|
Ported code to use new unified access to spider settings, keeping backwards compatibility for old spider attributes. Refs #245
|
2010-09-22 16:09:13 -03:00 |
|
test_http_cookies.py
|
Removed forked cookielib tests, because Python cookielib has been suffering several changes and maintaining a fork of the tests has become a pain. Instead, we've added specific tests for the urllib2 request/response wrappers
|
2010-09-27 07:55:27 -03:00 |
|
test_http_headers.py
|
fixed bug in scrapy.http.Headers: values weren't being encoded to str when passed as lists
|
2011-05-01 19:39:13 -03:00 |
|
test_http_request.py
|
fixed wrong code in test
|
2011-06-10 18:27:39 -03:00 |
|
test_http_response.py
|
* Made Response.meta attribute map to Request.meta attribute. Closes #290
|
2010-11-18 12:51:54 -02:00 |
|
test_item.py
|
Changed default representation of items to pretty-printed dicts. This improves
|
2011-06-03 01:13:01 -03:00 |
|
test_libxml2.py
|
* Added lxml backend for XPath selectors. Closes #147
|
2010-10-25 14:47:10 -02:00 |
|
test_link.py
|
added tests for Link object
|
2011-01-25 19:51:17 -02:00 |
|
test_log.py
|
Added support for logging twisted errors generated outside of Scrapy - refs #188
|
2010-08-05 20:46:54 -03:00 |
|
test_logformatter.py
|
Changed default representation of items to pretty-printed dicts. This improves
|
2011-06-03 01:13:01 -03:00 |
|
test_mail.py
|
removed (somewhat hacky) MAIL_DEBUG setting
|
2010-08-22 22:42:00 -03:00 |
|
test_middleware.py
|
Splitted settings classes from settings singleton. Closes #244
|
2010-09-22 15:47:33 -03:00 |
|
test_pipeline_images.py
|
disconnect signals before uninstalling crawler in image tests
|
2010-10-23 05:10:52 -02:00 |
|
test_pipeline_media.py
|
fixed wrong code in test
|
2011-06-10 18:27:39 -03:00 |
|
test_queue.py
|
Fixed issue with unicode keyword arguments bug in earlier Python versions (see http://bugs.python.org/issue2646). Closes #250
|
2010-09-25 21:17:36 -03:00 |
|
test_responsetypes.py
|
Added test to make sure custom mime.types shipped with Scrapy is loaded, and made Scrapy more egg-friendly by using pkutil.get_data()
|
2010-12-20 15:16:21 -02:00 |
|
test_selector.py
|
avoid stripping trailing spaces on lxml-based selectors. closes #270
|
2010-10-27 21:39:28 -02:00 |
|
test_selector_dummy.py
|
some refactoring to selectors code, to reuse more code between lxml and libxml2 backends (refs #147). also added tests for dummy backend
|
2010-10-27 06:19:49 -02:00 |
|
test_selector_libxml2.py
|
moved all similar selector tests to common selector tests, to reuse them among all backends
|
2010-10-27 08:54:32 -02:00 |
|
test_selector_lxml.py
|
moved all similar selector tests to common selector tests, to reuse them among all backends
|
2010-10-27 08:54:32 -02:00 |
|
test_settings.py
|
Added tests for CrawlerSettings and SpiderSettings classes
|
2010-09-22 16:09:13 -03:00 |
|
test_spider.py
|
Don't set allowed_domains attribute in BaseSpider constructor
|
2010-09-04 03:20:05 -03:00 |
|
test_spidermiddleware_depth.py
|
removed deprecated stat 'envinfo/request_depth_limit'. we should instead support dumping settings, for these cases
|
2011-06-06 01:02:58 -03:00 |
|
test_spidermiddleware_httperror.py
|
silence HttpError exceptions raised by httperror spidermiddleware if not handled by spider
|
2010-05-21 17:54:32 -03:00 |
|
test_spidermiddleware_offsite.py
|
Don't filter out requests coming from spiders that don't define allowed_domains. Closes #225
|
2010-09-04 02:23:04 -03:00 |
|
test_spidermiddleware_referer.py
|
made Spider name required again (do not default)
|
2010-04-05 12:34:29 -03:00 |
|
test_spidermiddleware_urllength.py
|
Removed settings.disabled hack used in some tests. Closes #143
|
2010-09-06 11:04:27 -03:00 |
|
test_spiderqueue.py
|
Added SpiderQueue tests. SQS spider queue not tested because operations take too long to complete and it's not easy to know when they have. Closes #227
|
2010-09-06 09:47:45 -03:00 |
|
test_stats.py
|
Splitted stats collector classes from stats collection facility (#204)
|
2010-08-22 01:24:07 -03:00 |
|
test_urlparse_monkeypatches.py
|
monkeypatch urlparse if s3 netloc parsing fails (python issue7904). closes #223
|
2010-09-04 01:02:52 -03:00 |
|
test_utils_conf.py
|
Support passing spider arguments in crawl command with -a option. Closes #216
|
2010-08-28 14:43:28 -03:00 |
|
test_utils_datatypes.py
|
make trial run doctests
|
2010-10-26 20:50:41 -02:00 |
|
test_utils_defer.py
|
Improve spider errors logging which were previously logged as confusing "Unhandled errors" - closes #196
|
2010-08-13 01:45:47 -03:00 |
|
test_utils_encoding.py
|
Some improvements to Response encoding support:
|
2010-03-25 15:47:10 -03:00 |
|
test_utils_gz.py
|
fixed bug handling truncated gzipped responses. closes #319
|
2011-06-06 18:25:14 -03:00 |
|
test_utils_httpobj.py
|
remove Url class and use str instead for Request and Response urls. Also added urlparse_cached function for achieving the same caching functionality provided by old Url class
|
2009-08-17 21:16:55 -03:00 |
|
test_utils_iterators.py
|
Fix xmliter_lxml
|
2011-02-11 11:41:44 -02:00 |
|
test_utils_jsonrpc.py
|
Check that arguments and keyword arguments are not passed simultaneously in jsonrpc_client_call()
|
2010-08-27 13:45:52 -03:00 |
|
test_utils_memory.py
|
Fixed exception thrown when in FreeBSD when /proc exists but it's not mounted. Closes #235
|
2010-09-10 15:17:36 -03:00 |
|
test_utils_python.py
|
Fixed scrapy.utils.python unittests
|
2011-02-10 17:27:40 -02:00 |
|
test_utils_request.py
|
Make url/body attributes of Request/Response objects read-only - use replace() to change them. Deprecation warning left for backwards compatibilty.
|
2010-09-08 00:15:11 -03:00 |
|
test_utils_response.py
|
Moved several functions from scrapy.utils.{http,markup,multipart,response,url} (and their tests) to a new library called 'w3lib'. Scrapy will now depend on w3lib.
|
2011-04-18 22:37:19 -03:00 |
|
test_utils_serialize.py
|
Replaced old manager references with crawler
|
2010-08-25 19:31:04 -03:00 |
|
test_utils_signal.py
|
Added support for returning deferreds from (some) signal handlers. Closes #193
|
2010-08-14 21:10:37 -03:00 |
|
test_utils_simpledb.py
|
simpledb collector: moved to_sdb_value function to utils.simpledb, and added unittests
|
2009-08-30 12:37:30 -03:00 |
|
test_utils_spider.py
|
Fixed bug with runspider command that appeared after the introduction of new spider manager in r2121. Also factored out common code shared by new spider manager and runspider command, with tests included.
|
2010-08-19 01:58:10 -03:00 |
|
test_utils_sqlite.py
|
Fixed bugs with SQLiteDict and added tests
|
2010-09-08 14:32:28 -03:00 |
|
test_utils_template.py
|
make trial run doctests
|
2010-10-26 20:50:41 -02:00 |
|
test_utils_url.py
|
Moved several functions from scrapy.utils.{http,markup,multipart,response,url} (and their tests) to a new library called 'w3lib'. Scrapy will now depend on w3lib.
|
2011-04-18 22:37:19 -03:00 |
|
test_webclient.py
|
Fixed issue with non-standard line ending in HTTP headers. Closes #258
|
2010-10-09 20:43:05 -02:00 |