RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
scrapy/scrapy/tests
History
Pablo Hoffman 0f69e7a191 Some changes to HTTP Cache middleware: 
* made it use the project data storage by default (closes #279)
* added HTTPCACHE_ENABLED setting (False by default) to enable it
* made HTTPCACHE_DIR = 'httpcache' by default (inside the project data storage)
* simplified HTTPCACHE_EXPIRATION_SECS semantics: zero means don't expire,
  dropped support for negative numbers
* other minor doc improvements
 		2010-11-01 02:38:15 -02:00
..
sample_data linkextractor: unique after urljoin_rfc 2010-04-02 19:45:30 +08:00
test_cmdline Removed hacky SCRAPY_SETTINGS_DISABLED environment variable 2010-09-22 16:08:18 -03:00
test_contrib_ibl make trial run doctests 2010-10-26 20:50:41 -02:00
test_djangoitem use explicit relative import on djangoitem tests 2009-08-29 21:04:32 -03:00
test_spidermanager Added ISpiderManager interface and a test to verify the default SpiderManager comforms to it 2010-09-03 14:29:27 -03:00
test_utils_misc make trial run doctests 2010-10-26 20:50:41 -02:00
__init__.py Added scrapy.utils.py26.json to use python2.6 json module when available, otherwise failback to simplejson module or scrapy.xlib.simplejson. This way we can always assume json and avoid conditional code. 2010-04-12 10:44:07 -03:00
test_clientform.py Applied patch to ClientForm to fix bug with wrong entities. Also added tests and left patch in repo in case we upgrade ClientForm in the future and need to re-apply it 2010-07-13 19:46:53 -03:00
test_commands.py Removed hacky SCRAPY_SETTINGS_DISABLED environment variable 2010-09-22 16:08:18 -03:00
test_contrib_exp_crawlspider_matchers.py contrib_exp: added crawlspider v2 package + tests 2010-02-19 18:19:01 -04:00
test_contrib_exp_crawlspider_reqext.py Support relative url used in base tag. closes #148 2010-03-25 12:38:37 -03:00
test_contrib_exp_crawlspider_reqgen.py removed obsolete test 2010-06-09 13:06:05 -03:00
test_contrib_exp_crawlspider_reqproc.py contrib_exp: added crawlspider v2 package + tests 2010-02-19 18:19:01 -04:00
test_contrib_exp_crawlspider_rules.py made Spider name required again (do not default) 2010-04-05 12:34:29 -03:00
test_contrib_exp_crawlspider_spider.py made Spider name required again (do not default) 2010-04-05 12:34:29 -03:00
test_contrib_exporter.py Added JSON item exporter with doc and unittests (closes #192), and also: 2010-08-07 15:52:59 -03:00
test_contrib_feedexport.py Added IFeedStorage interface and test all Feed Storages conform to it. Also added test for StdoutFeedStorage 2010-09-06 10:22:28 -03:00
test_contrib_linkextractors.py BaseSgmlLinkExtractor: Fix extract '>>' as '>' 2010-09-19 19:28:35 -03:00
test_contrib_loader.py Fixed Item Loader bug that was preventing values that evaluate to False from being loaded. Patch contributed by Anibal Pacheco. Closes #174 2010-08-22 22:07:44 -03:00
test_contrib_spidercontext.py Added SpiderContext extension. Closes #203 2010-09-08 15:52:35 -03:00
test_contrib_spiderqueue.py Added SpiderQueue tests. SQS spider queue not tested because operations take too long to complete and it's not easy to know when they have. Closes #227 2010-09-06 09:47:45 -03:00
test_dependencies.py fixed bug in OpenSSL depedency test which was comparing versions alphabetically, instead of numerically 2009-12-02 13:59:58 -02:00
test_downloader_handlers.py make download_timeout configurable by request. closes #229 2010-09-07 13:01:40 -03:00
test_downloadermiddleware_cookies.py made Spider name required again (do not default) 2010-04-05 12:34:29 -03:00
test_downloadermiddleware_decompression.py made Spider name required again (do not default) 2010-04-05 12:34:29 -03:00
test_downloadermiddleware_defaultheaders.py Ported code to use new unified access to spider settings, keeping backwards compatibility for old spider attributes. Refs #245 2010-09-22 16:09:13 -03:00
test_downloadermiddleware_downloadtimeout.py Ported code to use new unified access to spider settings, keeping backwards compatibility for old spider attributes. Refs #245 2010-09-22 16:09:13 -03:00
test_downloadermiddleware_httpauth.py Added a weak key factory based cache 2010-09-06 00:50:56 -03:00
test_downloadermiddleware_httpcache.py Some changes to HTTP Cache middleware: 2010-11-01 02:38:15 -02:00
test_downloadermiddleware_httpcompression.py Force recalculating the encoding on HTTPCompression middleware until we are sure the responsetypes guessing is reliable. Refs #239, #240 2010-09-15 13:57:17 -03:00
test_downloadermiddleware_httpproxy.py removed unused import 2010-08-10 18:26:40 -03:00
test_downloadermiddleware_redirect.py Added dont_redirect request.meta key to make RedirectMiddleware ignore requests. Closes #233 2010-09-09 21:37:35 -03:00
test_downloadermiddleware_retry.py Make RetryMiddleware obey Request.meta 'dont_retry' key when processing exceptions. Closes #259 2010-10-11 21:28:42 -02:00
test_downloadermiddleware_stats.py StatsCollector: ported methods to receive spider instances (closes #113), removed list_domains() method, added iter_spider_stats() method 2009-11-14 20:28:59 -02:00
test_downloadermiddleware_useragent.py Ported code to use new unified access to spider settings, keeping backwards compatibility for old spider attributes. Refs #245 2010-09-22 16:09:13 -03:00
test_dupefilter.py made Spider name required again (do not default) 2010-04-05 12:34:29 -03:00
test_engine.py Ported code to use new unified access to spider settings, keeping backwards compatibility for old spider attributes. Refs #245 2010-09-22 16:09:13 -03:00
test_http_cookies.py Removed forked cookielib tests, because Python cookielib has been suffering several changes and maintaining a fork of the tests has become a pain. Instead, we've added specific tests for the urllib2 request/response wrappers 2010-09-27 07:55:27 -03:00
test_http_headers.py added some unittests to make sure certain objects are using __slots__ and are also weak-referenceable 2009-08-18 20:40:04 -03:00
test_http_request.py Added formname parameter for FormRequest.from_response 2010-09-20 08:33:24 -03:00
test_http_response.py Changed TextResponse.replace() behaviour by keeping previous encoding when not specified 2010-09-09 18:01:00 -03:00
test_item.py Raise when trying to set an item field value using setattr api, and added tests. 2010-06-22 14:00:31 -03:00
test_libxml2.py * Added lxml backend for XPath selectors. Closes #147 2010-10-25 14:47:10 -02:00
test_log.py Added support for logging twisted errors generated outside of Scrapy - refs #188 2010-08-05 20:46:54 -03:00
test_logformatter.py Fixed encoding error with some item dropped messages. Closes #232 2010-09-08 15:34:13 -03:00
test_mail.py removed (somewhat hacky) MAIL_DEBUG setting 2010-08-22 22:42:00 -03:00
test_middleware.py Splitted settings classes from settings singleton. Closes #244 2010-09-22 15:47:33 -03:00
test_pipeline_images.py disconnect signals before uninstalling crawler in image tests 2010-10-23 05:10:52 -02:00
test_pipeline_media.py test media_to_download mediapipeline hook. ref #269 2010-10-25 13:16:11 -02:00
test_queue.py Fixed issue with unicode keyword arguments bug in earlier Python versions (see http://bugs.python.org/issue2646). Closes #250 2010-09-25 21:17:36 -03:00
test_responsetypes.py Fixed bug in HTTP Compression middleware which was failing to properly discover the encoding when the encoding was declared inside the response body. Closes #239. Also changed responsetypes to return Response class (instead of HtmlResponse) when the response has a Content-Encoding header 2010-09-14 20:22:25 -03:00
test_schedulermiddleware_duplicatesfilter.py moved scrapy.core.exceptions to scrapy.exceptions, keeping backwards compatibility 2010-08-10 17:36:48 -03:00
test_selector.py avoid stripping trailing spaces on lxml-based selectors. closes #270 2010-10-27 21:39:28 -02:00
test_selector_dummy.py some refactoring to selectors code, to reuse more code between lxml and libxml2 backends (refs #147). also added tests for dummy backend 2010-10-27 06:19:49 -02:00
test_selector_libxml2.py moved all similar selector tests to common selector tests, to reuse them among all backends 2010-10-27 08:54:32 -02:00
test_selector_lxml.py moved all similar selector tests to common selector tests, to reuse them among all backends 2010-10-27 08:54:32 -02:00
test_settings.py Added tests for CrawlerSettings and SpiderSettings classes 2010-09-22 16:09:13 -03:00
test_spider.py Don't set allowed_domains attribute in BaseSpider constructor 2010-09-04 03:20:05 -03:00
test_spidermiddleware_depth.py Removed settings.disabled hack used in some tests. Closes #143 2010-09-06 11:04:27 -03:00
test_spidermiddleware_httperror.py silence HttpError exceptions raised by httperror spidermiddleware if not handled by spider 2010-05-21 17:54:32 -03:00
test_spidermiddleware_offsite.py Don't filter out requests coming from spiders that don't define allowed_domains. Closes #225 2010-09-04 02:23:04 -03:00
test_spidermiddleware_referer.py made Spider name required again (do not default) 2010-04-05 12:34:29 -03:00
test_spidermiddleware_urllength.py Removed settings.disabled hack used in some tests. Closes #143 2010-09-06 11:04:27 -03:00
test_spiderqueue.py Added SpiderQueue tests. SQS spider queue not tested because operations take too long to complete and it's not easy to know when they have. Closes #227 2010-09-06 09:47:45 -03:00
test_stats.py Splitted stats collector classes from stats collection facility (#204) 2010-08-22 01:24:07 -03:00
test_urlparse_monkeypatches.py monkeypatch urlparse if s3 netloc parsing fails (python issue7904). closes #223 2010-09-04 01:02:52 -03:00
test_utils_conf.py Support passing spider arguments in crawl command with -a option. Closes #216 2010-08-28 14:43:28 -03:00
test_utils_datatypes.py make trial run doctests 2010-10-26 20:50:41 -02:00
test_utils_defer.py Improve spider errors logging which were previously logged as confusing "Unhandled errors" - closes #196 2010-08-13 01:45:47 -03:00
test_utils_encoding.py Some improvements to Response encoding support: 2010-03-25 15:47:10 -03:00
test_utils_http.py make trial run doctests 2010-10-26 20:50:41 -02:00
test_utils_httpobj.py remove Url class and use str instead for Request and Response urls. Also added urlparse_cached function for achieving the same caching functionality provided by old Url class 2009-08-17 21:16:55 -03:00
test_utils_iterators.py * Added lxml backend for XPath selectors. Closes #147 2010-10-25 14:47:10 -02:00
test_utils_jsonrpc.py Check that arguments and keyword arguments are not passed simultaneously in jsonrpc_client_call() 2010-08-27 13:45:52 -03:00
test_utils_markup.py remove_tags: add keep argument 2010-04-24 19:08:01 +08:00
test_utils_memory.py Fixed exception thrown when in FreeBSD when /proc exists but it's not mounted. Closes #235 2010-09-10 15:17:36 -03:00
test_utils_python.py make trial run doctests 2010-10-26 20:50:41 -02:00
test_utils_request.py Make url/body attributes of Request/Response objects read-only - use replace() to change them. Deprecation warning left for backwards compatibilty. 2010-09-08 00:15:11 -03:00
test_utils_response.py make trial run doctests 2010-10-26 20:50:41 -02:00
test_utils_serialize.py Replaced old manager references with crawler 2010-08-25 19:31:04 -03:00
test_utils_signal.py Added support for returning deferreds from (some) signal handlers. Closes #193 2010-08-14 21:10:37 -03:00
test_utils_simpledb.py simpledb collector: moved to_sdb_value function to utils.simpledb, and added unittests 2009-08-30 12:37:30 -03:00
test_utils_spider.py Fixed bug with runspider command that appeared after the introduction of new spider manager in r2121. Also factored out common code shared by new spider manager and runspider command, with tests included. 2010-08-19 01:58:10 -03:00
test_utils_sqlite.py Fixed bugs with SQLiteDict and added tests 2010-09-08 14:32:28 -03:00
test_utils_template.py make trial run doctests 2010-10-26 20:50:41 -02:00
test_utils_url.py Another fix to tests, broken by recent Python changes 2010-09-26 21:09:14 -03:00
test_webclient.py Fixed issue with non-standard line ending in HTTP headers. Closes #258 2010-10-09 20:43:05 -02:00