RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
scrapy/scrapy/tests
History
Pablo Hoffman c7d9f6e270 Added JSON item exporter with doc and unittests (closes #192), and also: 
* put all json exporters in scrapy.contrib.exporters and deprecated
  scrapy.contrib.exporters.jsonlines to reduce module nesting
* use JSON exporter with EXPORT_FORMAT=json in file export pipeline
 		2010-08-07 15:52:59 -03:00
..
sample_data linkextractor: unique after urljoin_rfc 2010-04-02 19:45:30 +08:00
test_cmdline moved scrapy.command.cmdline module to scrapy.cmdline (keeping backwards compatibility until 0.10) 2010-05-26 10:29:32 -03:00
test_contrib_ibl removed nltk dependency from IBL code 2010-06-22 13:38:32 -03:00
test_contrib_spidermanager Added handles_request() class method to BaseSpider - closes #191 2010-08-06 14:59:18 -03:00
test_djangoitem use explicit relative import on djangoitem tests 2009-08-29 21:04:32 -03:00
test_utils_misc Rewritten walk_modules function to support eggs, and added tests 2010-07-30 17:05:55 -03:00
__init__.py Added scrapy.utils.py26.json to use python2.6 json module when available, otherwise failback to simplejson module or scrapy.xlib.simplejson. This way we can always assume json and avoid conditional code. 2010-04-12 10:44:07 -03:00
test_clientform.py Applied patch to ClientForm to fix bug with wrong entities. Also added tests and left patch in repo in case we upgrade ClientForm in the future and need to re-apply it 2010-07-13 19:46:53 -03:00
test_commands.py moved scrapy.command.cmdline module to scrapy.cmdline (keeping backwards compatibility until 0.10) 2010-05-26 10:29:32 -03:00
test_conf.py Added Settings class tests, and fixed minor bug 2009-12-02 15:52:17 -02:00
test_contrib_exp_crawlspider_matchers.py contrib_exp: added crawlspider v2 package + tests 2010-02-19 18:19:01 -04:00
test_contrib_exp_crawlspider_reqext.py Support relative url used in base tag. closes #148 2010-03-25 12:38:37 -03:00
test_contrib_exp_crawlspider_reqgen.py removed obsolete test 2010-06-09 13:06:05 -03:00
test_contrib_exp_crawlspider_reqproc.py contrib_exp: added crawlspider v2 package + tests 2010-02-19 18:19:01 -04:00
test_contrib_exp_crawlspider_rules.py made Spider name required again (do not default) 2010-04-05 12:34:29 -03:00
test_contrib_exp_crawlspider_spider.py made Spider name required again (do not default) 2010-04-05 12:34:29 -03:00
test_contrib_exp_loader_lxmlloader.py added LxmlItemLoader 2009-09-29 16:17:30 -03:00
test_contrib_exporter.py Added JSON item exporter with doc and unittests (closes #192), and also: 2010-08-07 15:52:59 -03:00
test_contrib_linkextractors.py linkextractor: unique after urljoin_rfc 2010-04-02 19:45:30 +08:00
test_contrib_loader.py ItemLoader: add test for adding a dict value 2010-04-24 21:21:12 +08:00
test_contrib_logformatter.py some improvements to 'Crawled' log lines, delegating the formatting to a pluggable function 2009-10-06 22:47:17 -02:00
test_core_queue.py Added ExecutionQueue class for feeding spiders and requests to scrape. This 2010-05-26 10:29:32 -03:00
test_dependencies.py fixed bug in OpenSSL depedency test which was comparing versions alphabetically, instead of numerically 2009-12-02 13:59:58 -02:00
test_downloader_handlers.py downloader_handler: test HEAD method 2010-05-04 15:50:26 +08:00
test_downloadermiddleware_cookies.py made Spider name required again (do not default) 2010-04-05 12:34:29 -03:00
test_downloadermiddleware_decompression.py made Spider name required again (do not default) 2010-04-05 12:34:29 -03:00
test_downloadermiddleware_defaultheaders.py update docs for defaultheaders middleware and change spider attribute to match global setting name 2010-07-16 16:17:08 -03:00
test_downloadermiddleware_httpauth.py made Spider name required again (do not default) 2010-04-05 12:34:29 -03:00
test_downloadermiddleware_httpcache.py HTTPCACHE: Don't cache response with codes in HTTPCACHE_IGNORE_HTTP_CODES 2010-07-09 13:14:25 -03:00
test_downloadermiddleware_httpcompression.py made Spider name required again (do not default) 2010-04-05 12:34:29 -03:00
test_downloadermiddleware_httpproxy.py made Spider name required again (do not default) 2010-04-05 12:34:29 -03:00
test_downloadermiddleware_redirect.py downloadermiddleware/redirect: always do "HEAD" if origin request method is HEAD 2010-05-04 16:11:45 +08:00
test_downloadermiddleware_retry.py made Spider name required again (do not default) 2010-04-05 12:34:29 -03:00
test_downloadermiddleware_stats.py StatsCollector: ported methods to receive spider instances (closes #113), removed list_domains() method, added iter_spider_stats() method 2009-11-14 20:28:59 -02:00
test_downloadermiddleware_useragent.py made Spider name required again (do not default) 2010-04-05 12:34:29 -03:00
test_dupefilter.py made Spider name required again (do not default) 2010-04-05 12:34:29 -03:00
test_engine.py Added ExecutionQueue class for feeding spiders and requests to scrape. This 2010-05-26 10:29:32 -03:00
test_http_cookies.py removed wtf line 2009-07-08 18:19:54 -03:00
test_http_headers.py added some unittests to make sure certain objects are using __slots__ and are also weak-referenceable 2009-08-18 20:40:04 -03:00
test_http_request.py allow passing custom headers in FormRequest.from_response() 2010-07-08 14:02:28 -03:00
test_http_response.py Minimize effect of http://bugs.python.org/issue8271 on TextResponses by changing str.decode errors policy by custom `replace` alike error handler 2010-04-07 00:29:53 -03:00
test_item.py Raise when trying to set an item field value using setattr api, and added tests. 2010-06-22 14:00:31 -03:00
test_log.py Added support for logging twisted errors generated outside of Scrapy - refs #188 2010-08-05 20:46:54 -03:00
test_mail.py Some mail improvements and tests. 2010-05-28 16:51:47 -03:00
test_pipeline_images.py fixed bug in images pipeline bug in win32 systems, and added regression tests 2009-10-07 22:34:38 -02:00
test_pipeline_media.py mediapipeline: bugfix error raised when media requests has not callbacks, remove item_media_{downloaded,failed} hooks in favour or request.{errback,calback}, and add tests 2010-06-14 12:34:52 -03:00
test_responsetypes.py mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
test_schedulermiddleware_duplicatesfilter.py made Spider name required again (do not default) 2010-04-05 12:34:29 -03:00
test_selector.py fixed bug caused when instantiating selectors with responses containing empty bodies 2009-10-21 16:37:30 -02:00
test_spider.py made Spider name required again (do not default) 2010-04-05 12:34:29 -03:00
test_spidermiddleware_depth.py StatsCollector: ported methods to receive spider instances (closes #113), removed list_domains() method, added iter_spider_stats() method 2009-11-14 20:28:59 -02:00
test_spidermiddleware_httperror.py silence HttpError exceptions raised by httperror spidermiddleware if not handled by spider 2010-05-21 17:54:32 -03:00
test_spidermiddleware_offsite.py made Spider name required again (do not default) 2010-04-05 12:34:29 -03:00
test_spidermiddleware_referer.py made Spider name required again (do not default) 2010-04-05 12:34:29 -03:00
test_spidermiddleware_urlfilter.py made Spider name required again (do not default) 2010-04-05 12:34:29 -03:00
test_spidermiddleware_urllength.py made Spider name required again (do not default) 2010-04-05 12:34:29 -03:00
test_stats.py made Spider name required again (do not default) 2010-04-05 12:34:29 -03:00
test_utils_conf.py added support for defining EXTENSIONS setting using dicts, like middleware settings 2009-08-18 11:05:36 -03:00
test_utils_datatypes.py mv scrapy/trunk to root as part of svn2hg migration 2009-05-06 15:55:17 -03:00
test_utils_defer.py remove obsolete deferred_imap util, use coiterate+imap instead 2009-06-23 14:45:16 -07:00
test_utils_encoding.py Some improvements to Response encoding support: 2010-03-25 15:47:10 -03:00
test_utils_httpobj.py remove Url class and use str instead for Request and Response urls. Also added urlparse_cached function for achieving the same caching functionality provided by old Url class 2009-08-17 21:16:55 -03:00
test_utils_iterators.py move lxml based xmliter function to contrib_exp 2009-10-14 13:22:28 -02:00
test_utils_jsonrpc.py * Added Scrapy Web Service with documentation and tests. 2010-06-09 13:46:22 -03:00
test_utils_markup.py remove_tags: add keep argument 2010-04-24 19:08:01 +08:00
test_utils_memory.py make sure get_vmvalue_from_procfs returns int 2009-08-18 00:59:32 -03:00
test_utils_python.py utils.python: added equal_attributes() to compare two objects arbitrary attributes 2010-02-19 17:57:48 -04:00
test_utils_request.py bugfix in request_httprepr() function 2010-07-15 12:04:55 -03:00
test_utils_response.py Fixed bug with float values in meta refresh 2010-07-01 11:46:06 -03:00
test_utils_serialize.py utils.serialize: added support for encoding Deferreds, and to refer spiders by name using 'spider::name' 2010-06-11 18:16:09 -03:00
test_utils_signal.py Scrapy logging refactoring (closes #188): 2010-08-02 08:49:14 -03:00
test_utils_simpledb.py simpledb collector: moved to_sdb_value function to utils.simpledb, and added unittests 2009-08-30 12:37:30 -03:00
test_utils_spider.py check iterable output of crawl spider and add tests for common function used to iterate spider output 2009-09-21 13:57:16 -03:00
test_utils_url.py scrapy.utils.url_is_from_spider() - Consider spider name as possible domain for matching in scrapy.utils.url_is_from_spider() 2010-08-02 12:16:36 -03:00
test_webclient.py rewrote of downloader handlers 2009-10-05 04:10:22 -02:00