RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
scrapy/tests
History
tpeng fa84730e70 avoid download large response 
introduce DOWNLOAD_MAXSIZE and DOWNLOAD_WARNSIZE in settings and
download_maxsize/download_warnsize in spider/request meta, so
downloader stop downloading as soon as the received data exceed the
limit. also check the twsisted response's length in advance to stop
downloading as early as possible.
 		2014-11-12 12:28:02 +01:00
..
keys move tests under root dir 2014-07-30 19:45:08 -03:00
mocks move tests under root dir 2014-07-30 19:45:08 -03:00
sample_data Allow to specify the quotechar in CSVFeedSpider 2014-09-13 02:14:57 +02:00
test_cmdline move tests under root dir 2014-07-30 19:45:08 -03:00
test_djangoitem move tests under root dir 2014-07-30 19:45:08 -03:00
test_settings Change error type when updating frozen settings 2014-08-14 11:59:25 -03:00
test_spidermanager SPIDER_MODULES can be set as a csv string 2014-09-10 23:25:57 -03:00
test_utils_misc move tests under root dir 2014-07-30 19:45:08 -03:00
__init__.py remove more references to runtests.sh 2014-07-31 17:30:45 -03:00
mockserver.py move tests under root dir 2014-07-30 19:45:08 -03:00
py3-ignores.txt Deprecate Crawler.spiders attribute 2014-08-14 09:19:41 -03:00
requirements.txt move tests requirements under tests dir 2014-07-30 19:45:08 -03:00
spiders.py Collect the list of packages not working on python3 2014-07-31 14:06:34 -03:00
test_closespider.py Update tests utils, fixing get_crawler and removing docrawl 2014-08-12 14:02:56 -03:00
test_command_fetch.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_command_shell.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_command_version.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_commands.py add project name validation 2014-08-01 14:36:30 -03:00
test_contracts.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_contrib_exporter.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_contrib_feedexport.py TST modernize some of the asserts 2014-08-01 23:44:23 +06:00
test_contrib_linkextractors.py SgmlLinkExtractor - fix for parsing <area> tag with Unicode present 2014-08-28 18:55:58 +02:00
test_contrib_loader.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_contrib_spiderstate.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_crawl.py Update tests utils, fixing get_crawler and removing docrawl 2014-08-12 14:02:56 -03:00
test_crawler.py Add the tests changes for previous commit 2014-09-10 12:05:18 -03:00
test_dependencies.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_downloader_handlers.py avoid download large response 2014-11-12 12:28:02 +01:00
test_downloadermiddleware.py Update tests utils, fixing get_crawler and removing docrawl 2014-08-12 14:02:56 -03:00
test_downloadermiddleware_ajaxcrawlable.py Update tests utils, fixing get_crawler and removing docrawl 2014-08-12 14:02:56 -03:00
test_downloadermiddleware_cookies.py TST small cleanup of a cookie test 2014-09-21 05:31:34 +06:00
test_downloadermiddleware_decompression.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_downloadermiddleware_defaultheaders.py Update tests utils, fixing get_crawler and removing docrawl 2014-08-12 14:02:56 -03:00
test_downloadermiddleware_downloadtimeout.py Update tests utils, fixing get_crawler and removing docrawl 2014-08-12 14:02:56 -03:00
test_downloadermiddleware_httpauth.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_downloadermiddleware_httpcache.py Update tests utils, fixing get_crawler and removing docrawl 2014-08-12 14:02:56 -03:00
test_downloadermiddleware_httpcompression.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_downloadermiddleware_httpproxy.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_downloadermiddleware_redirect.py Merge pull request #816 from Curita/api-cleanup 2014-09-01 21:55:36 -03:00
test_downloadermiddleware_retry.py Merge pull request #816 from Curita/api-cleanup 2014-09-01 21:55:36 -03:00
test_downloadermiddleware_robotstxt.py dont_obey_robotstxt meta key; don't process requests to /robots.txt 2014-09-23 00:10:43 +06:00
test_downloadermiddleware_stats.py Update tests utils, fixing get_crawler and removing docrawl 2014-08-12 14:02:56 -03:00
test_downloadermiddleware_useragent.py Update tests utils, fixing get_crawler and removing docrawl 2014-08-12 14:02:56 -03:00
test_dupefilter.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_engine.py Drop support for scrapy.project.crawler (And scrapy.stats consequently) 2014-08-12 14:02:56 -03:00
test_http_cookies.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_http_headers.py normalize header values to bytes 2014-08-01 00:02:50 -03:00
test_http_request.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_http_response.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_item.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_link.py PY3 port scrapy.link 2014-08-02 00:16:01 +06:00
test_log.py Support multiple simultaneous LogObservers listening different crawlers 2014-08-12 14:02:56 -03:00
test_logformatter.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_mail.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_middleware.py TST modernize some of the asserts 2014-08-01 23:44:23 +06:00
test_pipeline_files.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_pipeline_images.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_pipeline_media.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_proxy_connect.py Update tests utils, fixing get_crawler and removing docrawl 2014-08-12 14:02:56 -03:00
test_responsetypes.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_selector.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_selector_csstranslator.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_selector_lxmldocument.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_spider.py Per-spider settings tests 2014-09-01 21:56:57 -03:00
test_spidermiddleware_depth.py Update tests utils, fixing get_crawler and removing docrawl 2014-08-12 14:02:56 -03:00
test_spidermiddleware_httperror.py Update tests utils, fixing get_crawler and removing docrawl 2014-08-12 14:02:56 -03:00
test_spidermiddleware_offsite.py Update tests utils, fixing get_crawler and removing docrawl 2014-08-12 14:02:56 -03:00
test_spidermiddleware_referer.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_spidermiddleware_urllength.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_squeue.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_stats.py Update tests utils, fixing get_crawler and removing docrawl 2014-08-12 14:02:56 -03:00
test_toplevel.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_urlparse_monkeypatches.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_utils_conf.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_utils_datatypes.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_utils_defer.py TST modernize some of the asserts 2014-08-01 23:44:23 +06:00
test_utils_deprecate.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_utils_gz.py PY3: port scrapy/utils/gz.py 2014-08-01 02:25:33 -03:00
test_utils_http.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_utils_httpobj.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_utils_iterators.py added a test-case for wrong quotechar 2014-09-13 03:47:40 +02:00
test_utils_python.py TST modernize some of the asserts 2014-08-01 23:44:23 +06:00
test_utils_reqser.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_utils_request.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_utils_response.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_utils_serialize.py jsonrpc webservice moved to https://github.com/scrapy/scrapy-jsonrpc repository 2014-08-15 23:28:13 -03:00
test_utils_signal.py TST modernize some of the asserts 2014-08-01 23:44:23 +06:00
test_utils_sitemap.py PY3 fix test_utils_sitemap. 2014-08-01 16:17:40 +06:00
test_utils_spider.py PY3 port scrapy.utils.spider 2014-08-01 16:43:39 +06:00
test_utils_template.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_utils_url.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_webclient.py move tests under root dir 2014-07-30 19:45:08 -03:00