RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
scrapy/tests
History
Vostretsov Nikita b364d27247 [MRG+1] Automatic port selection for servicies in unit tests (#3210) 
* ability to pass port as a parameter

* try to find free ports

* use environment variables to pass mock server address

* get mock server address from environment variables

* ability to select ports for proxy in runtime

* use common method for URLs from mock server

* https support

* get mock server address

* get mock address

* replace hand-written mechanism by kernel-based one

* use ephemeral ports in mockserver

* strip EOL from addresses

* use ephemeral port in proxy

* no need to restore environment as it is restored in tearDown

* decode bytes

* use mockserver address as a variable

* ability to pass address as variable

* per test-case mockserver

* use base class

* remove obsolete environment manipulation

* return usage of proxy for http cases

* common method for broking proxy auth credentials

* python version-independent url methods
 		2018-05-23 21:25:50 +03:00
..
keys revert wrong changes 2018-03-13 13:05:37 +08:00
mocks move tests under root dir 2014-07-30 19:45:08 -03:00
sample_data Add file listing resource + redirecting resource to MockServer 2017-03-10 21:35:25 +01:00
test_cmdline Update deprecated test aliases 2017-08-09 12:52:10 +02:00
test_settings Support 'True' and 'False' strings as boolean settings values 2017-01-30 16:33:08 +01:00
test_spiderloader Do not use self.assertRaises() as context manager 2017-03-09 12:21:03 +01:00
test_utils_misc Update deprecated test aliases 2017-08-09 12:52:10 +02:00
__init__.py Use https links wherever possible 2017-10-28 16:24:40 +05:30
constraints.txt blacklist twisted version with regression in constraints file 2018-05-17 08:53:42 +00:00
mockserver.py [MRG+1] Automatic port selection for servicies in unit tests (#3210) 2018-05-23 21:25:50 +03:00
pipelines.py Update docstring 2016-11-08 13:30:51 +01:00
py3-ignores.txt Re-enable FTP tests on Python 3 2017-02-27 17:42:00 +01:00
requirements-py3.txt [httpcompression] minor style edits 2017-02-07 10:22:42 +01:00
requirements.txt [httpcompression] minor style edits 2017-02-07 10:22:42 +01:00
spiders.py [MRG+1] Automatic port selection for servicies in unit tests (#3210) 2018-05-23 21:25:50 +03:00
test_closespider.py [MRG+1] Automatic port selection for servicies in unit tests (#3210) 2018-05-23 21:25:50 +03:00
test_command_fetch.py Let framework handle only HTTP redirects by default for fetch and shell commands 2016-12-07 17:56:13 +01:00
test_command_parse.py removed commented out code, wrapped line to pep-8 and removed backlashes 2017-11-11 18:30:01 -05:00
test_command_shell.py Add test for fetch(url) within shell with and without redirect 2016-12-07 19:07:32 +01:00
test_command_version.py Fix test 2017-09-25 12:49:27 +02:00
test_commands.py Add test for DNS cache disabling 2017-07-04 23:10:19 +02:00
test_contracts.py Move scrapy/spider.py to scrapy/spiders/__init__.py 2015-05-09 04:20:09 -03:00
test_crawl.py [MRG+1] Automatic port selection for servicies in unit tests (#3210) 2018-05-23 21:25:50 +03:00
test_crawler.py Respect log settings in custom_settings: fixes GH-1612 2017-03-03 18:01:11 +03:00
test_dependencies.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_downloader_handlers.py [MRG+1] Automatic port selection for servicies in unit tests (#3210) 2018-05-23 21:25:50 +03:00
test_downloadermiddleware.py py3: body to bytes in tests, unskip test file 2016-01-15 11:26:01 +03:00
test_downloadermiddleware_ajaxcrawlable.py PY3 fix AjacCrawlable middleware tests 2015-09-01 03:49:52 +05:00
test_downloadermiddleware_cookies.py Update deprecated test aliases 2017-08-09 12:52:10 +02:00
test_downloadermiddleware_decompression.py PY3 fix test downloadermiddleware decompression 2015-07-29 13:51:01 +00:00
test_downloadermiddleware_defaultheaders.py Update deprecated test aliases 2017-08-09 12:52:10 +02:00
test_downloadermiddleware_downloadtimeout.py Update deprecated test aliases 2017-08-09 12:52:10 +02:00
test_downloadermiddleware_httpauth.py Update deprecated test aliases 2017-08-09 12:52:10 +02:00
test_downloadermiddleware_httpcache.py HTTP Cache: treat 308 as 301 2017-07-26 19:01:48 +02:00
test_downloadermiddleware_httpcompression.py Update deprecated test aliases 2017-08-09 12:52:10 +02:00
test_downloadermiddleware_httpproxy.py Fix typos in tests 2017-10-01 12:24:56 -03:00
test_downloadermiddleware_redirect.py Update deprecated test aliases 2017-08-09 12:52:10 +02:00
test_downloadermiddleware_retry.py Improvise the clarity of test cases 2017-03-23 19:45:04 +05:30
test_downloadermiddleware_robotstxt.py Pass user-agent as native str when checking URLs against robots.txt 2016-11-15 17:38:32 +01:00
test_downloadermiddleware_stats.py PY3 fix DownloaderStats middleware tests 2015-09-01 04:09:15 +05:00
test_downloadermiddleware_useragent.py Update deprecated test aliases 2017-08-09 12:52:10 +02:00
test_dupefilters.py Merge pull request #1388 from scrapy/dupefilter-persist 2015-08-11 14:16:34 -03:00
test_engine.py deprecate Spider.make_requests_from_url. Fixes #1495. 2017-02-16 03:39:34 +05:00
test_exporters.py Fixed bug on XMLItemExporter with non-string fields in items 2016-01-30 10:00:06 -02:00
test_feedexport.py [MRG+1] Automatic port selection for servicies in unit tests (#3210) 2018-05-23 21:25:50 +03:00
test_http_cookies.py Update asserts to use more generic ones 2017-08-09 12:52:10 +02:00
test_http_headers.py normalize header values to bytes 2014-08-01 00:02:50 -03:00
test_http_request.py Corrected Test 2018-03-03 20:07:50 +05:30
test_http_response.py [MRG+1] Fix part of issue #3128 - None should not be a valid type for 'url' in Response.follow (#3131) 2018-02-22 03:37:26 +05:00
test_item.py Force Travis CI to test again 2017-08-04 14:35:43 +02:00
test_link.py PY3 raise an exception if bytes are passed as url to Link constructor 2015-08-28 23:04:02 +05:00
test_linkextractors.py TST fixed compatibility with new link extractor whitespace handling 2017-02-21 00:05:40 +05:00
test_linkextractors_deprecated.py TST fixed compatibility with new link extractor whitespace handling 2017-02-21 00:05:40 +05:00
test_loader.py Update asserts to use more generic ones 2017-08-09 12:52:10 +02:00
test_logformatter.py [logformatter] backward compat comments 2017-03-17 08:11:20 +01:00
test_mail.py (fixes #2272) using arg_to_iter() to wrap single values and list() to avoid consuming from generators. 2016-10-18 11:06:55 -03:00
test_middleware.py PY3 fix test middleware 2015-07-29 13:51:01 +00:00
test_pipeline_crawl.py [MRG+1] Automatic port selection for servicies in unit tests (#3210) 2018-05-23 21:25:50 +03:00
test_pipeline_files.py added test for gcs policy 2018-04-03 18:06:34 +09:00
test_pipeline_images.py Update deprecated test aliases 2017-08-09 12:52:10 +02:00
test_pipeline_media.py Refactor settings tests 2017-03-03 17:03:25 +01:00
test_proxy_connect.py [MRG+1] Automatic port selection for servicies in unit tests (#3210) 2018-05-23 21:25:50 +03:00
test_pydispatch_deprecated.py add deprecation for pydispatch (thanks for the help @redapple) 2016-02-11 16:15:28 -02:00
test_responsetypes.py Merge pull request #1503 from demelziraptor/amazon-json-response 2016-09-12 13:21:16 -03:00
test_selector.py Update deprecated test aliases 2017-08-09 12:52:10 +02:00
test_selector_csstranslator.py cleanup tests for selectors and translators 2015-08-11 14:09:34 -03:00
test_spider.py Merge pull request #2854 from jenya/2853-sitemap-follow-alternate-fix 2017-08-21 19:15:03 +05:00
test_spidermiddleware_depth.py Update deprecated test aliases 2017-08-09 12:52:10 +02:00
test_spidermiddleware_httperror.py [MRG+1] Automatic port selection for servicies in unit tests (#3210) 2018-05-23 21:25:50 +03:00
test_spidermiddleware_offsite.py checking for subclass of URLWarning instead of checking error message text when URL in allowed_domains 2017-11-26 20:07:04 +01:00
test_spidermiddleware_referer.py Update deprecated test aliases 2017-08-09 12:52:10 +02:00
test_spidermiddleware_urllength.py Update deprecated test aliases 2017-08-09 12:52:10 +02:00
test_spiderstate.py TST remove temporary files and folders 2017-02-16 17:50:38 +05:00
test_squeues.py Update test for unpickable objects 2018-02-08 15:03:57 -03:00
test_stats.py enable test_stats and test_utils_log tests in Python 3 2015-08-26 01:58:59 +05:00
test_toplevel.py drop deprecated "optional_features" set 2015-09-15 09:00:08 +00:00
test_urlparse_monkeypatches.py Update deprecated test aliases 2017-08-09 12:52:10 +02:00
test_utils_conf.py Validate values for components order 2017-02-07 09:13:57 -03:00
test_utils_console.py Add support for bpython console. 2015-08-21 01:12:58 +01:00
test_utils_datatypes.py Update deprecated test aliases 2017-08-09 12:52:10 +02:00
test_utils_defer.py Update deprecated test aliases 2017-08-09 12:52:10 +02:00
test_utils_deprecate.py Ignore ScrapyDeprecationWarning warnings properly. 2015-06-09 18:22:03 +03:00
test_utils_gz.py Modifying existing gzip read failure recovery mechanism to patch read for broken archives 2016-08-11 18:21:42 +05:30
test_utils_http.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_utils_httpobj.py move tests under root dir 2014-07-30 19:45:08 -03:00
test_utils_iterators.py Update deprecated test aliases 2017-08-09 12:52:10 +02:00
test_utils_log.py Replace FailureFormatter with direct exc_info conversions in log calls 2015-05-15 05:46:14 -03:00
test_utils_project.py Update deprecated test aliases 2017-08-09 12:52:10 +02:00
test_utils_python.py Fix get_func_args test for pypy3 2017-12-25 14:48:10 +03:00
test_utils_reqser.py make reqser tests create Request with proper callback/errback 2017-06-05 17:26:52 -03:00
test_utils_request.py Do not fail representing non-http requests 2015-08-10 14:10:58 -03:00
test_utils_response.py response_status_message should not fail on non-standard HTTP codes 2016-03-12 14:16:40 +01:00
test_utils_serialize.py Add set serialization to ScrapyJSONEncoder 2016-07-22 17:20:03 -04:00
test_utils_signal.py Update asserts to use more generic ones 2017-08-09 12:52:10 +02:00
test_utils_sitemap.py handle relative sitemap urls in robots.txt 2016-12-01 09:53:40 -03:00
test_utils_spider.py Move scrapy/contrib/spiders to scrapy/spiders 2015-04-29 21:27:19 -03:00
test_utils_template.py Test utils.template.render_templatefile() 2015-08-26 20:44:33 +03:00
test_utils_trackref.py PY3: port scrapy.utils.trackref 2015-08-10 15:13:29 -03:00
test_utils_url.py Fix strip_url() tests 2017-03-01 20:59:52 +01:00
test_webclient.py Update asserts to use more generic ones 2017-08-09 12:52:10 +02:00