scrapy/tests
Paul Tremberth db40852892 Do not interpret non-ASCII bytes in "Location" and percent-encode them (#2322)
* Do not interpret non-ASCII bytes in "Location" and percent-encode them

Fixes GH-2321

The idea is to not guess the encoding of "Location" header value
and simply percent-encode non-ASCII bytes,
which should then be re-interpreted correctly by the remote website
in whatever encoding was used originally.

See https://tools.ietf.org/html/rfc3987#section-3.2

This is similar to the changes to safe_url_string in
https://github.com/scrapy/w3lib/pull/45

* Remove unused import
2016-10-19 23:26:12 -03:00
..
keys Add HTTPS tests with non-hostname-maching server certificate 2016-04-20 14:42:03 +02:00
mocks
…
sample_data Modifying existing gzip read failure recovery mechanism to patch read for broken archives 2016-08-11 18:21:42 +05:30
test_cmdline
…
test_settings
…
test_spiderloader
…
test_utils_misc move tests under root dir 2014-07-30 19:45:08 -03:00
__init__.py
…
mockserver.py
…
py3-ignores.txt
…
requirements-py3.txt
…
requirements.txt
…
spiders.py
…
test_closespider.py
…
test_command_fetch.py
…
test_command_parse.py Moved parse command tests to its own file. Added some checks to check for logged errors. 2016-09-19 05:33:05 +02:00
test_command_shell.py Add shell test for using scrapy.Request() directly without importing scrapy 2016-09-15 19:25:20 +02:00
test_command_version.py
…
test_commands.py Moved parse command tests to its own file. Added some checks to check for logged errors. 2016-09-19 05:33:05 +02:00
test_contracts.py
…
test_crawl.py
…
test_crawler.py
…
test_dependencies.py
…
test_downloader_handlers.py
…
test_downloadermiddleware.py
…
test_downloadermiddleware_ajaxcrawlable.py
…
test_downloadermiddleware_cookies.py
…
test_downloadermiddleware_decompression.py
…
test_downloadermiddleware_defaultheaders.py
…
test_downloadermiddleware_downloadtimeout.py
…
test_downloadermiddleware_httpauth.py
…
test_downloadermiddleware_httpcache.py
…
test_downloadermiddleware_httpcompression.py
…
test_downloadermiddleware_httpproxy.py
…
test_downloadermiddleware_redirect.py Do not interpret non-ASCII bytes in "Location" and percent-encode them (#2322) 2016-10-19 23:26:12 -03:00
test_downloadermiddleware_retry.py
…
test_downloadermiddleware_robotstxt.py
…
test_downloadermiddleware_stats.py
…
test_downloadermiddleware_useragent.py
…
test_dupefilters.py
…
test_engine.py
…
test_exporters.py
…
test_feedexport.py Feed exporter: start exporting only on first item 2016-09-17 01:36:56 +02:00
test_http_cookies.py
…
test_http_headers.py
…
test_http_request.py
…
test_http_response.py
…
test_item.py
…
test_link.py
…
test_linkextractors.py
…
test_linkextractors_deprecated.py
…
test_loader.py
…
test_logformatter.py
…
test_mail.py
…
test_middleware.py
…
test_pipeline_files.py [image & file pipeline] loading setting for user classes 2016-09-15 09:39:16 +02:00
test_pipeline_images.py [image & file pipeline] loading setting for user classes 2016-09-15 09:39:16 +02:00
test_pipeline_media.py
…
test_proxy_connect.py
…
test_pydispatch_deprecated.py
…
test_responsetypes.py Merge pull request #1503 from demelziraptor/amazon-json-response 2016-09-12 13:21:16 -03:00
test_selector.py
…
test_selector_csstranslator.py
…
test_spider.py
…
test_spidermiddleware_depth.py
…
test_spidermiddleware_httperror.py
…
test_spidermiddleware_offsite.py
…
test_spidermiddleware_referer.py
…
test_spidermiddleware_urllength.py
…
test_spiderstate.py
…
test_squeues.py
…
test_stats.py
…
test_toplevel.py
…
test_urlparse_monkeypatches.py
…
test_utils_conf.py
…
test_utils_console.py Add support for bpython console. 2015-08-21 01:12:58 +01:00
test_utils_datatypes.py
…
test_utils_defer.py
…
test_utils_deprecate.py
…
test_utils_gz.py Modifying existing gzip read failure recovery mechanism to patch read for broken archives 2016-08-11 18:21:42 +05:30
test_utils_http.py
…
test_utils_httpobj.py
…
test_utils_iterators.py
…
test_utils_log.py
…
test_utils_project.py test abs path outside project as well 2016-09-30 15:07:58 -03:00
test_utils_python.py
…
test_utils_reqser.py
…
test_utils_request.py
…
test_utils_response.py
…
test_utils_serialize.py
…
test_utils_signal.py
…
test_utils_sitemap.py
…
test_utils_spider.py
…
test_utils_template.py
…
test_utils_trackref.py
…
test_utils_url.py Use w3lib.url.canonicalize_url() from w3lib 1.15.0 2016-08-16 17:42:16 +05:30
test_webclient.py
…