8 Commits

Author	SHA1	Message	Date
Mikhail Korobov	2b4d46315f	TST fixed compatibility with new link extractor whitespace handling	2017-02-21 00:05:40 +05:00
Mikhail Korobov	df446d167f	fix deprecated link extractors	2017-02-20 23:01:14 +05:00
Mikhail Korobov	d079e15fe2	Strip leading/trailing whitespaces in link extractors. Fixes GH-838.	2017-02-16 02:22:17 +05:00
Paul Tremberth	7b5243a263	Add link extractor test for non-ASCII characters in query part of URL	2016-04-09 15:15:01 +02:00
Paul Tremberth	1656fbcffa	Fix link extractor tests for non-ASCII characters from latin1 document ... URL path component should use UTF-8 before percent-encoding (that's what browsers do when you open scrapy/tests/sample_data/link_extractor/linkextractor_latin1.html and follow the links) This matches current w3lib v1.14.1	2016-04-08 23:25:50 +02:00
Pengyu CHEN	94486bb294	added: Test case for the fix.	2015-11-02 23:00:42 +08:00
Mikhail Korobov	9bfe6ece59	Merge branch 'master' into py3-linkextractors ... Conflicts: scrapy/linkextractors/lxmlhtml.py tests/test_linkextractors.py	2015-08-28 04:53:32 +05:00
Mikhail Korobov	f2edbd05de	PY3 port LinkExtractor ... * tests for other link extractors are moved to test_linkextractors_deprecated.py * in Python 3 Link is converted to use native strings for urls * minor cleanups	2015-08-28 04:11:30 +05:00