Commit Graph

3 Commits

Author SHA1 Message Date
Paul Tremberth 5bf10cc8ff Fix tests on URL path encoding for links from latin1 document
UTF-8 is to be used for path component.
Page encoding only affects query part of URLs.
2016-04-07 22:43:47 +02:00
Andrew Scorpil 108195e780 [LinkExtractors] Ignore bogus links
(rebased the code for scrapy 1.0 and made a few code improvements --nyov)
2016-01-11 15:42:56 +01:00
Julia Medina cf064b1437 Move scrapy/contrib/linkextractors to scrapy/linkextractors 2015-04-29 21:24:30 -03:00