20 Commits

Author	SHA1	Message	Date
vishesh10	e208f82076	Add support for multiple-compressed responses (#6063)	2024-02-22 12:16:24 +01:00
Adrián Chaves	9cc8703877	Protect against zstandard bombs	2023-11-22 17:53:00 +01:00
Adrián Chaves	fba167c5e1	Protect against brotli bombs	2023-11-22 17:32:09 +01:00
Adrián Chaves	0c4a98f8e0	Protect against deflate bombs	2023-11-22 17:12:43 +01:00
Adrián Chaves	6969041c5f	Protect against gzip bombs	2023-11-22 15:52:00 +01:00
spav	b386c64864	Fix tests for allowing duplicates in extract_links	2023-01-11 19:58:42 +01:00
FJMonteroInformatica	6a3f2ee687	HTML Conventions	2022-03-17 20:09:56 +01:00
P. Chen	50e1f35d1f	Adding test cases for the zstd content encoding	2020-10-05 23:43:12 +01:00
Artur Shellunts	62a4ede5e9	Remove deprecated classes BaseSgmlLinkExtractor, RegexLinkExtractor and SgmlLinkExtractor (#4356)	2020-07-17 12:40:04 +02:00
Eugenio Lacuesta	b602c61e1c	[Test] Rename outdated sample files	2019-11-20 09:38:54 -03:00
Eugenio Lacuesta	e1fa1fd8ad	TextResponse.follow_all: skip invalid links	2019-10-10 00:37:30 -03:00
Paul Tremberth	7dcc86e61a	Add file listing resource + redirecting resource to MockServer	2017-03-10 21:35:25 +01:00
Mikhail Korobov	47f7da8724	canonicalize=False by default for LinkExtractor. Fixes GH-1941.	2017-02-20 22:58:11 +05:00
Daniel Graña	4a93be4ad8	Merge pull request #2547 from scrapy/linkextractor-strip-whitespaces ... [MRG+1] LinkExtractors: strip whitespaces	2017-02-20 11:08:32 -03:00
Mikhail Korobov	d079e15fe2	Strip leading/trailing whitespaces in link extractors. Fixes GH-838.	2017-02-16 02:22:17 +05:00
Pawel Miech	16c4b4e184	[httpcompression] add support for br - brotli content encoding	2017-02-06 11:41:08 +01:00
rootavish	d9437fd3d9	Modifying existing gzip read failure recovery mechanism to patch read for broken archives	2016-08-11 18:21:42 +05:30
Paul Tremberth	7b5243a263	Add link extractor test for non-ASCII characters in query part of URL	2016-04-09 15:15:01 +02:00
Mikael Åhlén	47b6dff9f1	Allow to specify the quotechar in CSVFeedSpider	2014-09-13 02:14:57 +02:00
Daniel Graña	242c08553f	move tests under root dir	2014-07-30 19:45:08 -03:00