17 Commits

Author	SHA1	Message	Date
Paul Tremberth	768f3155e5	Fix referrer policy from response headers and support explicit empty string	2017-03-06 16:20:37 +01:00
Paul Tremberth	efa50039ec	Add tests for policy fallback on unknown policies from meta and headers	2017-03-01 17:51:23 +01:00
Paul Tremberth	8226e77010	Add test for Referer header on HTTP redirections	2017-03-01 17:51:23 +01:00
Paul Tremberth	d2aa51c0fb	Update tests	2017-03-01 17:51:23 +01:00
Paul Tremberth	bc200d1155	Rename setting to REFERRER_POLICY (with 2 Rs)	2017-03-01 17:51:23 +01:00
Paul Tremberth	b6c761d2b4	Fix tests	2017-03-01 17:50:39 +01:00
Paul Tremberth	5cef67ae75	Update Referrer tests for "strict-" policies	2017-03-01 17:50:39 +01:00
Paul Tremberth	d3d4d66ce8	Add tests for referrer-policy set in response HTTP headers	2017-03-01 17:50:39 +01:00
Paul Tremberth	e50e670eff	Add test for custom referrer policy via settings	2017-03-01 17:50:39 +01:00
Paul Tremberth	0344f57fef	Support case-insensitive policy names in settings	2017-03-01 17:50:39 +01:00
Paul Tremberth	e72b6e3361	Add tests for referrer policy via settings and via Request meta	2017-03-01 17:50:39 +01:00
Paul Tremberth	7ec1b5f6c3	Add tests for the different referrer policies	2017-03-01 17:50:38 +01:00
Paul Tremberth	baed7c436f	WIP Add Referrer policies	2017-03-01 17:50:38 +01:00
Mikhail Korobov	ff24cbbc47	PY3 depth, offsite and referer spider middlewares; Crawler	2015-08-28 04:11:30 +05:00
Julia Medina	d3f576a816	Move scrapy/spider.py to scrapy/spiders/__init__.py	2015-05-09 04:20:09 -03:00
Julia Medina	180272c092	Move scrapy/contrib/spidermiddleware to scrapy/spidermiddlewares	2015-04-29 21:26:35 -03:00
Daniel Graña	242c08553f	move tests under root dir	2014-07-30 19:45:08 -03:00