RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Edit text

This commit is contained in:
Paul Tremberth 2017-01-26 12:09:34 +01:00
parent eb07285a63
commit 605935f015
1 changed files with 3 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
docs/topics/spider-middleware.rst
View File

@ -363,12 +363,12 @@ It can also be the non-standard value ``"scrapy-default"`` to use
Scrapy's default referrer policy.
Scrapy's default referrer policy is a variant of `"no-referrer-when-downgrade"`_,
with the addition that "Referrer" is not sent if the parent request was
with the addition that "Referer" is not sent if the parent request was
using ``file://`` or ``s3://`` scheme.
.. warning::
Scrapy's default referrer policy—just like `"no-referrer-when-downgrade"`_,
the W3C-recommended value for browsers—will send a non-empty
Scrapy's default referrer policy — just like `"no-referrer-when-downgrade"`_,
the W3C-recommended value for browsers — will send a non-empty
"Referer" header from any ``http(s)://`` to any ``https://`` URL,
even if the domain is different.
`"same-origin"`_ may be a better choice if you want to remove referrer