mirror of https://github.com/scrapy/scrapy.git
Use https:// for readthedocs links
This commit is contained in:
parent
d847e65aae
commit
fad6b70d92
|
|
@ -107,7 +107,7 @@ Python virtualenvs can be created to use Python 2 by default, or Python 3 by def
|
|||
|
||||
.. _virtualenv: https://virtualenv.pypa.io
|
||||
.. _virtualenv installation instructions: https://virtualenv.pypa.io/en/stable/installation/
|
||||
.. _virtualenvwrapper: http://virtualenvwrapper.readthedocs.io/en/latest/install.html
|
||||
.. _virtualenvwrapper: https://virtualenvwrapper.readthedocs.io/en/latest/install.html
|
||||
.. _user guide: https://virtualenv.pypa.io/en/stable/userguide/
|
||||
|
||||
|
||||
|
|
|
|||
|
|
@ -12,7 +12,7 @@ but quite a few handy improvements nonetheless.
|
|||
Scrapy now supports anonymous FTP sessions with customizable user and
|
||||
password via the new :setting:`FTP_USER` and :setting:`FTP_PASSWORD` settings.
|
||||
And if you're using Twisted version 17.1.0 or above, FTP is now available
|
||||
with Python 3.
|
||||
with Python 3.
|
||||
|
||||
There's a new :meth:`response.follow <scrapy.http.TextResponse.follow>` method
|
||||
for creating requests; **it is now a recommended way to create Requests
|
||||
|
|
@ -407,7 +407,7 @@ Refactoring
|
|||
|
||||
- ``canonicalize_url`` has been moved to `w3lib.url`_ (:issue:`2168`).
|
||||
|
||||
.. _w3lib.url: http://w3lib.readthedocs.io/en/latest/w3lib.html#w3lib.url.canonicalize_url
|
||||
.. _w3lib.url: https://w3lib.readthedocs.io/en/latest/w3lib.html#w3lib.url.canonicalize_url
|
||||
|
||||
Tests & Requirements
|
||||
~~~~~~~~~~~~~~~~~~~~
|
||||
|
|
|
|||
|
|
@ -543,7 +543,7 @@ Example::
|
|||
|
||||
COMMANDS_MODULE = 'mybot.commands'
|
||||
|
||||
.. _Deploying your project: http://scrapyd.readthedocs.org/en/latest/deploy.html
|
||||
.. _Deploying your project: https://scrapyd.readthedocs.io/en/latest/deploy.html
|
||||
|
||||
Register commands via setup.py entry points
|
||||
-------------------------------------------
|
||||
|
|
|
|||
|
|
@ -50,10 +50,10 @@ them as needed - the configuration is read from the ``scrapy.cfg`` file
|
|||
just like ``scrapyd-deploy``.
|
||||
|
||||
.. _Scrapyd: https://github.com/scrapy/scrapyd
|
||||
.. _Deploying your project: https://scrapyd.readthedocs.org/en/latest/deploy.html
|
||||
.. _Deploying your project: https://scrapyd.readthedocs.io/en/latest/deploy.html
|
||||
.. _Scrapy Cloud: http://scrapinghub.com/scrapy-cloud/
|
||||
.. _scrapyd-client: https://github.com/scrapy/scrapyd-client
|
||||
.. _shub: http://doc.scrapinghub.com/shub.html
|
||||
.. _scrapyd-deploy documentation: http://scrapyd.readthedocs.org/en/latest/deploy.html
|
||||
.. _scrapyd-deploy documentation: https://scrapyd.readthedocs.io/en/latest/deploy.html
|
||||
.. _Scrapy Cloud documentation: http://doc.scrapinghub.com/scrapy-cloud.html
|
||||
.. _Scrapinghub: http://scrapinghub.com/
|
||||
|
|
|
|||
|
|
@ -208,7 +208,7 @@ and Deferred callback fires, it saves item to a file and adds filename to an ite
|
|||
item["screenshot_filename"] = filename
|
||||
return item
|
||||
|
||||
.. _Splash: http://splash.readthedocs.io/en/stable/
|
||||
.. _Splash: https://splash.readthedocs.io/en/stable/
|
||||
.. _Deferred: https://twistedmatrix.com/documents/current/core/howto/defer.html
|
||||
|
||||
Duplicates filter
|
||||
|
|
|
|||
|
|
@ -10,4 +10,4 @@ Scrapyd has been moved into a separate project.
|
|||
|
||||
Its documentation is now hosted at:
|
||||
|
||||
http://scrapyd.readthedocs.org/en/latest/
|
||||
https://scrapyd.readthedocs.io/en/latest/
|
||||
|
|
|
|||
|
|
@ -80,7 +80,7 @@ scrapy.Spider
|
|||
allowed to crawl. Requests for URLs not belonging to the domain names
|
||||
specified in this list (or their subdomains) won't be followed if
|
||||
:class:`~scrapy.spidermiddlewares.offsite.OffsiteMiddleware` is enabled.
|
||||
|
||||
|
||||
Let's say your target url is ``https://www.example.com/1.html``,
|
||||
then add ``'example.com'`` to the list.
|
||||
|
||||
|
|
@ -756,4 +756,4 @@ Combine SitemapSpider with other sources of urls::
|
|||
.. _Sitemap index files: http://www.sitemaps.org/protocol.html#index
|
||||
.. _robots.txt: http://www.robotstxt.org/
|
||||
.. _TLD: https://en.wikipedia.org/wiki/Top-level_domain
|
||||
.. _Scrapyd documentation: http://scrapyd.readthedocs.org/en/latest/
|
||||
.. _Scrapyd documentation: https://scrapyd.readthedocs.io/en/latest/
|
||||
|
|
|
|||
Loading…
Reference in New Issue