From cb5280ab0da22a6e4ff5a78b693996b71e37214c Mon Sep 17 00:00:00 2001 From: Mikhail Korobov Date: Wed, 15 Apr 2015 19:25:22 +0500 Subject: [PATCH] DOC tweak deployment docs --- docs/topics/deploy.rst | 65 +++++++++++++++++------------------------- 1 file changed, 26 insertions(+), 39 deletions(-) diff --git a/docs/topics/deploy.rst b/docs/topics/deploy.rst index e2e796cf7..b7394d5ce 100644 --- a/docs/topics/deploy.rst +++ b/docs/topics/deploy.rst @@ -11,57 +11,44 @@ when you need to execute long-running spiders or move spiders to run in production continously. This is where the solutions for deploying Scrapy spiders come in. -The most popular choices, for deploying Scrapy spiders, are: +Popular choices for deploying Scrapy spiders are: -* :ref:`Scrapy Cloud ` (cloud-based, easier to setup) -* :ref:`Scrapyd ` (open source, harder to setup) - -.. _deploy-scrapy-cloud: - -Deploying to Scrapy Cloud -========================= - -`Scrapy Cloud`_ is a hosted, cloud-based service by `Scrapinghub`_, the company -behind Scrapy. - -Advantages: - -- easy to setup (no need to setup or manage servers) -- well-designed UI to manage spiders and review scraped items, logs and stats -- cheap pricing (cheaper than renting a server, for small workloads) - -Disadvantages: - -- it's not open source - -To deploy spiders to Scrapy Cloud you can use the `shub`_ command line tool. -Please refer to the `Scrapy Cloud documentation`_ for more information. - -The configuration is read from the ``scrapy.cfg`` file just like -``scrapyd-deploy``. +* :ref:`Scrapyd ` (open source) +* :ref:`Scrapy Cloud ` (cloud-based) .. _deploy-scrapyd: Deploying to a Scrapyd Server ============================= -`Scrapyd`_ is an open source application to run Scrapy spiders. It is -maintained by some of the Scrapy developers. - -Advantages: - -- it's open source, so it can be installed and run anywhere - -Disadvantages: - -- simple UI (no analytics, graphs or rich log/items browsing) -- requires setting up servers, installing and configuring scrapyd on them. An - APT repo with Ubuntu packages is provided by the Scrapyd team +`Scrapyd`_ is an open source application to run Scrapy spiders. It provides +a server with HTTP API, capable of running and monitoring Scrapy spiders. To deploy spiders to Scrapyd, you can use the scrapyd-deploy tool provided by the `scrapyd-client`_ package. Please refer to the `scrapyd-deploy documentation`_ for more information. +Scrapyd is maintained by some of the Scrapy developers. + +.. _deploy-scrapy-cloud: + +Deploying to Scrapy Cloud +========================= + +`Scrapy Cloud`_ is a hosted, cloud-based service by `Scrapinghub`_, +the company behind Scrapy. + +Scrapy Cloud removes the need to setup and monitor servers +and provides a nice UI to manage spiders and review scraped items, +logs and stats. + +To deploy spiders to Scrapy Cloud you can use the `shub`_ command line tool. +Please refer to the `Scrapy Cloud documentation`_ for more information. + +Scrapy Cloud is compatible with Scrapyd and one can switch between +them as needed - the configuration is read from the ``scrapy.cfg`` file +just like ``scrapyd-deploy``. + .. _Scrapyd: https://github.com/scrapy/scrapyd .. _Deploying your project: https://scrapyd.readthedocs.org/en/latest/deploy.html .. _Scrapy Cloud: http://scrapinghub.com/scrapy-cloud/