From 13d0ecde77cc33a8f81d7165a47ed2dc9c2c5a58 Mon Sep 17 00:00:00 2001 From: Elias Dorneles Date: Thu, 26 Mar 2015 15:26:16 -0300 Subject: [PATCH] addressing more review comments, to avoid ambiguity on desired reading flow --- docs/intro/overview.rst | 29 +++++++++++++++++------------ 1 file changed, 17 insertions(+), 12 deletions(-) diff --git a/docs/intro/overview.rst b/docs/intro/overview.rst index d93797cae..65b26613d 100644 --- a/docs/intro/overview.rst +++ b/docs/intro/overview.rst @@ -17,11 +17,8 @@ crawler. Walk-through of an example spider ================================= -In order to show you what Scrapy brings to the table, we'll walk you -through an example of a Scrapy Spider using the simplest way to run a spider. - -Once you're ready to dive in more, you can :ref:`follow the tutorial -and build a full-blown Scrapy project `. +In order to show you what Scrapy brings to the table, we'll walk you through an +example of a Scrapy Spider using the simplest way to run a spider. So, here's the code for a spider that follows the links to the top voted questions on StackOverflow and scrapes some data from each page:: @@ -144,10 +141,18 @@ scraping easy and efficient, such as: * Robust encoding support and auto-detection, for dealing with foreign, non-standard and broken encoding declarations. -* Strong :ref:`extensibility support ` and lots of built-in - extensions and middlewares to handle things like cookies, crawl throttling, - HTTP caching, HTTP compression, user-agent spoofing, robots.txt, - stats collection and many more. +* :ref:`Strong extensibility support `, allowing you to plug + in your own functionality using :ref:`signals ` and a + well-defined API (middlewares, :ref:`extensions `, and + :ref:`pipelines `). + +* Wide range of built-in extensions and middlewares for handling: + * cookies and session handling + * HTTP features like compression, authentication, caching + * user-agent spoofing + * robots.txt + * crawl depth restriction + * and more * A :ref:`Telnet console ` for hooking into a Python console running inside your Scrapy process, to introspect and debug your @@ -161,11 +166,11 @@ scraping easy and efficient, such as: What's next? ============ -The next obvious steps for you are to `download Scrapy`_, read :ref:`the -tutorial ` and join `the community`_. Thanks for your +The next steps for you are to :ref:`install Scrapy `, +:ref:`follow through the tutorial ` to learn how to organize +your code in Scrapy projects and `join the community`_. Thanks for your interest! -.. _download Scrapy: http://scrapy.org/download/ .. _the community: http://scrapy.org/community/ .. _screen scraping: http://en.wikipedia.org/wiki/Screen_scraping .. _web scraping: http://en.wikipedia.org/wiki/Web_scraping