From 5f65c26080862777885acb199277e5fd64681ba3 Mon Sep 17 00:00:00 2001 From: Pablo Hoffman Date: Sat, 16 Oct 2010 19:02:08 -0200 Subject: [PATCH] Some minor improvements to feature list in Scrapy at a Glance documentation page --- docs/intro/overview.rst | 20 +++++++++++++++----- 1 file changed, 15 insertions(+), 5 deletions(-) diff --git a/docs/intro/overview.rst b/docs/intro/overview.rst index 7b4f490a0..080b3980d 100644 --- a/docs/intro/overview.rst +++ b/docs/intro/overview.rst @@ -212,9 +212,19 @@ scraping easy and efficient, such as: well-defined API (middlewares, :ref:`extensions `, and :ref:`pipelines `). -* Wide range of built-in middlewares and extensions for handling of - compression, cache, cookies, authentication, user-agent spoofing, robots.txt - handling, statistics, crawl depth restriction, etc +* Wide range of built-in middlewares and extensions for: + + * cookies and session handling + * HTTP compression + * HTTP authentication + * HTTP cache + * user-agent spoofing + * robots.txt + * crawl depth restriction + * and more + +* Robust encoding support and auto-detection, for dealing with foreign, + non-standard and broken encoding declarations. * Extensible :ref:`stats collection ` for multiple spider metrics, useful for monitoring the performance of your spiders and detecting @@ -233,8 +243,8 @@ scraping easy and efficient, such as: console running inside your Scrapy process, to introspect and debug your crawler -* Built-in :ref:`logging ` facility that you can hook to for - catching errors during the scraping process. +* :ref:`Logging ` facility that you can hook on to for catching + errors during the scraping process. What's next? ============