diff --git a/docs/intro/overview.rst b/docs/intro/overview.rst index 7b4f490a0..080b3980d 100644 --- a/docs/intro/overview.rst +++ b/docs/intro/overview.rst @@ -212,9 +212,19 @@ scraping easy and efficient, such as: well-defined API (middlewares, :ref:`extensions `, and :ref:`pipelines `). -* Wide range of built-in middlewares and extensions for handling of - compression, cache, cookies, authentication, user-agent spoofing, robots.txt - handling, statistics, crawl depth restriction, etc +* Wide range of built-in middlewares and extensions for: + + * cookies and session handling + * HTTP compression + * HTTP authentication + * HTTP cache + * user-agent spoofing + * robots.txt + * crawl depth restriction + * and more + +* Robust encoding support and auto-detection, for dealing with foreign, + non-standard and broken encoding declarations. * Extensible :ref:`stats collection ` for multiple spider metrics, useful for monitoring the performance of your spiders and detecting @@ -233,8 +243,8 @@ scraping easy and efficient, such as: console running inside your Scrapy process, to introspect and debug your crawler -* Built-in :ref:`logging ` facility that you can hook to for - catching errors during the scraping process. +* :ref:`Logging ` facility that you can hook on to for catching + errors during the scraping process. What's next? ============