minor corrections in documentation.

This commit is contained in:
bagratte 2015-04-19 18:58:15 +04:00
parent beea9267a1
commit 1312bcd007
4 changed files with 9 additions and 9 deletions

2
.gitignore vendored
View File

@ -12,4 +12,4 @@ dist
.idea .idea
# Windows # Windows
Thumbs.db Thumbs.db

View File

@ -8,7 +8,7 @@ Feed exports
One of the most frequently required features when implementing scrapers is One of the most frequently required features when implementing scrapers is
being able to store the scraped data properly and, quite often, that means being able to store the scraped data properly and, quite often, that means
generating a "export file" with the scraped data (commonly called "export generating an "export file" with the scraped data (commonly called "export
feed") to be consumed by other systems. feed") to be consumed by other systems.
Scrapy provides this functionality out of the box with the Feed Exports, which Scrapy provides this functionality out of the box with the Feed Exports, which
@ -21,7 +21,7 @@ Serialization formats
===================== =====================
For serializing the scraped data, the feed exports use the :ref:`Item exporters For serializing the scraped data, the feed exports use the :ref:`Item exporters
<topics-exporters>` and these formats are supported out of the box: <topics-exporters>`. These formats are supported out of the box:
* :ref:`topics-feed-format-json` * :ref:`topics-feed-format-json`
* :ref:`topics-feed-format-jsonlines` * :ref:`topics-feed-format-jsonlines`

View File

@ -5,14 +5,14 @@ Item Pipeline
============= =============
After an item has been scraped by a spider, it is sent to the Item Pipeline After an item has been scraped by a spider, it is sent to the Item Pipeline
which process it through several components that are executed sequentially. which processes it through several components that are executed sequentially.
Each item pipeline component (sometimes referred as just "Item Pipeline") is a Each item pipeline component (sometimes referred as just "Item Pipeline") is a
Python class that implements a simple method. They receive an item and perform Python class that implements a simple method. They receive an item and perform
an action over it, also deciding if the item should continue through the an action over it, also deciding if the item should continue through the
pipeline or be dropped and no longer processed. pipeline or be dropped and no longer processed.
Typical use for item pipelines are: Typical uses of item pipelines are:
* cleansing HTML data * cleansing HTML data
* validating scraped data (checking that the items contain certain fields) * validating scraped data (checking that the items contain certain fields)
@ -167,7 +167,7 @@ Duplicates filter
----------------- -----------------
A filter that looks for duplicate items, and drops those items that were A filter that looks for duplicate items, and drops those items that were
already processed. Let say that our items have an unique id, but our spider already processed. Let's say that our items have a unique id, but our spider
returns multiples items with the same id:: returns multiples items with the same id::
@ -198,6 +198,6 @@ To activate an Item Pipeline component you must add its class to the
} }
The integer values you assign to classes in this setting determine the The integer values you assign to classes in this setting determine the
order they run in- items go through pipelines from order number low to order in which they run: items go through from lower valued to higher
high. It's customary to define these numbers in the 0-1000 range. valued classes. It's customary to define these numbers in the 0-1000 range.

View File

@ -82,7 +82,7 @@ LxmlLinkExtractor
module. module.
:type deny_extensions: list :type deny_extensions: list
:param restrict_xpaths: is a XPath (or list of XPath's) which defines :param restrict_xpaths: is an XPath (or list of XPath's) which defines
regions inside the response where links should be extracted from. regions inside the response where links should be extracted from.
If given, only the text selected by those XPath will be scanned for If given, only the text selected by those XPath will be scanned for
links. See examples below. links. See examples below.