Extend docs about Crawling Rules

This commit is contained in:
Eugenio Lacuesta 2019-07-09 15:30:22 -03:00
parent d04e84c11d
commit 9fb0f8454e
No known key found for this signature in database
GPG Key ID: DA3EF2D0913E9810
1 changed files with 3 additions and 1 deletions

View File

@ -386,7 +386,9 @@ Crawling rules
the specified link extractor. This callback receives a :class:`~scrapy.http.Response`
as its first argument and must return either a single instance or an iterable of
:class:`~scrapy.item.Item`, ``dict`` and/or :class:`~scrapy.http.Request` objects
(or any subclass of them).
(or any subclass of them). As mentioned above, the received :class:`~scrapy.http.Response`
object will contain the text of the link that produced the :class:`~scrapy.http.Request`
in its ``meta`` dictionary (under the ``link_text`` key)
.. warning:: When writing crawl spider rules, avoid using ``parse`` as
callback, since the :class:`CrawlSpider` uses the ``parse`` method