RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Merge remote-tracking branch 'upstream/master' into cancel-request-download

This commit is contained in:
Eugenio Lacuesta 2020-05-27 10:27:45 -03:00
parent fbe915d9cb b82a480e91
commit 634ad5ebca
No known key found for this signature in database
GPG Key ID: DA3EF2D0913E9810
2 changed files with 9 additions and 6 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

12
docs/topics/item-pipeline.rst
View File

@ -167,11 +167,13 @@ method and how to clean up the resources properly.::
Take screenshot of item Take screenshot of item
----------------------- -----------------------
This example demonstrates how to return a This example demonstrates how to use :doc:`coroutine syntax <coroutines>` in
:class:`~twisted.internet.defer.Deferred` from the :meth:`process_item` method. the :meth:`process_item` method.
It uses Splash_ to render screenshot of item url. Pipeline
makes request to locally running instance of Splash_. After request is downloaded, This item pipeline makes a request to a locally-running instance of Splash_ to
it saves the screenshot to a file and adds filename to the item. render a screenshot of the item URL. After the request response is downloaded,
the item pipeline saves the screenshot to a file and adds the filename to the
item.
:: ::

3
tests/requirements-py3.txt
View File

@ -2,7 +2,8 @@
jmespath jmespath
mitmproxy; python_version >= '3.6' mitmproxy; python_version >= '3.6'
mitmproxy<4.0.0; python_version < '3.6' mitmproxy<4.0.0; python_version < '3.6'
pytest < 5.4 # https://github.com/pytest-dev/pytest-twisted/issues/93
pytest != 5.4, != 5.4.1
pytest-cov pytest-cov
pytest-twisted >= 1.11 pytest-twisted >= 1.11
pytest-xdist pytest-xdist