RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Document S3 capabilities in FilesPipeline and ImagesPipeline

This commit is contained in:
Jesús Losada 2016-07-22 19:32:29 +02:00
parent f72991a96b
commit c6a2ca4e93
2 changed files with 18 additions and 10 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

19
docs/topics/media-pipeline.rst
View File

@ -117,7 +117,7 @@ Supported Storage
=================
File system is currently the only officially supported storage, but there is
also (undocumented) support for storing files in `Amazon S3`_.
also support for storing files in `Amazon S3`_.
.. _Amazon S3: https://aws.amazon.com/s3/
@ -146,6 +146,23 @@ Where:
* ``full`` is a sub-directory to separate full images from thumbnails (if
used). For more info see :ref:`topics-images-thumbnails`.
Amazon S3 storage
-----------------
.. setting:: FILES_STORE_S3_ACL
.. setting:: IMAGES_STORE_S3_ACL
:setting:`FILES_STORE` and :setting:`IMAGES_STORE` can represent an Amazon S3
bucket. Scrapy will automatically upload the files to the bucket.
For example, this is a valid :setting:`IMAGES_STORE` value::
IMAGES_STORE = 's3://bucket/images'
You can modify the Access Control List (ACL) policy used for the stored files,
which is defined by the :setting:`FILES_STORE_S3_ACL` and
:setting:`IMAGES_STORE_S3_ACL` settings. By default, the ACL is set to
``private``.
Usage example
=============

9
docs/topics/settings.rst
View File

@ -689,15 +689,6 @@ temporary files before uploading with :ref:`FTP feed storage <topics-feed-storag
:ref:`Amazon S3 <topics-feed-storage-s3>`.
.. setting:: FILES_STORE_S3_ACL
FILES_STORE_S3_ACL
------------------
Default: ``'private'``
S3-specific access control policy (ACL) for S3 files store.
.. setting:: ITEM_PIPELINES
ITEM_PIPELINES