scrapy/scrapy/pipelines
Konstantin Lopuhin b01bf4728f Fix a race condition in the FilesPipeline
Checksum calculation could happen simultaniously with
persisting the file in the store (which is done in a thread):
they operated on the same buf object.
Concretely this lead to a bug with S3FilesStore
when using botocore: the signature did not match because
the position in the buf was already at the end.
The fix is to move checksum calculation before passing buf
to the store.
2016-03-31 12:00:26 +02:00
..
__init__.py Replace BaseSettings._getcomposite() with public .getwithbase() method 2015-11-11 17:39:57 +01:00
files.py Fix a race condition in the FilesPipeline 2016-03-31 12:00:26 +02:00
images.py PY3 fix tests pipelines images 2015-08-08 04:23:06 +05:00
media.py Replace FailureFormatter with direct exc_info conversions in log calls 2015-05-15 05:46:14 -03:00