RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
5,661 Commits 49 Branches 132 Tags 144 MiB
Commit Graph

5661 Commits

Author SHA1 Message Date
Paul Tremberth cbd0bbb829 Bump version: 1.1.1 → 1.1.2 2016-08-18 16:34:36 +02:00
Paul Tremberth 514682f53a Merge pull request #2184 from redapple/release-notes-1.1.2 
Add release notes for 1.1.2 version
 2016-08-18 16:31:36 +02:00
Paul Tremberth 05787d09e7 Add release notes for 1.1.2 version 2016-08-18 16:18:27 +02:00
Paul Tremberth f3bd3995fb Merge pull request #2152 from scrapy/bumpversion-config-1.1 
[MRG+1] Better bumpversion config for branch 1.1
 2016-08-11 12:20:37 +02:00
Paul Tremberth 79afcd070c Merge pull request #2172 from redapple/backport-1.1-pr2140 
[backport][1.1][PR #2140] Fix IMAGES_EXPIRES default value back to 90
 2016-08-11 12:18:36 +02:00
Jesús Losada a486042fe5 Fix ImagesPipeline test settings 2016-08-11 11:56:04 +02:00
Jesús Losada 77ce43b5c4 Fix IMAGES_EXPIRES default value 
The default value should be 90.
 2016-08-11 11:55:42 +02:00
Paul Tremberth d9cb27a94c Merge pull request #2158 from redapple/backport-1.1-pr2138 
[backport][1.1] Apply the FILES_STORE_S3_ACL setting in ImagesPipeline (PR #2138)
 2016-08-01 16:13:57 +02:00
Elias Dorneles 73c8787b9c remove remaining prerelease configuration 2016-08-01 11:12:18 -03:00
Jesús Losada 2295499957 Add documentation on Amazon S3 ACLs 2016-08-01 15:56:18 +02:00
Jesús Losada f6def018a1 Document S3 capabilities in FilesPipeline and ImagesPipeline 2016-08-01 15:56:18 +02:00
Jesús Losada 097945702d Add the IMAGES_STORE_S3_ACL setting 2016-08-01 15:56:18 +02:00
Elias Dorneles 605edd2215 better bumpversion config for branch 1.1 
Having the part:prerel setup as it's right now, it's forcing releases to
go through a pre-release cycle dev1, rc1, before the actual release.

This is not desired for older branches, since they will mostly get
only minor and patch releases.
 2016-07-29 13:43:32 -03:00
Paul Tremberth 427d90a8ed Bump version: 1.1.0 → 1.1.1 2016-07-13 18:19:35 +02:00
Paul Tremberth f14cc821e9 Merge pull request #2113 from scrapy/release-notes-1.1.1 
Update release notes for upcoming 1.1.1 release
 2016-07-13 18:12:56 +02:00
Paul Tremberth 7e7c832f9f Update 1.1.1 release date 2016-07-13 17:59:11 +02:00
Paul Tremberth ed79193f49 Update notes with latest 1.1 commits 2016-07-13 17:49:17 +02:00
Paul Tremberth 51ed24904b Update release notes for upcoming 1.1.1 release 2016-07-13 17:36:48 +02:00
Kenneth Schnall 758802d41b Update practices.rst 2016-07-13 17:25:08 +02:00
Paul Tremberth e28392ca8c Merge pull request #2122 from redapple/backport-1.1-1989 
[backport][1.1] [image_pipeline] bring back uppercase class attributes (PR #1989)
 2016-07-13 17:19:36 +02:00
Pawel Miech 1f8b2c162b [image_pipeline] minor style tweaks 2016-07-13 17:02:13 +02:00
Pawel Miech 44e731898a [image_pipeline] dont use assert in doctest 2016-07-13 17:02:13 +02:00
Pawel Miech d40de1e013 [image_pipeline] style edits 
* 80 characters line limit
* shortening some code
* removed dead code
* add doctest for _key_for_pipe function
 2016-07-13 17:02:13 +02:00
Pawel Miech 0405750117 [FilesPipeline, ImagesPipeline] fix for cls attrs with DEFAULT prefix 
some class attributes for ImagePipeline and FilesPipeline had DEFAULT prefix. These
attributes should be preserved as well, if users subclasses define values for
DEFAULT_<CLS_ATTRIBUTE_NAME> attribute this value should be preserved.
 2016-07-13 17:02:13 +02:00
Pawel Miech d9a9f76ca0 [files-pipeline] update docs with note about settings 
for subclasses.
 2016-07-13 17:02:13 +02:00
Pawel Miech 516618752b [media-pipeline, file-pipeline] allow setting custom settings for subclasses 
* move key_for_pipe function to media pipeline so that file pipeline can use it
* use key_for_pipe in file pipeline so that users can define custom settings for subclasses easily
* add tests for file pipelines attributes and settings
 2016-07-13 17:02:13 +02:00
Pawel Miech 0957f078bd [files_pipeline] ensure class attributes are preserved 
dont override class attributes with default settings (same as in image pipeline).
 2016-07-13 17:02:13 +02:00
Pawel Miech b3591eadaa [files_pipeline] unify tests for files pipeline 
if test tests same thing but for different field it can be unified into one.
 2016-07-13 17:02:13 +02:00
Pawel Miech 20a74dd27a [image_pipeline] another test for subclass inheritance 
test case when subclass inherits from base class and has no attributes nor
settings defined.
 2016-07-13 17:02:13 +02:00
Pawel Miech df4cda79d2 [image_pipeline] refactor and simplify tests for image settings 
unify tests that test same thing for different attribute values into one. Add
better docstrings for tests.
 2016-07-13 17:02:12 +02:00
Pawel Miech dec04d50fa [image_pipeline] unify and simplify tests for setting loading 
there was identical test for different setting keys. I unified it into
one unit test.

Fixes comments for tests, adds comments about intention of uppercase attrs.

Adds another test for user defined setting keys and uppercase attrs.
 2016-07-13 17:02:12 +02:00
Pawel Miech c6277c9963 [image-pipeline] image settings with class name 
allow to have image settings with class name, so that settings for user defined ImagePipeline
subclasses can be defined easily.
 2016-07-13 17:02:12 +02:00
Pawel Miech 6bec0f773b [image_pipeline] tests for class attrs backward compatibility 
and docs about image pipeline settings.
 2016-07-13 17:02:12 +02:00
Pawel Miech 3fce2842ea [image_pipeline] bring back uppercase pipeline attributes 
allow users to have class attributes on image pipelines. This assumes
that class attributes are useful if users want to have different pipeline
classes inhriting from ImagePipeline.
 2016-07-13 17:02:12 +02:00
Paul Tremberth 308da48806 Merge pull request #2121 from redapple/backport-1.1-2094 
[backport][1.1] Catch and ignore certification verification exception for IP-address hosts (PR #2094)
 2016-07-13 16:46:15 +02:00
Paul Tremberth 1b7b87def1 Change wording of warning + docstring for ScrapyClientTLSOptions 2016-07-13 16:24:46 +02:00
Paul Tremberth 498719686c Rephrase warning 2016-07-13 16:24:46 +02:00
Paul Tremberth d2585704b8 Catch and ignore TLS verification exception for IP-address hosts 
Fixes GH-2092
 2016-07-13 16:24:46 +02:00
Paul Tremberth 0774b52245 Merge pull request #2112 from redapple/backport-1.1-pr2065 
[backport][1.1] Do not decompress binary/octet-stream responses (PR #2065)
 2016-07-11 13:37:08 +02:00
Paul Tremberth bda448f17d [HttpCompressionMiddleware] Do not decompress binary/octet-stream responses 2016-07-11 12:37:35 +02:00
Elias Dorneles a40f7c7a86 Merge pull request #2107 from redapple/backport-1.1-pr2052 
[backport][1.1] Enable genspider command outside project folder (PR #2052)
 2016-07-08 14:53:51 -03:00
Elias Dorneles 5b1531b077 Merge pull request #2106 from redapple/backport-1.1-pr2050 
[backport][1.1] Is_gzipped for application/x-gzip;charset=utf-8 (PR #2050)
 2016-07-08 14:53:41 -03:00
Valdir Stumm Junior 848bd4c2a2 document new genspider behavior 2016-07-08 18:48:39 +02:00
Valdir Stumm Junior e239246f4b remove references to Item classes in templates 2016-07-08 18:48:39 +02:00
Valdir Stumm Junior acb0c325aa enable genspider command outside projects 2016-07-08 18:48:39 +02:00
Joakim Uddholm 92bde95874 is_gzipped: Separated tests again. 2016-07-08 18:30:34 +02:00
Joakim Uddholm 658b6a6dcd is_gzipped: improved readability 2016-07-08 18:30:34 +02:00
Joakim Uddholm 27cbcbcdaf is_gzipped: Changed to regex to check the content-type header. Also suggested by @redapple. 2016-07-08 18:30:34 +02:00
Joakim Uddholm 346a376f5b Added new testcases suggested by @redapple. 2016-07-08 18:30:34 +02:00
Joakim Uddholm 5c511a29ec Separated tests based on case 2016-07-08 18:30:34 +02:00