RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
5,686 Commits 49 Branches 132 Tags 141 MiB
Commit Graph

5686 Commits

Author SHA1 Message Date
Paul Tremberth ed6aa265ff Stricter requirements on Twisted (<17) and lxml (>=2.3) 2017-03-02 16:51:52 +01:00
Paul Tremberth 76c25798b7 Bump version: 1.1.2 → 1.1.3 2016-09-22 22:05:24 +02:00
Paul Tremberth 75dd45d9bb Merge pull request #2279 from scrapy/release-notes-1.1.3 
[1.1] Update release notes for upcoming 1.1.3 bugfix release
 2016-09-22 22:02:12 +02:00
Paul Tremberth 176b383b7e Set release date, fix typo and add tutorial improvement issue number 2016-09-22 21:33:05 +02:00
Elias Dorneles 4340693309 Merge pull request #2281 from redapple/backport-1.1-pr2252 
[backport][1.1][PR#2252] Rewrite tutorial seeking to improve learning path
 2016-09-22 14:25:50 -03:00
Paul Tremberth be06a4e397 Remove "scrapy" line from shell help (it's new in 1.2 only) 2016-09-22 19:14:00 +02:00
Paul Tremberth 517acf7d99 [backport][PR#2252] Rewrite tutorial seeking to improve learning path 2016-09-22 19:02:55 +02:00
Paul Tremberth 00ae4024b3 Update release notes for upcoming 1.1.3 bugfix release 2016-09-22 17:21:26 +02:00
Paul Tremberth 2453962e95 Merge pull request #2266 from redapple/backport-1.1-pr2243 
[backport][1.1][PR#2243][image & file pipeline] loading setting for user classes
 2016-09-20 10:53:46 +02:00
pawelmhm 8343ba5096 [image & file pipeline] loading setting for user classes 
if user has some custom subclass of Image pipeline and no setting for
this pipeline, he should get default settings defined for Image Pipeline.

Fixes #2198
 2016-09-19 18:45:15 +02:00
Elias Dorneles b27e41fc26 mentions stackoverflow as help channel (fixes #2255) 2016-09-19 11:52:04 +02:00
Wayne Lovely d638f893e8 Fix a dict key in the tutorial 2016-09-17 14:20:44 +02:00
Mikhail Korobov 2d8d7dd68d Merge pull request #2256 from scrapy/fix-overview-spider-1.1 
[backport][1.1] docs: update overview spider code to use toscrape.com and minor changes
 2016-09-17 06:07:37 +06:00
Elias Dorneles de052bbd1d use better condition in example spider 2016-09-16 15:58:17 -03:00
Elias Dorneles 511eb0d657 minor grammar fix 2016-09-16 15:58:17 -03:00
Elias Dorneles 45219ea079 docs: update overview spider code to use toscrape.com and minor changes 
So, this will replace the spider example code from the overview that
scrapes questions from StackOverflow by a spider scraping quotes (much
like the one in the tutorial), and upates the text around it to be
consistent.

There are also minor wording changes plus a small Sphinx/reST syntax fix
on the features list at the bottom (it was creating a definition list,
causing one line to be bold).
 2016-09-16 15:58:17 -03:00
Paul Tremberth 0a90cf46b5 Merge pull request #2247 from redapple/backport-1.1-tutorial-update 
[backport][1.1] Tutorial update (PR #2236)
 2016-09-15 18:37:13 +02:00
Elias Dorneles 19d57f59af updated tutorial as per review comments 2016-09-15 18:30:51 +02:00
Valdir Stumm Junior c1f4070d81 fix indentation issue 2016-09-15 18:29:59 +02:00
Valdir Stumm Junior 812474bb42 changed tutorial examples from dmoz to quotes.toscrape.com 2016-09-15 18:29:41 +02:00
Mikhail Korobov beb411d5b6 Merge pull request #2218 from mremes/patch-1 
[MRG+1] Update exceptions.rst
 2016-09-08 20:27:37 +06:00
Paul Tremberth a7fdb31a88 Merge pull request #2219 from scrapy/add-segment 
Add Segment Analytics to Documentation (backport to 1.1 branch)
 2016-09-05 15:04:01 +02:00
Valdir Stumm Junior 0f7a99e8f4 Add Segment Analytics to Documentation 2016-09-05 08:41:18 -03:00
Matti Remes e84d37a3fd Update exceptions.rst 
Added the missing dot.
 2016-09-04 21:50:46 +03:00
Matti Remes 38abd838ca Update exceptions.rst 
There are namely no constructors in classes in Python but an ``__init__`` method instead.
 2016-09-03 17:36:47 +03:00
Paul Tremberth cbd0bbb829 Bump version: 1.1.1 → 1.1.2 2016-08-18 16:34:36 +02:00
Paul Tremberth 514682f53a Merge pull request #2184 from redapple/release-notes-1.1.2 
Add release notes for 1.1.2 version
 2016-08-18 16:31:36 +02:00
Paul Tremberth 05787d09e7 Add release notes for 1.1.2 version 2016-08-18 16:18:27 +02:00
Paul Tremberth f3bd3995fb Merge pull request #2152 from scrapy/bumpversion-config-1.1 
[MRG+1] Better bumpversion config for branch 1.1
 2016-08-11 12:20:37 +02:00
Paul Tremberth 79afcd070c Merge pull request #2172 from redapple/backport-1.1-pr2140 
[backport][1.1][PR #2140] Fix IMAGES_EXPIRES default value back to 90
 2016-08-11 12:18:36 +02:00
Jesús Losada a486042fe5 Fix ImagesPipeline test settings 2016-08-11 11:56:04 +02:00
Jesús Losada 77ce43b5c4 Fix IMAGES_EXPIRES default value 
The default value should be 90.
 2016-08-11 11:55:42 +02:00
Paul Tremberth d9cb27a94c Merge pull request #2158 from redapple/backport-1.1-pr2138 
[backport][1.1] Apply the FILES_STORE_S3_ACL setting in ImagesPipeline (PR #2138)
 2016-08-01 16:13:57 +02:00
Elias Dorneles 73c8787b9c remove remaining prerelease configuration 2016-08-01 11:12:18 -03:00
Jesús Losada 2295499957 Add documentation on Amazon S3 ACLs 2016-08-01 15:56:18 +02:00
Jesús Losada f6def018a1 Document S3 capabilities in FilesPipeline and ImagesPipeline 2016-08-01 15:56:18 +02:00
Jesús Losada 097945702d Add the IMAGES_STORE_S3_ACL setting 2016-08-01 15:56:18 +02:00
Elias Dorneles 605edd2215 better bumpversion config for branch 1.1 
Having the part:prerel setup as it's right now, it's forcing releases to
go through a pre-release cycle dev1, rc1, before the actual release.

This is not desired for older branches, since they will mostly get
only minor and patch releases.
 2016-07-29 13:43:32 -03:00
Paul Tremberth 427d90a8ed Bump version: 1.1.0 → 1.1.1 2016-07-13 18:19:35 +02:00
Paul Tremberth f14cc821e9 Merge pull request #2113 from scrapy/release-notes-1.1.1 
Update release notes for upcoming 1.1.1 release
 2016-07-13 18:12:56 +02:00
Paul Tremberth 7e7c832f9f Update 1.1.1 release date 2016-07-13 17:59:11 +02:00
Paul Tremberth ed79193f49 Update notes with latest 1.1 commits 2016-07-13 17:49:17 +02:00
Paul Tremberth 51ed24904b Update release notes for upcoming 1.1.1 release 2016-07-13 17:36:48 +02:00
Kenneth Schnall 758802d41b Update practices.rst 2016-07-13 17:25:08 +02:00
Paul Tremberth e28392ca8c Merge pull request #2122 from redapple/backport-1.1-1989 
[backport][1.1] [image_pipeline] bring back uppercase class attributes (PR #1989)
 2016-07-13 17:19:36 +02:00
Pawel Miech 1f8b2c162b [image_pipeline] minor style tweaks 2016-07-13 17:02:13 +02:00
Pawel Miech 44e731898a [image_pipeline] dont use assert in doctest 2016-07-13 17:02:13 +02:00
Pawel Miech d40de1e013 [image_pipeline] style edits 
* 80 characters line limit
* shortening some code
* removed dead code
* add doctest for _key_for_pipe function
 2016-07-13 17:02:13 +02:00
Pawel Miech 0405750117 [FilesPipeline, ImagesPipeline] fix for cls attrs with DEFAULT prefix 
some class attributes for ImagePipeline and FilesPipeline had DEFAULT prefix. These
attributes should be preserved as well, if users subclasses define values for
DEFAULT_<CLS_ATTRIBUTE_NAME> attribute this value should be preserved.
 2016-07-13 17:02:13 +02:00
Pawel Miech d9a9f76ca0 [files-pipeline] update docs with note about settings 
for subclasses.
 2016-07-13 17:02:13 +02:00