RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,396 Commits 49 Branches 132 Tags 180 MiB
Commit Graph

6396 Commits

Author SHA1 Message Date
Paul Tremberth ae6d8d728e Support 'True' and 'False' strings as boolean settings values 2017-01-30 16:33:08 +01:00
Paul Tremberth 4156a86148 Update docs on view command 2017-01-30 15:57:37 +01:00
Paul Tremberth fc07711614 Remove unused --headers option for view command 2017-01-30 15:54:28 +01:00
Paul Tremberth 4ca191eaf2 Merge pull request #2512 from fladi/fix_manpage_spelling 
Fix spelling error in scrapy.1 manpage.
 2017-01-25 14:40:46 +01:00
Paul Tremberth 87472346df Update scrapy.1 2017-01-25 11:28:20 +01:00
Michael Fladischer bae12870bb Fix spelling error in scrapy.1 manpage. 
The word "intepreted" should be "interpreted".
 2017-01-24 22:20:37 +01:00
Eugenio Lacuesta 53757e51e5 Preserve request class when converting to/from dicts (utils.reqser) 2017-01-24 17:13:21 -03:00
Paul Tremberth 4620d2f425 Merge pull request #2470 from chekunkov/patch-1 
[MRG+1] .devN release suffix must be preceded with a dot
 2017-01-24 10:33:22 +01:00
Mikhail Korobov efbb155730 Merge pull request #2507 from eLRuLL/non-doc-readmes 
[MRG+1] Changing README to README.rst
 2017-01-23 17:03:58 +05:00
Paul Tremberth a347c75baa Merge branch 'master' into patch-1 2017-01-23 11:40:38 +01:00
Raul Gallegos 299544416a changing README to README.rst 2017-01-22 19:23:44 -05:00
Mikhail Korobov c275ceb17c Merge pull request #2485 from redapple/tox-py36 
Add Python 3.6 tox env + Travis CI build for it
 2017-01-20 03:36:37 +05:00
Mikhail Korobov f7abef4b39 Merge pull request #2497 from eLRuLL/formid-docs 
[MRG+1] Adding formid to FormRequest documentation
 2017-01-20 03:35:37 +05:00
Paul Tremberth b279bc8546 Fix view command against new --no-redirect option 2017-01-19 16:28:52 +01:00
Raul Gallegos df1a42419f adding formid to FormRequest documentation 2017-01-14 20:45:20 -05:00
Paulius Aleksiūnas 5586fc7e38 Update architecture.rst 
In the data flow image arrows are red.
 2017-01-10 10:40:27 +01:00
Paul Tremberth 4636bef475 Merge pull request #2483 from Digenis/doc_spider_args2attrs 
[MRG+1] Document copying of spider arguments to attributes
 2017-01-10 10:28:38 +01:00
Paul Tremberth bf2277a028 Update spiders.rst 2017-01-10 10:27:38 +01:00
Νικόλαος-Διγενής Καραγιάννης 900b6710d3 Document copying of spider arguments to attributes 2017-01-09 22:12:38 +02:00
Paul Tremberth b3406677b9 Update classifiers in setup.py 2017-01-09 14:40:02 +01:00
Mikhail Korobov e7d0dae7a1 Merge pull request #2469 from scrapy/update-readme 
[MRG+1] Upgrade CoC and mention it after main contributing docs
 2017-01-09 01:42:44 +05:00
Paul Tremberth 6b838b0296 Use matrix build config 2017-01-06 16:10:14 +01:00
Paul Tremberth 53769245f5 Use python 3.6 directly 2017-01-06 16:02:14 +01:00
Paul Tremberth 40851a3d4c Use Python 3.6-dev on Travis 2017-01-06 15:44:32 +01:00
Paul Tremberth a214731471 Add Python 3.6 tox env + Travis CI build for it 2017-01-06 15:38:35 +01:00
Elias Dorneles b6ab1ae9c3 docs: installation instructions, mention conda in the beginning (closes #2475) 2017-01-03 15:14:59 -02:00
Paul Tremberth e7dede66f6 Merge pull request #2458 from rolando-contrib/http11-maxsize-logging-tweak 
[MRG+1] ENH Pass arguments to logger rather than formatted message.
 2017-01-03 14:01:34 +01:00
Alex 8a86574394 .devN release suffix must be preceded with a dot 
https://packaging.python.org/distributing/#standards-compliance-for-interoperability
 2016-12-28 14:25:22 +00:00
Elias Dorneles b7dd089bf9 show CoC in its own section 2016-12-27 11:33:23 -02:00
Elias Dorneles dabcb17d72 update code of conduct http://contributor-covenant.org/version/1/4 2016-12-27 11:32:15 -02:00
Elias Dorneles 9922ec15d7 mention contributing document before CoC in the README 2016-12-27 09:52:35 -02:00
nyov 2240f00a13 Remove dependency on os.environ from default settings 
Avoid loading settings from environment in scrapy core.
Instead it's better to populate them from the starting
shell or an embedding script.
 2016-12-26 20:49:16 +00:00
Raul Gallegos e7c7e055ff settings: fixing name of the pipeline template 2016-12-24 11:55:04 -05:00
Mikhail Korobov cc06b6b1f6 Merge pull request #2460 from redapple/filepipe-random-test-fail 
TST: Randomize FILES_EXPIRES above 90 days
 2016-12-21 23:23:50 +05:00
Paul Tremberth 07f9985a94 TST: Randomize FILES_EXPIRES above 90 days 2016-12-21 17:03:11 +01:00
Paul Tremberth ac74d5a467 Bump version: 1.2.2 → 1.3.0 2016-12-21 16:28:44 +01:00
Paul Tremberth f8793e2460 Set release date for 1.3.0 2016-12-21 16:27:01 +01:00
Paul Tremberth 0c27d252d1 Merge pull request #2437 from scrapy/release-notes-1.3.0 
Update changelog for upcoming 1.3.0 release
 2016-12-21 16:25:13 +01:00
Paul Tremberth b9e7ca044c Reword things a tiny bit 2016-12-21 16:11:19 +01:00
Paul Tremberth d60a6899df Merge logging changes into "New features" section 2016-12-21 16:01:36 +01:00
Paul Tremberth 4eeec3e42c Add preamble on why 1.3.0 comes so soon after 1.2.2 2016-12-21 15:59:18 +01:00
Paul Tremberth 49a84c2d41 Add note on HTTP redirects with shell and fetch 2016-12-21 14:49:16 +01:00
Paul Tremberth 9098001888 Add note on LOG_SHORT_NAMES 2016-12-21 14:32:59 +01:00
Paul Tremberth 9d5afd8c35 Add note on HttpErrorMiddleware new logging level 2016-12-21 14:32:59 +01:00
Paul Tremberth e9b3cf01f4 Update changelog for upcoming 1.3.0 release 2016-12-21 14:32:59 +01:00
Elias Dorneles d09ec3db68 Merge pull request #2410 from redapple/fetch-transparent-redirect 
[MRG+1] Transparently handle redirections in fetch and shell
 2016-12-21 09:49:15 -02:00
Rolando Espinoza 6dec4a3ccb ENH Pass arguments to logger rather than formatted message. 
This not only use the standard form but helps error aggregation
libraries (i.e.: Sentry) to avoid duplicating the message.
 2016-12-20 20:02:31 -04:00
Paul Tremberth 140a57d7b0 Amend note on --no-redirect option for shell tool 2016-12-19 17:54:54 +01:00
Mikhail Korobov d19c4c1f80 Merge pull request #2433 from redapple/wrong-spidermodules-warning 
[MRG+1] Warn user instead of failing for wrong SPIDER_MODULES setting
 2016-12-19 21:46:56 +05:00
Paul Tremberth 78d34cc44c Merge pull request #2454 from crasker/fix/low_parsel_version_number 
[MRG+1] Fix/low parsel version number
 2016-12-19 17:11:17 +01:00