RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,809 Commits 49 Branches 132 Tags 158 MiB
Commit Graph

6809 Commits

Author SHA1 Message Date
Paul Tremberth 1c0b805357 DOC Mention XPath variables in Selectors section 2017-02-02 17:44:57 +01:00
Paul Tremberth 803d8c4b57 Add tests for passing kwargs on response .xpath() shortcut 2017-02-02 17:44:57 +01:00
Paul Tremberth 0cf6344cc2 Support kwargs for response.xpath() 2017-02-02 17:44:57 +01:00
Mikhail Korobov c305c46254 Merge pull request #2503 from redapple/view-no-redirect 
[MRG] Fix view command against new --no-redirect option
 2017-02-02 21:24:56 +05:00
Mikhail Korobov d4a8f43816 Merge pull request #2519 from redapple/settings-getbool-new 
[MRG+1] Support 'True' and 'False' strings as boolean settings values
 2017-02-02 21:15:24 +05:00
Mikhail Korobov 245287fd5a Merge pull request #2496 from redapple/dns-resolver-timeout 
[MRG] Enforce DNS resolution timeout
 2017-02-02 21:13:59 +05:00
Paul Tremberth 73f985cbde Merge pull request #2525 from scrapy/cache-docs 
DOC mention LevelDB cache storage backend
 2017-02-02 13:22:23 +01:00
Mikhail Korobov 9c75403176 Merge pull request #2466 from eLRuLL/settings-pipeline-template 
[MRG+1] settings: fixing name of the pipeline template
 2017-02-02 17:16:57 +05:00
Mikhail Korobov 55742c0392 DOC mention LevelDB cache storage backend 2017-02-01 22:43:28 +05:00
Paul Tremberth 70f260d353 Don't run coverage stats when on PyPy 2017-02-01 15:19:17 +01:00
Paul Tremberth 8c4f614d21 Enable PyPy tests on Travis 2017-02-01 15:19:17 +01:00
Paul Tremberth a586243758 Buffer CONNECT response bytes from proxy until all HTTP headers are received 2017-01-31 18:27:55 +01:00
Paul Tremberth d2e9ea0c88 Enforce DNS resolution timeout 2017-01-31 18:21:11 +01:00
Paul Tremberth ae6d8d728e Support 'True' and 'False' strings as boolean settings values 2017-01-30 16:33:08 +01:00
Paul Tremberth 4156a86148 Update docs on view command 2017-01-30 15:57:37 +01:00
Paul Tremberth fc07711614 Remove unused --headers option for view command 2017-01-30 15:54:28 +01:00
Paul Tremberth 4ca191eaf2 Merge pull request #2512 from fladi/fix_manpage_spelling 
Fix spelling error in scrapy.1 manpage.
 2017-01-25 14:40:46 +01:00
Paul Tremberth 87472346df Update scrapy.1 2017-01-25 11:28:20 +01:00
Michael Fladischer bae12870bb Fix spelling error in scrapy.1 manpage. 
The word "intepreted" should be "interpreted".
 2017-01-24 22:20:37 +01:00
Eugenio Lacuesta 53757e51e5 Preserve request class when converting to/from dicts (utils.reqser) 2017-01-24 17:13:21 -03:00
Paul Tremberth 4620d2f425 Merge pull request #2470 from chekunkov/patch-1 
[MRG+1] .devN release suffix must be preceded with a dot
 2017-01-24 10:33:22 +01:00
Mikhail Korobov efbb155730 Merge pull request #2507 from eLRuLL/non-doc-readmes 
[MRG+1] Changing README to README.rst
 2017-01-23 17:03:58 +05:00
Paul Tremberth a347c75baa Merge branch 'master' into patch-1 2017-01-23 11:40:38 +01:00
Raul Gallegos 299544416a changing README to README.rst 2017-01-22 19:23:44 -05:00
Mikhail Korobov c275ceb17c Merge pull request #2485 from redapple/tox-py36 
Add Python 3.6 tox env + Travis CI build for it
 2017-01-20 03:36:37 +05:00
Mikhail Korobov f7abef4b39 Merge pull request #2497 from eLRuLL/formid-docs 
[MRG+1] Adding formid to FormRequest documentation
 2017-01-20 03:35:37 +05:00
Paul Tremberth b279bc8546 Fix view command against new --no-redirect option 2017-01-19 16:28:52 +01:00
Raul Gallegos df1a42419f adding formid to FormRequest documentation 2017-01-14 20:45:20 -05:00
Paulius Aleksiūnas 5586fc7e38 Update architecture.rst 
In the data flow image arrows are red.
 2017-01-10 10:40:27 +01:00
Paul Tremberth 4636bef475 Merge pull request #2483 from Digenis/doc_spider_args2attrs 
[MRG+1] Document copying of spider arguments to attributes
 2017-01-10 10:28:38 +01:00
Paul Tremberth bf2277a028 Update spiders.rst 2017-01-10 10:27:38 +01:00
Νικόλαος-Διγενής Καραγιάννης 900b6710d3 Document copying of spider arguments to attributes 2017-01-09 22:12:38 +02:00
Paul Tremberth b3406677b9 Update classifiers in setup.py 2017-01-09 14:40:02 +01:00
Mikhail Korobov e7d0dae7a1 Merge pull request #2469 from scrapy/update-readme 
[MRG+1] Upgrade CoC and mention it after main contributing docs
 2017-01-09 01:42:44 +05:00
Paul Tremberth 6b838b0296 Use matrix build config 2017-01-06 16:10:14 +01:00
Paul Tremberth 53769245f5 Use python 3.6 directly 2017-01-06 16:02:14 +01:00
Paul Tremberth 40851a3d4c Use Python 3.6-dev on Travis 2017-01-06 15:44:32 +01:00
Paul Tremberth a214731471 Add Python 3.6 tox env + Travis CI build for it 2017-01-06 15:38:35 +01:00
Elias Dorneles b6ab1ae9c3 docs: installation instructions, mention conda in the beginning (closes #2475) 2017-01-03 15:14:59 -02:00
Paul Tremberth e7dede66f6 Merge pull request #2458 from rolando-contrib/http11-maxsize-logging-tweak 
[MRG+1] ENH Pass arguments to logger rather than formatted message.
 2017-01-03 14:01:34 +01:00
Alex 8a86574394 .devN release suffix must be preceded with a dot 
https://packaging.python.org/distributing/#standards-compliance-for-interoperability
 2016-12-28 14:25:22 +00:00
Elias Dorneles b7dd089bf9 show CoC in its own section 2016-12-27 11:33:23 -02:00
Elias Dorneles dabcb17d72 update code of conduct http://contributor-covenant.org/version/1/4 2016-12-27 11:32:15 -02:00
Elias Dorneles 9922ec15d7 mention contributing document before CoC in the README 2016-12-27 09:52:35 -02:00
nyov 2240f00a13 Remove dependency on os.environ from default settings 
Avoid loading settings from environment in scrapy core.
Instead it's better to populate them from the starting
shell or an embedding script.
 2016-12-26 20:49:16 +00:00
Raul Gallegos e7c7e055ff settings: fixing name of the pipeline template 2016-12-24 11:55:04 -05:00
Mikhail Korobov cc06b6b1f6 Merge pull request #2460 from redapple/filepipe-random-test-fail 
TST: Randomize FILES_EXPIRES above 90 days
 2016-12-21 23:23:50 +05:00
Paul Tremberth 07f9985a94 TST: Randomize FILES_EXPIRES above 90 days 2016-12-21 17:03:11 +01:00
Paul Tremberth ac74d5a467 Bump version: 1.2.2 → 1.3.0 2016-12-21 16:28:44 +01:00
Paul Tremberth f8793e2460 Set release date for 1.3.0 2016-12-21 16:27:01 +01:00