RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,066 Commits 49 Branches 132 Tags 175 MiB
Commit Graph

6066 Commits

Author SHA1 Message Date
Rolando Espinoza 4e765acaed BUG: Fix __classcell__ propagation. 
Python 3.6 added simpler customization of class creation but this
requires to propagate correctly the __classcell__ attribute in custom
__new__ methods.

See https://docs.python.org/3.6/whatsnew/3.6.html#pep-487-simpler-
customization-of-class-creation
 2017-02-08 02:12:52 -04:00
Mikhail Korobov f2f9350c47 Merge pull request #2542 from scrapy/redirect-cleanup 
[MRG+1] Cleanup MetaRefreshMiddleware: remove redundant check
 2017-02-08 00:57:21 +05:00
Mikhail Korobov eaf62ab69c cleanup MetaRefreshMiddleware: remove redundant check 2017-02-07 17:56:43 +05:00
Mikhail Korobov 3b8e6d4d82 Merge pull request #2531 from Lukas0907/patch-1 
Fix typo in downloader-middleware.rst.
 2017-02-06 13:09:35 +05:00
Mikhail Korobov 2743786d1d Merge pull request #2534 from shio-phys/fix/typo_of_doc 
fix typo
 2017-02-06 13:05:46 +05:00
Takehiro Shiozaki fcb3daf4fa fix typo 2017-02-06 14:03:41 +09:00
Lukas Anzinger 09643796b4 Fix typo in downloader-middleware.rst. 2017-02-03 20:05:17 +01:00
Mikhail Korobov 814ce37dff Merge pull request #2528 from redapple/dns-retry-test 
Make DNS retry test compatible with Twisted 17+
 2017-02-03 02:43:46 +05:00
Mikhail Korobov 7b8bbc9205 Merge pull request #2215 from redapple/travis-pypy 
Enable PyPy tests on Travis (allowed to fail)
 2017-02-03 02:38:49 +05:00
Paul Tremberth 02e1d2b1fd Add trailing dot 2017-02-02 22:28:37 +01:00
Paul Tremberth e604c0f3ab Remove unused imports 2017-02-02 18:26:41 +01:00
Mikhail Korobov ae2a5292d8 Merge pull request #2457 from redapple/parsel-selector-kwargs 
[MRG] Support kwargs for response.xpath()
 2017-02-02 22:17:26 +05:00
Paul Tremberth 3358254c5c Make DNS retry test compatible with Twisted 17+ 2017-02-02 17:53:28 +01:00
Paul Tremberth 1295c17a26 Bump parsel requirement to at least parsel v1.1 2017-02-02 17:47:22 +01:00
Paul Tremberth 1c0b805357 DOC Mention XPath variables in Selectors section 2017-02-02 17:44:57 +01:00
Paul Tremberth 803d8c4b57 Add tests for passing kwargs on response .xpath() shortcut 2017-02-02 17:44:57 +01:00
Paul Tremberth 0cf6344cc2 Support kwargs for response.xpath() 2017-02-02 17:44:57 +01:00
Mikhail Korobov c305c46254 Merge pull request #2503 from redapple/view-no-redirect 
[MRG] Fix view command against new --no-redirect option
 2017-02-02 21:24:56 +05:00
Mikhail Korobov d4a8f43816 Merge pull request #2519 from redapple/settings-getbool-new 
[MRG+1] Support 'True' and 'False' strings as boolean settings values
 2017-02-02 21:15:24 +05:00
Mikhail Korobov 245287fd5a Merge pull request #2496 from redapple/dns-resolver-timeout 
[MRG] Enforce DNS resolution timeout
 2017-02-02 21:13:59 +05:00
Paul Tremberth 73f985cbde Merge pull request #2525 from scrapy/cache-docs 
DOC mention LevelDB cache storage backend
 2017-02-02 13:22:23 +01:00
Mikhail Korobov 9c75403176 Merge pull request #2466 from eLRuLL/settings-pipeline-template 
[MRG+1] settings: fixing name of the pipeline template
 2017-02-02 17:16:57 +05:00
Mikhail Korobov 55742c0392 DOC mention LevelDB cache storage backend 2017-02-01 22:43:28 +05:00
Paul Tremberth 70f260d353 Don't run coverage stats when on PyPy 2017-02-01 15:19:17 +01:00
Paul Tremberth 8c4f614d21 Enable PyPy tests on Travis 2017-02-01 15:19:17 +01:00
Paul Tremberth d2e9ea0c88 Enforce DNS resolution timeout 2017-01-31 18:21:11 +01:00
Paul Tremberth ae6d8d728e Support 'True' and 'False' strings as boolean settings values 2017-01-30 16:33:08 +01:00
Paul Tremberth 4156a86148 Update docs on view command 2017-01-30 15:57:37 +01:00
Paul Tremberth fc07711614 Remove unused --headers option for view command 2017-01-30 15:54:28 +01:00
Paul Tremberth 4ca191eaf2 Merge pull request #2512 from fladi/fix_manpage_spelling 
Fix spelling error in scrapy.1 manpage.
 2017-01-25 14:40:46 +01:00
Paul Tremberth 87472346df Update scrapy.1 2017-01-25 11:28:20 +01:00
Michael Fladischer bae12870bb Fix spelling error in scrapy.1 manpage. 
The word "intepreted" should be "interpreted".
 2017-01-24 22:20:37 +01:00
Paul Tremberth 4620d2f425 Merge pull request #2470 from chekunkov/patch-1 
[MRG+1] .devN release suffix must be preceded with a dot
 2017-01-24 10:33:22 +01:00
Mikhail Korobov efbb155730 Merge pull request #2507 from eLRuLL/non-doc-readmes 
[MRG+1] Changing README to README.rst
 2017-01-23 17:03:58 +05:00
Paul Tremberth a347c75baa Merge branch 'master' into patch-1 2017-01-23 11:40:38 +01:00
Raul Gallegos 299544416a changing README to README.rst 2017-01-22 19:23:44 -05:00
Mikhail Korobov c275ceb17c Merge pull request #2485 from redapple/tox-py36 
Add Python 3.6 tox env + Travis CI build for it
 2017-01-20 03:36:37 +05:00
Mikhail Korobov f7abef4b39 Merge pull request #2497 from eLRuLL/formid-docs 
[MRG+1] Adding formid to FormRequest documentation
 2017-01-20 03:35:37 +05:00
Paul Tremberth b279bc8546 Fix view command against new --no-redirect option 2017-01-19 16:28:52 +01:00
Raul Gallegos df1a42419f adding formid to FormRequest documentation 2017-01-14 20:45:20 -05:00
Paulius Aleksiūnas 5586fc7e38 Update architecture.rst 
In the data flow image arrows are red.
 2017-01-10 10:40:27 +01:00
Paul Tremberth 4636bef475 Merge pull request #2483 from Digenis/doc_spider_args2attrs 
[MRG+1] Document copying of spider arguments to attributes
 2017-01-10 10:28:38 +01:00
Paul Tremberth bf2277a028 Update spiders.rst 2017-01-10 10:27:38 +01:00
Νικόλαος-Διγενής Καραγιάννης 900b6710d3 Document copying of spider arguments to attributes 2017-01-09 22:12:38 +02:00
Paul Tremberth b3406677b9 Update classifiers in setup.py 2017-01-09 14:40:02 +01:00
Mikhail Korobov e7d0dae7a1 Merge pull request #2469 from scrapy/update-readme 
[MRG+1] Upgrade CoC and mention it after main contributing docs
 2017-01-09 01:42:44 +05:00
Paul Tremberth 6b838b0296 Use matrix build config 2017-01-06 16:10:14 +01:00
Paul Tremberth 53769245f5 Use python 3.6 directly 2017-01-06 16:02:14 +01:00
Paul Tremberth 40851a3d4c Use Python 3.6-dev on Travis 2017-01-06 15:44:32 +01:00
Paul Tremberth a214731471 Add Python 3.6 tox env + Travis CI build for it 2017-01-06 15:38:35 +01:00