RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,078 Commits 49 Branches 132 Tags 141 MiB
Commit Graph

6078 Commits

Author SHA1 Message Date
Paul Tremberth d205206aaa Merge pull request #2345 from gustavodeandrade/master 
[MRG+1] Fix documentation about HTML entities decoding with selector extraction
 2017-02-08 13:21:15 +01:00
Paul Tremberth 7d0b89042f Merge pull request #2533 from djrobust/patch-1 
[MRG+1] Use yield with nested parsing of responses
 2017-02-08 13:02:50 +01:00
Paul Tremberth a8893190a1 Merge pull request #2464 from elacuesta/component_order_integer 
[MRG+2] Validate numeric values (components order)
 2017-02-08 13:01:02 +01:00
Paul Tremberth 3becb861af Merge pull request #2544 from scrapy/twisted-version-cleanup 
[MRG+1] Remove code required to support ancient twisted versions.
 2017-02-08 12:59:45 +01:00
Paul Tremberth e87f18447c Merge pull request #2538 from scrapy/linkextractor-fail-fast 
LinkExtractor: don’t check all regexes if one of them matches
 2017-02-08 12:58:41 +01:00
Paul Tremberth 5ad64204ac Merge pull request #2509 from rolando-contrib/py36-classcell-compat 
[MRG+1] BUG: Fix __classcell__ propagation required in Python 3.6.
 2017-02-08 12:15:15 +01:00
Rolando Espinoza 4e765acaed BUG: Fix __classcell__ propagation. 
Python 3.6 added simpler customization of class creation but this
requires to propagate correctly the __classcell__ attribute in custom
__new__ methods.

See https://docs.python.org/3.6/whatsnew/3.6.html#pep-487-simpler-
customization-of-class-creation
 2017-02-08 02:12:52 -04:00
Mikhail Korobov f2f9350c47 Merge pull request #2542 from scrapy/redirect-cleanup 
[MRG+1] Cleanup MetaRefreshMiddleware: remove redundant check
 2017-02-08 00:57:21 +05:00
Mikhail Korobov 04b2f79e7a Remove code required to support ancient twisted versions. See GH-1887. 2017-02-07 22:30:58 +05:00
Mikhail Korobov eaf62ab69c cleanup MetaRefreshMiddleware: remove redundant check 2017-02-07 17:56:43 +05:00
Eugenio Lacuesta 24e82bfe75 Validate values for components order 2017-02-07 09:13:57 -03:00
Mikhail Korobov f73eb715ac LinkExtractor: don’t check all regexes if one of them matches 2017-02-07 02:16:06 +05:00
Mikhail Korobov 3b8e6d4d82 Merge pull request #2531 from Lukas0907/patch-1 
Fix typo in downloader-middleware.rst.
 2017-02-06 13:09:35 +05:00
Mikhail Korobov 2743786d1d Merge pull request #2534 from shio-phys/fix/typo_of_doc 
fix typo
 2017-02-06 13:05:46 +05:00
Takehiro Shiozaki fcb3daf4fa fix typo 2017-02-06 14:03:41 +09:00
djrobust 3021084f37 Use 'yield' when parsing multiple responses 
Use 'yield' consistently across examples of parse functions.
 2017-02-04 20:07:05 -08:00
Lukas Anzinger 09643796b4 Fix typo in downloader-middleware.rst. 2017-02-03 20:05:17 +01:00
Mikhail Korobov 814ce37dff Merge pull request #2528 from redapple/dns-retry-test 
Make DNS retry test compatible with Twisted 17+
 2017-02-03 02:43:46 +05:00
Mikhail Korobov 7b8bbc9205 Merge pull request #2215 from redapple/travis-pypy 
Enable PyPy tests on Travis (allowed to fail)
 2017-02-03 02:38:49 +05:00
Paul Tremberth 02e1d2b1fd Add trailing dot 2017-02-02 22:28:37 +01:00
Paul Tremberth e604c0f3ab Remove unused imports 2017-02-02 18:26:41 +01:00
Mikhail Korobov ae2a5292d8 Merge pull request #2457 from redapple/parsel-selector-kwargs 
[MRG] Support kwargs for response.xpath()
 2017-02-02 22:17:26 +05:00
Paul Tremberth 3358254c5c Make DNS retry test compatible with Twisted 17+ 2017-02-02 17:53:28 +01:00
Paul Tremberth 1295c17a26 Bump parsel requirement to at least parsel v1.1 2017-02-02 17:47:22 +01:00
Paul Tremberth 1c0b805357 DOC Mention XPath variables in Selectors section 2017-02-02 17:44:57 +01:00
Paul Tremberth 803d8c4b57 Add tests for passing kwargs on response .xpath() shortcut 2017-02-02 17:44:57 +01:00
Paul Tremberth 0cf6344cc2 Support kwargs for response.xpath() 2017-02-02 17:44:57 +01:00
Mikhail Korobov c305c46254 Merge pull request #2503 from redapple/view-no-redirect 
[MRG] Fix view command against new --no-redirect option
 2017-02-02 21:24:56 +05:00
Mikhail Korobov d4a8f43816 Merge pull request #2519 from redapple/settings-getbool-new 
[MRG+1] Support 'True' and 'False' strings as boolean settings values
 2017-02-02 21:15:24 +05:00
Mikhail Korobov 245287fd5a Merge pull request #2496 from redapple/dns-resolver-timeout 
[MRG] Enforce DNS resolution timeout
 2017-02-02 21:13:59 +05:00
Paul Tremberth 73f985cbde Merge pull request #2525 from scrapy/cache-docs 
DOC mention LevelDB cache storage backend
 2017-02-02 13:22:23 +01:00
Mikhail Korobov 9c75403176 Merge pull request #2466 from eLRuLL/settings-pipeline-template 
[MRG+1] settings: fixing name of the pipeline template
 2017-02-02 17:16:57 +05:00
Mikhail Korobov 55742c0392 DOC mention LevelDB cache storage backend 2017-02-01 22:43:28 +05:00
Paul Tremberth 70f260d353 Don't run coverage stats when on PyPy 2017-02-01 15:19:17 +01:00
Paul Tremberth 8c4f614d21 Enable PyPy tests on Travis 2017-02-01 15:19:17 +01:00
Paul Tremberth d2e9ea0c88 Enforce DNS resolution timeout 2017-01-31 18:21:11 +01:00
Paul Tremberth ae6d8d728e Support 'True' and 'False' strings as boolean settings values 2017-01-30 16:33:08 +01:00
Paul Tremberth 4156a86148 Update docs on view command 2017-01-30 15:57:37 +01:00
Paul Tremberth fc07711614 Remove unused --headers option for view command 2017-01-30 15:54:28 +01:00
Paul Tremberth 4ca191eaf2 Merge pull request #2512 from fladi/fix_manpage_spelling 
Fix spelling error in scrapy.1 manpage.
 2017-01-25 14:40:46 +01:00
Paul Tremberth 87472346df Update scrapy.1 2017-01-25 11:28:20 +01:00
Michael Fladischer bae12870bb Fix spelling error in scrapy.1 manpage. 
The word "intepreted" should be "interpreted".
 2017-01-24 22:20:37 +01:00
Paul Tremberth 4620d2f425 Merge pull request #2470 from chekunkov/patch-1 
[MRG+1] .devN release suffix must be preceded with a dot
 2017-01-24 10:33:22 +01:00
Mikhail Korobov efbb155730 Merge pull request #2507 from eLRuLL/non-doc-readmes 
[MRG+1] Changing README to README.rst
 2017-01-23 17:03:58 +05:00
Paul Tremberth a347c75baa Merge branch 'master' into patch-1 2017-01-23 11:40:38 +01:00
Raul Gallegos 299544416a changing README to README.rst 2017-01-22 19:23:44 -05:00
Mikhail Korobov c275ceb17c Merge pull request #2485 from redapple/tox-py36 
Add Python 3.6 tox env + Travis CI build for it
 2017-01-20 03:36:37 +05:00
Mikhail Korobov f7abef4b39 Merge pull request #2497 from eLRuLL/formid-docs 
[MRG+1] Adding formid to FormRequest documentation
 2017-01-20 03:35:37 +05:00
Paul Tremberth b279bc8546 Fix view command against new --no-redirect option 2017-01-19 16:28:52 +01:00
Raul Gallegos df1a42419f adding formid to FormRequest documentation 2017-01-14 20:45:20 -05:00