RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
7,483 Commits 49 Branches 132 Tags 141 MiB
Commit Graph

7483 Commits

Author SHA1 Message Date
Adrián Chaves fc3af54dbd Make tox configuration more user friendly 2019-11-20 08:04:17 +01:00
Andrey Rahmatullin 78ad01632f Fix flake8 problems in PR #3989 (#4176) 2019-11-19 10:43:30 +01:00
Andrey Rahmatullin 25cd7ac7ab
Merge pull request #4094 from victor-torres/invalid-url 
Improve URL schema validation on scrapy.Request initialization
 2019-11-19 13:50:08 +05:00
Andrey Rahmatullin 3408b757c1
Merge pull request #3989 from elacuesta/logformatter_error_method 
LogFormatter improvements
 2019-11-19 13:44:43 +05:00
Andrey Rahmatullin e829c47eb8
Merge pull request #3937 from sbs2001/patch-10 
Update reactor.py, updated 'if' sequencing .
 2019-11-19 11:20:56 +05:00
Andrey Rahmatullin a78e58afe0
Merge pull request #4167 from noviluni/fix_E711_and_E713 
fix E711 and E713
 2019-11-17 16:46:15 +05:00
Marc Hernandez Cabot 0e252f5a13 fix E711 and E713 2019-11-15 19:12:43 +01:00
Andrey Rahmatullin 786a55b2a6
Merge pull request #4059 from josealberto4444/master 
Make punctuation consistent
 2019-11-15 15:39:27 +05:00
José Alberto / Speedy 77a84f620f
Fix string 
Co-Authored-By: Adrián Chaves <adrian@chaves.io>
 2019-11-15 11:09:24 +01:00
Mikhail Korobov a541c329a9
Merge pull request #4152 from Gallaecio/sphinx-extensions 
Install the sphinx-notfound-page Sphinx extension
 2019-11-15 00:36:56 +05:00
Mikhail Korobov 7b4637d083
Merge pull request #4146 from Gallaecio/doctest 
Make tutorial doctests pass
 2019-11-15 00:19:20 +05:00
Mikhail Korobov 49b5251e06
Merge pull request #4147 from Gallaecio/intersphinx 
Use intersphinx for links to the Sphinx documentation
 2019-11-15 00:16:39 +05:00
Mikhail Korobov cc0026f733
Merge pull request #4148 from Gallaecio/doc-view-code 
Allow opening the source code from the API documentation
 2019-11-14 23:43:44 +05:00
Mikhail Korobov 550d8046fd
Merge pull request #4157 from Gallaecio/flake8 
Add missing whitespace after ‘,’, ‘;’ or ‘:’
 2019-11-14 23:42:06 +05:00
Mikhail Korobov 298d709e16
Merge pull request #4162 from Gallaecio/bandit 
Add bandit to CI
 2019-11-14 23:40:01 +05:00
Mikhail Korobov d61088f47d
Merge pull request #4163 from Gallaecio/speed-up-tests 
Have CI record the 10 slowest tests
 2019-11-14 23:35:21 +05:00
Mikhail Korobov 494f38a99d
Merge pull request #4115 from scrapy/remove-py2-code 
Remove py2 code
 2019-11-14 23:33:58 +05:00
Andrey Rakhmatullin 3b2289ad01 Rename test_non_str_url_py2 to test_bytes_url. 2019-11-14 22:53:28 +05:00
Andrey Rakhmatullin fe3a121f13 Use kwargs when calling get_func_args. 2019-11-14 22:50:53 +05:00
Adrián Chaves 5ee5508cc3 Have CI record the 10 slowest tests 2019-11-14 15:42:34 +01:00
Adrián Chaves b8ef12cd47 Add bandit to CI 2019-11-14 12:11:28 +01:00
Andrey Rahmatullin 5a2b057355
Merge pull request #4066 from akhterwahab/update-ignored-extensions 
Add .dmg, .iso & .apk to ignored other extensions
 2019-11-14 15:26:03 +05:00
Andrey Rakhmatullin e291460db6 Fix flake8-detected errors. 2019-11-14 15:24:37 +05:00
Andrey Rahmatullin 3631453bfb
Remove spaces on a blank line. 2019-11-14 15:07:53 +05:00
Adrián Chaves be6da52019
Include extensions from #2067 2019-11-14 10:31:55 +01:00
Andrey Rakhmatullin dd367438fa Improve the dbm module ref. 
Co-Authored-By: Adrián Chaves <adrian@chaves.io>
 2019-11-14 13:45:39 +05:00
Andrey Rakhmatullin a9c891399d Fix a duplicate ref name in docs. 2019-11-14 13:45:39 +05:00
Andrey Rakhmatullin 87c23ba22d Remove Py2-only code that checks sys.version_info. 2019-11-14 13:45:39 +05:00
Andrey Rakhmatullin a138fb05d4 Replace to_native_str calls with to_unicode. 2019-11-14 13:45:39 +05:00
Andrey Rakhmatullin 92ffd2f249 Simplify some more imports. 2019-11-14 13:45:39 +05:00
Andrey Rakhmatullin cfa633f5e8 Some text function messages cleanup, deprecate to_native_str. 2019-11-14 13:45:39 +05:00
Andrey Rakhmatullin 85e79ae792 Remove cStringIO imports. 2019-11-14 13:45:39 +05:00
Andrey Rakhmatullin 065fe29d3c Deprecate scrapy.utils.gz.read1. 2019-11-14 13:45:39 +05:00
Andrey Rakhmatullin 0e696ed06d Remove unneeded and unused code from XmlItemExporter. 2019-11-14 13:45:39 +05:00
Andrey Rakhmatullin 1d7c8cb0b1 Remove six.PY2 and six.PY3 conditionals. 2019-11-14 13:45:37 +05:00
Adrián Chaves 33ef24c757 Add missing whitespace after ‘,’, ‘;’ or ‘:’ 2019-11-13 10:52:05 +01:00
Adrián Chaves 76c31094df Install the sphinx-notfound-page Sphinx extension 2019-11-13 09:28:48 +01:00
Adrián Chaves b642a1fca2
Fix doctest skipping based on the running Python version 2019-11-13 09:14:20 +01:00
Adrián Chaves 414e6e2fd5 Skip a doctest in Python 3.5- because of dictionary changes 2019-11-13 08:40:31 +01:00
Andrey Rahmatullin c911e80209
Merge pull request #4088 from ammarnajjar/4086-constructor-initializer-docs 
docs: use __init__ method instead of constructor
 2019-11-12 21:48:16 +05:00
Andrey Rahmatullin c91390558d
Merge pull request #4074 from purvaudai/master 
Added Pathlib.Path support: Issue #3731
 2019-11-12 21:43:28 +05:00
Andrey Rahmatullin 4c9a1cd2d9
Merge pull request #4097 from Gallaecio/test-coverage 
Remove unused method from scrapy.pqueues._SlotPriorityQueues
 2019-11-12 18:45:29 +05:00
purvaudai 4b8b0345e5 Mades Changes as per review 2019-11-12 18:17:15 +05:30
Andrey Rahmatullin d8098350f0
Merge pull request #3960 from thernstig/issue_2149 
Update documentation for logging manually
 2019-11-12 16:17:49 +05:00
Andrey Rahmatullin 93385e647a
Merge pull request #4123 from elacuesta/utils-local-cache-limit 
Fix LocalCache limit issue, add tests
 2019-11-12 16:05:22 +05:00
Adrián Chaves 8a6a063778 Allow opening the source code from the API documentation 2019-11-12 10:23:19 +01:00
Adrián Chaves 7b7bb028f4 Use intersphinx for links to the Sphinx documentation 2019-11-12 08:49:06 +01:00
Adrián Chaves 79d2f99995 Make tutorial doctests pass 2019-11-12 08:08:50 +01:00
purvaudai 50eaabe1fc Added Test 2019-11-11 20:00:26 +05:30
purvaudai f39ff49458 Added Test 2019-11-11 18:54:21 +05:30