RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
7,456 Commits 42 Branches 132 Tags 162 MiB
Commit Graph

7456 Commits

Author SHA1 Message Date
Mikhail Korobov 298d709e16
Merge pull request #4162 from Gallaecio/bandit 
Add bandit to CI
 2019-11-14 23:40:01 +05:00
Mikhail Korobov d61088f47d
Merge pull request #4163 from Gallaecio/speed-up-tests 
Have CI record the 10 slowest tests
 2019-11-14 23:35:21 +05:00
Mikhail Korobov 494f38a99d
Merge pull request #4115 from scrapy/remove-py2-code 
Remove py2 code
 2019-11-14 23:33:58 +05:00
Andrey Rakhmatullin 3b2289ad01 Rename test_non_str_url_py2 to test_bytes_url. 2019-11-14 22:53:28 +05:00
Andrey Rakhmatullin fe3a121f13 Use kwargs when calling get_func_args. 2019-11-14 22:50:53 +05:00
Adrián Chaves 5ee5508cc3 Have CI record the 10 slowest tests 2019-11-14 15:42:34 +01:00
Adrián Chaves b8ef12cd47 Add bandit to CI 2019-11-14 12:11:28 +01:00
Andrey Rahmatullin 5a2b057355
Merge pull request #4066 from akhterwahab/update-ignored-extensions 
Add .dmg, .iso & .apk to ignored other extensions
 2019-11-14 15:26:03 +05:00
Andrey Rakhmatullin e291460db6 Fix flake8-detected errors. 2019-11-14 15:24:37 +05:00
Andrey Rahmatullin 3631453bfb
Remove spaces on a blank line. 2019-11-14 15:07:53 +05:00
Adrián Chaves be6da52019
Include extensions from #2067 2019-11-14 10:31:55 +01:00
Andrey Rakhmatullin dd367438fa Improve the dbm module ref. 
Co-Authored-By: Adrián Chaves <adrian@chaves.io>
 2019-11-14 13:45:39 +05:00
Andrey Rakhmatullin a9c891399d Fix a duplicate ref name in docs. 2019-11-14 13:45:39 +05:00
Andrey Rakhmatullin 87c23ba22d Remove Py2-only code that checks sys.version_info. 2019-11-14 13:45:39 +05:00
Andrey Rakhmatullin a138fb05d4 Replace to_native_str calls with to_unicode. 2019-11-14 13:45:39 +05:00
Andrey Rakhmatullin 92ffd2f249 Simplify some more imports. 2019-11-14 13:45:39 +05:00
Andrey Rakhmatullin cfa633f5e8 Some text function messages cleanup, deprecate to_native_str. 2019-11-14 13:45:39 +05:00
Andrey Rakhmatullin 85e79ae792 Remove cStringIO imports. 2019-11-14 13:45:39 +05:00
Andrey Rakhmatullin 065fe29d3c Deprecate scrapy.utils.gz.read1. 2019-11-14 13:45:39 +05:00
Andrey Rakhmatullin 0e696ed06d Remove unneeded and unused code from XmlItemExporter. 2019-11-14 13:45:39 +05:00
Andrey Rakhmatullin 1d7c8cb0b1 Remove six.PY2 and six.PY3 conditionals. 2019-11-14 13:45:37 +05:00
Andrey Rahmatullin c911e80209
Merge pull request #4088 from ammarnajjar/4086-constructor-initializer-docs 
docs: use __init__ method instead of constructor
 2019-11-12 21:48:16 +05:00
Andrey Rahmatullin c91390558d
Merge pull request #4074 from purvaudai/master 
Added Pathlib.Path support: Issue #3731
 2019-11-12 21:43:28 +05:00
Andrey Rahmatullin 4c9a1cd2d9
Merge pull request #4097 from Gallaecio/test-coverage 
Remove unused method from scrapy.pqueues._SlotPriorityQueues
 2019-11-12 18:45:29 +05:00
purvaudai 4b8b0345e5 Mades Changes as per review 2019-11-12 18:17:15 +05:30
Andrey Rahmatullin d8098350f0
Merge pull request #3960 from thernstig/issue_2149 
Update documentation for logging manually
 2019-11-12 16:17:49 +05:00
Andrey Rahmatullin 93385e647a
Merge pull request #4123 from elacuesta/utils-local-cache-limit 
Fix LocalCache limit issue, add tests
 2019-11-12 16:05:22 +05:00
purvaudai 50eaabe1fc Added Test 2019-11-11 20:00:26 +05:30
purvaudai f39ff49458 Added Test 2019-11-11 18:54:21 +05:30
purvaudai 0c2dcd5092 Added Test 2019-11-11 18:35:50 +05:30
purvaudai 970c3be160 Added Test 2019-11-11 18:34:15 +05:30
purvaudai 9e6e2dde2b Adding test 2019-11-11 16:10:37 +05:30
purvaudai 0042c389eb Adding test 2019-11-11 15:57:58 +05:30
purvaudai 084a1cda6d Adding test 2019-11-11 15:41:00 +05:30
Andrey Rahmatullin d267e183b4
Merge pull request #4139 from Gallaecio/jobdir-pickle-documentation 
Improve the details about request serialization requirements for JOBDIR
 2019-11-08 22:49:33 +05:00
Andrey Rahmatullin ea41117229
Merge pull request #4142 from Gallaecio/doctest 
Set the bases for testing code examples from the documentation
 2019-11-08 22:44:52 +05:00
Adrián Chaves 1df5755699 Set the bases for testing code examples from the documentation 2019-11-08 16:00:10 +01:00
Adrián Chaves aef98188fa Improve the details about request serialization requirements for JOBDIR 2019-11-07 18:06:55 +01:00
Andrey Rahmatullin d874c4d90b Remove the old Python 2 PyPy installation code from .travis.yml (#4138) 2019-11-07 18:02:17 +01:00
Marc Hernández c377c14e32 Fix W391 Blank line at end of file (#4137) 2019-11-07 17:47:35 +01:00
Marc Hernández e8b1e46e85 Add pytest-flake8 (#3945) 2019-11-07 14:05:01 +01:00
Adrián Chaves 98caf055b5
Fix a typo: specifiy → specify (#4128) 2019-11-06 11:53:46 +01:00
seregaxvm 698aa704b9 Fix zsh completion file extension (#4122) 2019-11-05 16:30:01 +01:00
Eugenio Lacuesta 613c66a034
Do not override built-in max function 2019-11-05 09:45:51 -03:00
elacuesta fed9fbe62d
Update tests/test_utils_datatypes.py 
Co-Authored-By: Adrián Chaves <adrian@chaves.io>
 2019-11-04 15:34:27 -03:00
Eugenio Lacuesta 439a3e59b8
Fix scrapy.utils.datatypes.LocalCache limit issue 2019-11-04 10:35:58 -03:00
Adrián Chaves f02c3d1dcf
Use communicate() instead of wait() after killing the mock server (#4095) 2019-10-31 13:31:33 +01:00
Adrián Chaves 15c55d0c1d
Remove LevelDB support (#4112) 2019-10-31 10:47:29 +01:00
Andrey Rahmatullin 229e722a03 Initial Python 2 removal (#4091) 2019-10-31 10:46:02 +01:00
Benjamin Ooghe-Tabanou 6d6da78eda Add a keep_fragments parameter to the request_fingerprint function (#4104) 2019-10-30 09:13:36 +01:00