RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
9,291 Commits 49 Branches 132 Tags 148 MiB
Commit Graph

9291 Commits

Author SHA1 Message Date
Adrián Chaves 0946eb335a Port code from Twisted’s deprecated HTTPClientFactory into ScrapyHTTPClientFactory 2019-11-14 17:56:21 +01:00
Adrián Chaves 058bdda0af Improve the performance of the DOWNLOAD_DELAY test 2019-11-14 16:53:20 +01:00
Adrián Chaves 5ee5508cc3 Have CI record the 10 slowest tests 2019-11-14 15:42:34 +01:00
Adrián Chaves b8ef12cd47 Add bandit to CI 2019-11-14 12:11:28 +01:00
Andrey Rahmatullin 5a2b057355
Merge pull request #4066 from akhterwahab/update-ignored-extensions 
Add .dmg, .iso & .apk to ignored other extensions
 2019-11-14 15:26:03 +05:00
Andrey Rakhmatullin e291460db6 Fix flake8-detected errors. 2019-11-14 15:24:37 +05:00
Andrey Rahmatullin 3631453bfb
Remove spaces on a blank line. 2019-11-14 15:07:53 +05:00
Adrián Chaves be6da52019
Include extensions from #2067 2019-11-14 10:31:55 +01:00
Adrián Chaves 1a4a77d49f Remove Python 2 check from MutableChainTest 2019-11-14 10:24:31 +01:00
Andrey Rakhmatullin dd367438fa Improve the dbm module ref. 
Co-Authored-By: Adrián Chaves <adrian@chaves.io>
 2019-11-14 13:45:39 +05:00
Andrey Rakhmatullin a9c891399d Fix a duplicate ref name in docs. 2019-11-14 13:45:39 +05:00
Andrey Rakhmatullin 87c23ba22d Remove Py2-only code that checks sys.version_info. 2019-11-14 13:45:39 +05:00
Andrey Rakhmatullin a138fb05d4 Replace to_native_str calls with to_unicode. 2019-11-14 13:45:39 +05:00
Andrey Rakhmatullin 92ffd2f249 Simplify some more imports. 2019-11-14 13:45:39 +05:00
Andrey Rakhmatullin cfa633f5e8 Some text function messages cleanup, deprecate to_native_str. 2019-11-14 13:45:39 +05:00
Andrey Rakhmatullin 85e79ae792 Remove cStringIO imports. 2019-11-14 13:45:39 +05:00
Andrey Rakhmatullin 065fe29d3c Deprecate scrapy.utils.gz.read1. 2019-11-14 13:45:39 +05:00
Andrey Rakhmatullin 0e696ed06d Remove unneeded and unused code from XmlItemExporter. 2019-11-14 13:45:39 +05:00
Andrey Rakhmatullin 1d7c8cb0b1 Remove six.PY2 and six.PY3 conditionals. 2019-11-14 13:45:37 +05:00
Adrián Chaves 33ef24c757 Add missing whitespace after ‘,’, ‘;’ or ‘:’ 2019-11-13 10:52:05 +01:00
Adrián Chaves a3a3107bc4 MutableChain: return self from __iter__ 2019-11-13 09:46:54 +01:00
Adrián Chaves 76c31094df Install the sphinx-notfound-page Sphinx extension 2019-11-13 09:28:48 +01:00
Adrián Chaves b642a1fca2
Fix doctest skipping based on the running Python version 2019-11-13 09:14:20 +01:00
Adrián Chaves 414e6e2fd5 Skip a doctest in Python 3.5- because of dictionary changes 2019-11-13 08:40:31 +01:00
Andrey Rahmatullin c911e80209
Merge pull request #4088 from ammarnajjar/4086-constructor-initializer-docs 
docs: use __init__ method instead of constructor
 2019-11-12 21:48:16 +05:00
Andrey Rahmatullin c91390558d
Merge pull request #4074 from purvaudai/master 
Added Pathlib.Path support: Issue #3731
 2019-11-12 21:43:28 +05:00
Andrey Rahmatullin 4c9a1cd2d9
Merge pull request #4097 from Gallaecio/test-coverage 
Remove unused method from scrapy.pqueues._SlotPriorityQueues
 2019-11-12 18:45:29 +05:00
purvaudai 4b8b0345e5 Mades Changes as per review 2019-11-12 18:17:15 +05:30
Andrey Rahmatullin d8098350f0
Merge pull request #3960 from thernstig/issue_2149 
Update documentation for logging manually
 2019-11-12 16:17:49 +05:00
Andrey Rahmatullin 93385e647a
Merge pull request #4123 from elacuesta/utils-local-cache-limit 
Fix LocalCache limit issue, add tests
 2019-11-12 16:05:22 +05:00
Adrián Chaves 8a6a063778 Allow opening the source code from the API documentation 2019-11-12 10:23:19 +01:00
Adrián Chaves 7b7bb028f4 Use intersphinx for links to the Sphinx documentation 2019-11-12 08:49:06 +01:00
Adrián Chaves 79d2f99995 Make tutorial doctests pass 2019-11-12 08:08:50 +01:00
purvaudai 50eaabe1fc Added Test 2019-11-11 20:00:26 +05:30
purvaudai f39ff49458 Added Test 2019-11-11 18:54:21 +05:30
purvaudai 0c2dcd5092 Added Test 2019-11-11 18:35:50 +05:30
purvaudai 970c3be160 Added Test 2019-11-11 18:34:15 +05:30
purvaudai 9e6e2dde2b Adding test 2019-11-11 16:10:37 +05:30
purvaudai 0042c389eb Adding test 2019-11-11 15:57:58 +05:30
purvaudai 084a1cda6d Adding test 2019-11-11 15:41:00 +05:30
Adrián Chaves ecc46ac741
Merge branch 'master' into pylint 2019-11-11 10:45:25 +01:00
Eugenio Lacuesta 07fa768d33
Merge branch 'remove-six-code' of github.com:scrapy/scrapy into remove-six-code 2019-11-08 22:17:12 -03:00
Eugenio Lacuesta b6bbb28197
PEP8 adjustments 2019-11-08 22:13:03 -03:00
Andrey Rahmatullin d267e183b4
Merge pull request #4139 from Gallaecio/jobdir-pickle-documentation 
Improve the details about request serialization requirements for JOBDIR
 2019-11-08 22:49:33 +05:00
Andrey Rahmatullin ea41117229
Merge pull request #4142 from Gallaecio/doctest 
Set the bases for testing code examples from the documentation
 2019-11-08 22:44:52 +05:00
Eugenio Lacuesta 342e3b5bd5
Merge remote-tracking branch 'upstream/master' into remove-six-code 2019-11-08 12:29:15 -03:00
Eugenio Lacuesta 6cde428af4
Remove deprecated MergeDict class 2019-11-08 12:26:40 -03:00
Adrián Chaves 1df5755699 Set the bases for testing code examples from the documentation 2019-11-08 16:00:10 +01:00
elacuesta 44f19df311
[test] Update mitmproxy version 
Co-Authored-By: Adrián Chaves <adrian@chaves.io>
 2019-11-08 11:32:50 -03:00
Adrián Chaves 40ed184914
Merge branch 'master' into pylint 2019-11-07 18:40:58 +01:00