RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
10,710 Commits 49 Branches 132 Tags 141 MiB
Commit Graph

10710 Commits

Author SHA1 Message Date
Andrey Rakhmatullin 1311e7db05 Regenerate the expired mitmproxy-ca.pem. 2024-02-29 16:31:06 +05:00
Andrey Rakhmatullin 032e6a091a Reformat the new changes with new black. 2024-02-29 16:24:52 +05:00
Adrián Chaves 31cbbb5758 bandit: ignore md5 usage for download slot names 2024-02-29 11:31:39 +01:00
Adrián Chaves 2bfd9a2257 bandit: allow-list false positives 2024-02-29 11:11:42 +01:00
Laerte Pereira 2169810414 fix: Proxy tests don't use custom certificate authority 2024-02-29 06:41:14 -03:00
Andrey Rakhmatullin 706eb8d427 Fix a merge error. 2024-02-29 14:33:55 +05:00
Andrey Rakhmatullin b6587575a1 Merge branch 'master' into typing-request-response-cls 2024-02-29 12:43:30 +05:00
Andrey Rakhmatullin 198f5cf0d4
Merge pull request #6257 from Laerte/master 
Fix and re-enable `unnecessary-comprehension` and `use-dict-literal` pylint tags
 2024-02-29 12:36:34 +05:00
Laerte Pereira 26a16f2c43 Fix tests 2024-02-28 16:36:19 -03:00
Laerte Pereira 63acd07209 Fix and re-enable unnecessary-comprehension and use-dict-literal pylint tags 2024-02-28 16:14:08 -03:00
Andrey Rakhmatullin 532cc8a517
Merge pull request #6253 from wRAR/update-tools 
Update tool versions, fix some of the pylint problems
 2024-02-28 16:17:42 +05:00
Andrey Rakhmatullin 4f9dd998dc Bump pylint, cleanup the ignored tags. 2024-02-28 14:31:21 +05:00
Andrey Rakhmatullin d2c05d9d96 Bump mypy and type stubs. 2024-02-28 14:31:21 +05:00
Andrey Rakhmatullin 68104b9f48 Update .bandit.yml, add problem names. 2024-02-28 14:31:16 +05:00
Andrey Rakhmatullin 6e5918345b Bump bandit, flake8 and isort. 2024-02-28 14:30:38 +05:00
Andrey Rakhmatullin 282767f23b Bump black. 2024-02-28 14:30:38 +05:00
Andrey Rakhmatullin 415c47479f
Merge pull request #6251 from Laerte/master 
Use defusedxml.xmlrpc
 2024-02-28 14:29:20 +05:00
Laerte Pereira 008ebb65fc Change immport style 2024-02-27 18:10:28 -03:00
Laerte Pereira 7f945ad6db Import defusedxml.xmlrpc using alias 2024-02-27 17:39:29 -03:00
Laerte Pereira d87f949526 Use defusedxml.xmlrpc 2024-02-27 17:08:13 -03:00
Adrián Chaves 2d46b4acf5
Complete coverage for the AutoThrottle extension (#6245) 2024-02-27 09:28:02 +01:00
Jon b0ef9a89a1
Remove usage of deprecated mktemp (#5285) 2024-02-26 19:53:06 +01:00
vishesh10 e208f82076
Add support for multiple-compressed responses (#6063) 2024-02-22 12:16:24 +01:00
Andrey Rakhmatullin ebd7e199f0
Merge pull request #6235 from elramen/http_request_tests 
Added tests for form.py
 2024-02-22 12:17:11 +05:00
Andrey Rakhmatullin edd7ba1c06
Merge pull request #6236 from elramen/json_request_tests_main 
Improve json_request.py coverage
 2024-02-22 12:16:47 +05:00
Can Kupeli c513e7d6e5 implemented tests for branch coverage for function printSummary 2024-02-21 23:52:35 +01:00
noon 877398a3de refactor #3 Remove inner class in form test 2024-02-21 21:13:57 +01:00
noon b7a7ae7dbb refactor #22 Change comment and warning catching 2024-02-21 21:04:45 +01:00
Andrey Rakhmatullin f798118ac2
Merge pull request #6232 from elramen/linkextractor_tests 
Added tests for LxmlLinkExtractor
 2024-02-21 23:03:20 +05:00
Elias Ram f19045403a test #8 made tests cleaner 2024-02-21 16:03:51 +01:00
Adrián Chaves 6fc7827042
Do not close the underlying file from compression plugins (#6239) 2024-02-21 14:27:42 +01:00
noon bc036542a8 refactor #3 Moved tests to FormRequestTest 2024-02-21 02:35:45 +01:00
noon 12b4417c56 test #22 Improve json_request.py coverage 2024-02-21 02:30:50 +01:00
noon e2a0c85f11 doc #3 Clarified test comments 2024-02-21 02:21:24 +01:00
noon e27d320c3c test #3 Increased branch coverage for form.py 2024-02-20 23:58:39 +01:00
Elias Ram e8e6d28479 test #8 added tests for LxmlLinkExtractor 2024-02-20 20:41:18 +01:00
Elias Ram f096f17fa4 test #6 added tests for check command 2024-02-20 20:32:02 +01:00
Laerte Pereira ee1189512f
Replace urlparse with urlparse_cached where possible (#6229) 2024-02-20 12:47:29 +01:00
Mikhail Korobov c4e4b9b56e
Add a SECURITY.md file (#6051) 2024-02-20 10:50:16 +01:00
Andrey Rakhmatullin ba8993ec09
Merge pull request #6223 from jxlil/docs/remove_external_docs 
Fix: Remove docs for other projects from the Scrapy docs
 2024-02-16 23:59:10 +04:00
Adrián Chaves 5e51417a48 Add tests, fix canonicalize passing 2024-02-16 20:10:52 +01:00
Jalil SA 36f72877ba update: docs/topics/selectors.rst 2024-02-16 10:39:16 -06:00
Kevin Lloyd Bernal 9bb973dc54
Refactor LogStats extension to log IPM and RPM to stats on spider_close (#4111) 2024-02-16 12:25:38 +01:00
Jalil SA 3e7b704c08 update: docs/topics/selectors.rst 2024-02-15 16:59:32 -06:00
Jalil SA 660e3b1953 update: docs/topics/items.rst 2024-02-15 16:59:31 -06:00
Mikhail Korobov c5fdba9b31
Merge pull request #6222 from Gallaecio/2.11-port 
2.11 port
 2024-02-15 19:26:40 +05:00
Adrián Chaves 6bd45bb6d9 Merge remote-tracking branch 'scrapy/2.11' into 2.11-port 2024-02-15 06:39:50 +01:00
Jalil SA bccb4cf18b fix: LxmlLinkExtractor unique_list missing key 2024-02-14 12:29:29 -06:00
Adrián Chaves 2f1d345e74 Solve test issues 2024-02-14 18:59:01 +01:00
Adrián Chaves 502addc717 Bump version: 2.11.0 → 2.11.1 2024-02-14 18:17:48 +01:00