RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
10,710 Commits 49 Branches 132 Tags 141 MiB
Commit Graph

10710 Commits

Author SHA1 Message Date
Adrián Chaves 6b88b3346c Set the release date of versions 2.11.1 and 1.8.4 2024-02-14 18:16:40 +01:00
Adrián Chaves 479619b340 Merge branch '2.11-redos' into 2.11 2024-02-14 17:18:26 +01:00
Adrián Chaves 809bfac489 Merge branch '2.11-compression-bomb' into 2.11 2024-02-14 17:16:25 +01:00
Adrián Chaves 5bcb8fd501 Merge branch '2.11-authorization' into 2.11 2024-02-14 17:14:29 +01:00
Andrey Rakhmatullin a55e933c11
Release notes for 2.11.1 (#6150) 2024-02-14 17:08:40 +01:00
Andy 1c9d308acc
Cover the deprecation and removal of response_httprepr in the release notes (#6216) 2024-02-05 12:52:01 +01:00
Adrián Chaves 5e5a92026e Remove slow leftovers 2024-02-02 14:06:45 +01:00
Adrián Chaves 810aaa637d Undo an unintended change 2024-02-02 14:04:28 +01:00
Adrián Chaves c5dad41190 Speed up tests, remove comments without regexps 2024-02-02 14:03:16 +01:00
Andrey Rakhmatullin 6f73dc0e67
Merge pull request #6213 from Laerte/master 
Cleanup deprecated fingerprint code in scrapy.utils.request
 2024-01-31 21:00:48 +04:00
Laerte Pereira 53ccf0016d Remove empty statement 2024-01-31 13:18:10 -03:00
Laerte Pereira 7001193c80 Simplify the logic 2024-01-31 12:53:08 -03:00
Laerte Pereira 24634f1bb2 Attend PR comments 2024-01-31 12:29:43 -03:00
Laerte Pereira bacaf0db7a Update documentation 2024-01-31 10:14:48 -03:00
Laerte Pereira 019443dd57 Remove settings from default implementation test 2024-01-31 10:08:07 -03:00
Laerte Pereira 2487e3cc03 Cleanup deprecated fingerprint code in scrapy.utils.request 2024-01-31 10:05:50 -03:00
Andrey Rakhmatullin 4229048255
Merge pull request #6208 from kevintomsgithub/add-faq 
Add FAQ on making a blank request
 2024-01-18 21:56:12 +04:00
Kevin Toms 9074c16497 make suggestion 2024-01-18 09:36:25 -05:00
Kevin Toms 46f94ec9cb Fix test 
Wrap the yield line in a function to prevent throwing error when the code snippet is executed
 2024-01-17 15:49:51 -05:00
Kevin Toms 88285e75b6 Add FAQ on making a blank request 2024-01-17 10:05:22 -05:00
Andrey Rakhmatullin 09a7efef7c Remove a defer.returnValue call. 2024-01-15 18:19:29 +04:00
Rotzbua d5233bb57f
chore(docs): update `sphinx` dependencies (#6200) 2024-01-15 14:11:33 +01:00
Adrián Chaves e8dadb9592
scrapy parse: fix the signature of callbacks from the CLI (#6182) 2024-01-15 13:37:03 +01:00
Adrián Chaves fa0c598096
Add component getters to Crawler (#6181) 2024-01-15 13:14:02 +01:00
Mikhail Korobov 8ad17f7476
Merge pull request #6199 from Rotzbua/fix_flake8 
fix(flake8): lint errors
 2024-01-12 22:52:22 +05:00
Mikhail Korobov b7cf30a48e
Merge pull request #6205 from wRAR/fix-pypy-tests 
Remove a defer.returnValue call.
 2024-01-12 22:50:41 +05:00
Andrey Rakhmatullin c2baf4d0da Remove a defer.returnValue call. 2024-01-12 18:30:41 +04:00
Andrey Rakhmatullin becff65ccb
Merge pull request #6201 from wRAR/more-mitmproxy 
Fix and re-enable newer mitmproxy usage in tests.
 2024-01-12 14:26:39 +04:00
Mikhail Korobov 32fda2dc53
Merge pull request #6196 from Rotzbua/fix_typo 
fix(typo): correct `successfully`
 2024-01-12 00:36:16 +05:00
Mikhail Korobov 7eeca55c70
Merge pull request #6197 from Rotzbua/refactor_yield 
refactor(yield): use `yield from` syntax
 2024-01-12 00:35:56 +05:00
Mikhail Korobov 825137399d
Merge pull request #6198 from Rotzbua/refactor_exception 
refactor(): use `OSError` exception
 2024-01-12 00:32:51 +05:00
Andrey Rakhmatullin 68fccb1d58 Fix and re-enable newer mitmproxy usage in tests. 2024-01-06 01:35:56 +04:00
Rotzbua 745b8412f6
fix(flake8): lint errors 
E226 missing whitespace around arithmetic operator
E201 whitespace after '{'
 2024-01-05 14:54:00 +01:00
Rotzbua 42c481cb4a
refactor(): use `OSError` exception 
https://docs.astral.sh/ruff/rules/os-error-alias/
 2024-01-05 12:36:36 +01:00
Rotzbua 0d445a3224
refactor(yield): use `yield from` syntax 2024-01-05 12:30:10 +01:00
Rotzbua c7b2b097b1
fix(typo): correct `successfully` 2024-01-05 10:50:45 +01:00
Adrián Chaves 6127f7d278 Update quotes.toscrape.com page copies (#6190) 2024-01-01 22:58:34 +04:00
Chan Sau Yee badc7c5be9 Update black reference in docs (#6192) 2024-01-01 22:58:21 +04:00
Chan Sau Yee 40e623b276
Add type hints (#6191) 2023-12-29 12:33:37 +01:00
Chan Sau Yee 1902284942
Update black reference in docs (#6192) 2023-12-29 12:32:51 +01:00
Adrián Chaves 34e01a8a93
Update quotes.toscrape.com page copies (#6190) 2023-12-28 12:25:01 +01:00
Andrey Rakhmatullin 2534a28ef0 Bump mypy. 2023-12-25 15:03:08 +04:00
Adrián Chaves 0e78acb657
MediaPipeline: log media_to_download errors before stripping them (#5068) 2023-12-21 21:01:07 +01:00
Jalil SA d25cfe5315
Add JsonResponse (#6174) 2023-12-21 10:36:21 +01:00
Adrián Chaves 48a9a58ff2 Link to Zyte’s export guides 2023-12-20 21:43:21 +04:00
Adrián Chaves 369712ee50 SPM → Zyte API (#6163) 2023-12-20 21:43:13 +04:00
Adrián Chaves b095dd218f Extend Request.meta documentation (#5565) 2023-12-20 21:43:03 +04:00
Mikhail Korobov b498f1376d
Merge pull request #6183 from Gallaecio/zyte-guides 
Link to Zyte’s export guides
 2023-12-20 22:22:22 +05:00
Andrey Rakhmatullin f56b5fc39e Bump typing deps. 2023-12-20 16:19:11 +04:00
Andrey Rakhmatullin a72394a388 Add tests for replace() with kwargs. 2023-12-20 16:14:53 +04:00