RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
10,237 Commits 49 Branches 132 Tags 129 MiB
Commit Graph

10237 Commits

Author SHA1 Message Date
Andrey Rakhmatullin d4709e4104 Don't use types-setuptools. 2024-10-08 16:39:41 +05:00
Andrey Rakhmatullin 18a66d080a Remove the installation dependency on setuptools. 2024-10-08 16:39:41 +05:00
Adrián Chaves 7914437a65
Merge pull request #6467 from wRAR/fix-typing-error 
Fix a typing error with Twisted 24.7.0.
 2024-08-26 17:35:20 +02:00
Andrey Rakhmatullin b80a20c84c Fix a typing error with Twisted 24.7.0. 2024-08-26 19:16:41 +05:00
Martin Breuss 7c1b17f07d
Fix typo in title of contracts.rst (#6444) 2024-07-31 11:36:55 +02:00
Andrey Rakhmatullin b84d000ce0 Bump twine in twinecheck. (#6416) 2024-06-26 17:45:03 +05:00
mlmsmith 571b7f14dc Apply grammar fixes (#6411) 2024-06-23 15:18:17 +05:00
Andrey Rakhmatullin 5b04c3a9d5 Unpin markupsafe in extra-deps. (#6403) 2024-06-17 14:40:30 +05:00
Andrey Rakhmatullin c25628439d Removing empty example reference (#6402) 
Co-authored-by: Michael Duane Mooring <mikeumus@gmail.com>
 2024-06-17 14:40:21 +05:00
Laerte Pereira fdaecbe474 Document missing parts of response.json method 2024-06-16 21:23:35 +05:00
Andrey Rakhmatullin ace800ef27 Move CI from the decommissioned macos-11 to macos-latest. (#6372) 2024-06-16 21:23:31 +05:00
Adrián Chaves e8cb5a03b3 Bump version: 2.11.1 → 2.11.2 2024-05-14 13:23:23 +02:00
Adrián Chaves 2c031f4061 Set the release date of 2.11.2 2024-05-14 13:23:13 +02:00
Adrián Chaves 3ffa17c020 Use posargs for pypy3-pinned 2024-05-14 13:19:07 +02:00
Adrián Chaves c6a8f0e4d9 Update VERSION references 2024-05-13 20:20:20 +02:00
Adrián Chaves 60d2577284 Merge remote-tracking branch '23j4/2.11.2-release-notes' into 2.11 2024-05-13 20:16:23 +02:00
Adrián Chaves 36287cb665 Merge branch 'redirect-protocols' into 2.11 2024-05-13 20:09:00 +02:00
Adrián Chaves f138d5d145 Merge branch 'environ-proxy-protocol' into 2.11 2024-05-13 20:06:15 +02:00
Adrián Chaves 1d0502f25b Merge branch 'advisory-fix' into 2.11 2024-05-13 19:51:49 +02:00
Adrián Chaves bb948af00b
Release notes for 2.11.2 (#6359) 2024-05-13 19:49:37 +02:00
Adrián Chaves 5ad9433dd5 Merge remote-tracking branch 'scrapy/2.11' into 2.11 2024-05-13 16:27:40 +02:00
Kevin Toms ac5d448054 Add FAQ on making a blank request (#6208) 2024-05-13 16:26:26 +02:00
Adrián Chaves a6c89a2e0a scrapy parse: fix the signature of callbacks from the CLI (#6182) 2024-05-13 16:25:07 +02:00
Adrián Chaves 67c77eb9f2 MediaPipeline: log media_to_download errors before stripping them (#5068) 2024-05-13 16:24:51 +02:00
nihilisticneuralnet 1d6d2a8751 [Solved] JOBDIR= None for when Scheduler initializes disk queue even if JOBDIR is empty string (#6124) 
Co-authored-by: John Doe <johndoe@email.com>
 2024-05-13 16:23:10 +02:00
Bagaudin Magomedov fa4c42dfd7 Add SpiderLoggerAdapter, change Spider.logger to return SpiderLoggerAdapter (#6324) 2024-05-13 16:22:46 +02:00
Sanchay Kumar 7ad9eb64c4 Indicate that Selector.type can be json (#6334) 2024-05-13 16:22:31 +02:00
Lorenzo Verardo 1f4523f1a2 Handle robots.txt files not UTF-8 encoded (#6298) 2024-05-13 16:21:57 +02:00
Víctor Ruiz 915f40fa81 Fix WrappedRequest.get_header raising TypeError if default is None (#6310) 2024-05-13 16:21:00 +02:00
Jalil SA 8c0bc1b698 fix: LxmlLinkExtractor unique_list missing key (#6221) 2024-05-13 16:19:52 +02:00
Andrey Rakhmatullin 454bd13a8d Remove the auto-generated copyright years from the docs footer. (#6322) 2024-05-13 16:16:34 +02:00
Adrián Chaves b25f34df69 Bandit: allow-list lxml usages (#6265) 2024-05-13 16:13:34 +02:00
Adrián Chaves 82981fb8a2 Do not close the underlying file from compression plugins (#6239) 2024-05-13 16:10:19 +02:00
Adrián Chaves f149ea4b80
Fix the offsite middleware missing some requests (#6358) 2024-05-13 15:32:53 +02:00
aisha-partha 3562618f67 Set METAREFRESH_IGNORE_TAGS to ['noscript'] by default (#6347) 2024-05-13 14:23:15 +02:00
Andrey Rakhmatullin 397d21f1f5 Cherry-pick WindowsRunSpiderCommandTest fixes (#6290). 2024-05-08 16:42:30 +05:00
Andrey Rakhmatullin 665c84e92c Update MANIFEST.in. 2024-05-08 12:44:50 +05:00
kokobhara bb4ff4d5cd Fix test expectations (#6316) 2024-04-27 20:23:35 +05:00
Adrián Chaves 7983aead92 Release notes for Scrapy 2.11.2 2024-04-11 20:39:10 +02:00
Adrián Chaves 070f13e7c7
Update practices.rst 2024-04-11 12:18:56 +02:00
Adrián Chaves 7a1ab7e1be Do not drop Cookie on http → http 2024-03-06 16:19:19 +01:00
Adrián Chaves 6499214a4f Keep the Cookie header on scheme upgrades 2024-03-06 15:40:13 +01:00
Tsubasa Umeuchi f8d6c456e0 Fixed logic for handling headers on redirect 2024-03-02 14:02:27 +09:00
Yuri H. Galvao 22ee980dd0 Restore brotlipy support (#6261) 2024-03-01 11:40:10 +01:00
Adrián Chaves 1932722277 Use defusedxml.xmlrpc 2024-02-29 09:50:29 +01:00
Adrián Chaves 12cd4f39c8 Fix bug 2024-02-27 23:20:53 +01:00
Adrián Chaves 247e24e5f4 Do not set _scheme_proxy unless necessary 2024-02-27 23:00:49 +01:00
Adrián Chaves c5446c0b85 Fix proxy handling on redirect to different scheme 2024-02-27 22:41:27 +01:00
Adrián Chaves 3cbb6fe596 Merge remote-tracking branch 'scrapy/2.11' into redirect-protocols 2024-02-21 14:38:29 +01:00
Adrián Chaves 11b610dfda
Address tox issues (#6240) 
* Force Python 3.8 in pinned tox envs

* Force werkzeug < 3 when using mitmproxy
 2024-02-21 14:28:39 +01:00