Commit Graph

9554 Commits

Author SHA1 Message Date
Andrey Rakhmatullin 2f12f5c259
Merge pull request #5790 from scrapy/ssl-legacy-reneg
Enable unsafe legacy renegotiation
2023-01-17 16:47:23 +05:00
Andrey Rakhmatullin 43ab8bd16a Roll back the get_openssl_version() type change. 2023-01-13 20:51:07 +04:00
Andrey Rakhmatullin fb52918d23 Set OP_LEGACY_SERVER_CONNECT to support some old servers when using OpenSSL 3. 2023-01-13 20:46:55 +04:00
Andrey Rakhmatullin 93ad6a4bc2 Simplify code for modern pyOpenSSL. 2023-01-13 20:39:44 +04:00
Andrey Rakhmatullin 4af5a06842
Merge pull request #5540 from Gallaecio/download-delay-documentation
Document how DOWNLOAD_DELAY affects per-domain concurrency
2023-01-13 13:00:15 +05:00
Andrey Rakhmatullin 74b8c34de6
Merge pull request #5458 from reidemeister94/fix/unique-list-link-extractors
fix: return unique_list only when link_extractor.unique is True
2023-01-13 01:13:45 +05:00
Andrey Rakhmatullin f87d061069
Merge branch 'master' into download-delay-documentation 2023-01-13 00:22:48 +05:00
Andrey Rakhmatullin 604ddf82fc
Merge pull request #5758 from MattyMay/finish_exporting_for_each_start_exporting
Finish exporting for each start exporting
2023-01-13 00:17:17 +05:00
Andrey Rakhmatullin 2944894c4d
Merge pull request #5764 from jsoref/spelling
Spelling
2023-01-13 00:15:36 +05:00
Adrián Chaves 36b89a4b20
Remove trailing whitespace 2023-01-12 08:36:31 +01:00
silviopavanetto faa5bd0f6b
Update scrapy/linkextractors/lxmlhtml.py
Co-authored-by: Adrián Chaves <adrian@chaves.io>
2023-01-11 20:30:57 +01:00
spav b386c64864 Fix tests for allowing duplicates in extract_links 2023-01-11 19:58:42 +01:00
spav b0ec38876d Fix docstring for extract_links specifying duplicates case 2023-01-11 19:32:33 +01:00
silviopavanetto a70cbfe838
Merge branch 'scrapy:master' into fix/unique-list-link-extractors 2023-01-11 18:15:39 +01:00
Andrey Rakhmatullin 4a5ef81604
Merge pull request #5777 from Malkiz223/fix/http2_cookies
Fix overwriting repeated headers in HTTP2
2023-01-11 21:05:48 +05:00
Adrián Chaves 520be4ff0b Merge remote-tracking branch 'scrapy/master' into fix/http2_cookies 2023-01-11 15:59:59 +01:00
Adrián Chaves d9f6de6bf5 Add a test for receiving duplicate headers 2023-01-11 15:59:45 +01:00
Adrián Chaves 1ab900659e
Fix typo: finis → finish 2023-01-11 14:05:13 +01:00
Mikhail Korobov 3252097b37
Merge pull request #2918 from HarrisonGregg/fix/inspect-response-signal-handling
Fix SIGINT handling when using inspect_response
2023-01-11 17:24:04 +05:00
Andrey Rakhmatullin 90a52957e6
Merge pull request #5786 from Gallaecio/ci-pypy
Minimum cryptography: 3.3 → 3.4.6
2023-01-08 00:48:40 +05:00
Adrián Chaves 16546564f6 Minimum cryptography: 3.3 → 3.4.6 2023-01-06 20:16:54 +01:00
Adrián Chaves 724b033287
Fix CI issues related to asyncio (#5782) 2023-01-06 19:51:07 +01:00
Adrián Chaves fd6742e811
Fix tests for pygments 2.14 (#5783) 2023-01-02 19:13:31 +01:00
Andrey Rakhmatullin 3e03004b3c
Merge pull request #5781 from Gallaecio/ci-clang
Remove Reppy from CI
2023-01-02 20:13:45 +05:00
Andrey Rakhmatullin 80d35a777d
Merge pull request #5780 from Gallaecio/ci
Fix test_pinned_twisted_version
2023-01-02 20:12:52 +05:00
Adrián Chaves 016d1de64e Remove Reppy from CI 2023-01-02 14:13:04 +01:00
Adrián Chaves 6084e8f627 Do not use -U for pip in Tox 2023-01-02 14:00:37 +01:00
Adrián Chaves e47ada2c7c Add CC to tox.ini:[testenv]passenv 2023-01-02 13:49:25 +01:00
Adrián Chaves c4d7f5e7a9 Use CLang to build Reppy 2023-01-02 13:41:08 +01:00
Laerte Pereira deaf1fb6cf
Stop using setup.py (#5776) 2022-12-31 20:11:45 +01:00
Malkiz223 517ed0749b Fix overwriting repeated headers 2022-12-31 00:51:43 +03:00
Steve Niafas 7ae32ea38d
Fix transparency for processed webp images (#5767) 2022-12-22 14:33:14 +01:00
Andrey Rahmatullin 8eb8b23b10
Merge pull request #5768 from KDreynolds/patch-1
Update setup.py
2022-12-21 23:41:42 +05:00
Kyle Reynolds 3b5ce4c182
Update setup.py
Sorry about the goof up.
2022-12-21 10:51:50 -07:00
Kyle Reynolds 2e54237649
Update setup.py
adding author_email to match_maintainer email for thoroughness' sake
2022-12-20 17:54:06 -07:00
Matt Mayfield a0832081ba Merge branch 'master' into finish_exporting_for_each_start_exporting 2022-12-19 18:12:02 -05:00
Matt Mayfield 0a84ce448c Fix InstrumentedFeedSlot
I accidentally called the wrong super method in overriden
finish_exporting
2022-12-19 18:09:43 -05:00
Josh Soref 41734bb5c1 spelling: unencodeable
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
2022-12-18 21:46:49 -05:00
Josh Soref 8a526d161c spelling: user
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
2022-12-18 21:46:11 -05:00
Josh Soref 2cb1e6668a spelling: workaround
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
2022-12-18 21:33:21 -05:00
Josh Soref 860fbef608 spelling: unknown
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
2022-12-18 21:33:21 -05:00
Josh Soref 1e44d4614e spelling: straight
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
2022-12-18 21:33:21 -05:00
Josh Soref 010cf9d420 spelling: refresh
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
2022-12-18 21:33:21 -05:00
Josh Soref d27c611cc0 spelling: referrer
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
2022-12-18 21:33:21 -05:00
Josh Soref 6aa5374bd3 spelling: received
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
2022-12-18 21:33:21 -05:00
Josh Soref 826e0ee611 spelling: preexisting
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
2022-12-18 21:33:21 -05:00
Josh Soref 66ab82f126 spelling: precedence
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
2022-12-18 21:33:21 -05:00
Josh Soref 8ae77fdb34 spelling: pipeline
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
2022-12-18 21:33:21 -05:00
Josh Soref f5d024f16c spelling: parsley
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
2022-12-18 21:33:21 -05:00
Josh Soref 1a5cf00db7 spelling: overridden
Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
2022-12-18 21:33:21 -05:00