RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
9,583 Commits 50 Branches 132 Tags 142 MiB
Commit Graph

9583 Commits

Author SHA1 Message Date
Adrián Chaves 9272c4af0c Merge remote-tracking branch 'scrapy/master' into no-callback 2023-01-25 17:41:41 +01:00
Adrián Chaves e71eab6932
Use black (#5734) 2023-01-25 12:03:46 +01:00
Emmanuel Rondan 72a853c751 fixing contributing page with suggestions 2023-01-23 14:56:48 -03:00
Emmanuel Rondan f2c22aaabb Merge remote-tracking branch 'upstream/master' into add-black-formatter 2023-01-20 17:08:07 -03:00
Emmanuel Rondan 8ee4817471 reaplying black, fixing conflicts and ignoring bandit checks on test directory 2023-01-20 10:55:46 -03:00
Andrey Rakhmatullin 9cb757d239
Merge pull request #5800 from Laerte/chore/feed-export-encoding 
Set `FEED_EXPORT_ENCODING='utf-8'` in the default template
 2023-01-20 17:47:43 +05:00
Laerte Pereira b611848029
fix(docs): Change `versionchanged` value 2023-01-20 08:35:17 -03:00
Laerte Pereira 973f0cf567
fix: line break 2023-01-20 08:23:05 -03:00
Laerte Pereira 8270df754d
Set `FEED_EXPORT_ENCODING='utf-8'` in the default template 2023-01-20 07:55:16 -03:00
Adrián Chaves 4242ae405d Restore Python 3.7 support 2023-01-19 20:37:24 +01:00
Adrián Chaves 5c1559f60e Address typing issues 2023-01-19 20:30:22 +01:00
Adrián Chaves a493464942 Update the screenshot pipeline code example 2023-01-19 19:53:53 +01:00
Tobias Mayr f449ee5377
Fix SMTP STARTTLS for Twisted >= 21.2.0 (#5406) 2023-01-19 19:44:55 +01:00
Adrián Chaves 50500a6b28 Implement a NO_CALLBACK value for Request.callback 2023-01-19 17:14:18 +01:00
Emmanuel Rondan 23e8b553b4 fixing docs with suggestions 2023-01-18 11:46:12 -03:00
Emmanuel Rondan 482a0b79e3 explaining pre-commit on documentation 2023-01-17 14:26:12 -03:00
Serhii A caaeb235a0
scrapy.utils.console.DEFAULT_PYTHON_SHELLS: OrderedDict → dict (#5795) 2023-01-17 12:52:41 +01:00
Andrey Rakhmatullin 2f12f5c259
Merge pull request #5790 from scrapy/ssl-legacy-reneg 
Enable unsafe legacy renegotiation
 2023-01-17 16:47:23 +05:00
Andrey Rakhmatullin 43ab8bd16a Roll back the get_openssl_version() type change. 2023-01-13 20:51:07 +04:00
Andrey Rakhmatullin fb52918d23 Set OP_LEGACY_SERVER_CONNECT to support some old servers when using OpenSSL 3. 2023-01-13 20:46:55 +04:00
Andrey Rakhmatullin 93ad6a4bc2 Simplify code for modern pyOpenSSL. 2023-01-13 20:39:44 +04:00
Andrey Rakhmatullin 4af5a06842
Merge pull request #5540 from Gallaecio/download-delay-documentation 
Document how DOWNLOAD_DELAY affects per-domain concurrency
 2023-01-13 13:00:15 +05:00
Andrey Rakhmatullin 74b8c34de6
Merge pull request #5458 from reidemeister94/fix/unique-list-link-extractors 
fix: return unique_list only when link_extractor.unique is True
 2023-01-13 01:13:45 +05:00
Andrey Rakhmatullin f87d061069
Merge branch 'master' into download-delay-documentation 2023-01-13 00:22:48 +05:00
Andrey Rakhmatullin 604ddf82fc
Merge pull request #5758 from MattyMay/finish_exporting_for_each_start_exporting 
Finish exporting for each start exporting
 2023-01-13 00:17:17 +05:00
Andrey Rakhmatullin 2944894c4d
Merge pull request #5764 from jsoref/spelling 
Spelling
 2023-01-13 00:15:36 +05:00
Adrián Chaves 36b89a4b20
Remove trailing whitespace 2023-01-12 08:36:31 +01:00
silviopavanetto faa5bd0f6b
Update scrapy/linkextractors/lxmlhtml.py 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2023-01-11 20:30:57 +01:00
spav b386c64864 Fix tests for allowing duplicates in extract_links 2023-01-11 19:58:42 +01:00
spav b0ec38876d Fix docstring for extract_links specifying duplicates case 2023-01-11 19:32:33 +01:00
silviopavanetto a70cbfe838
Merge branch 'scrapy:master' into fix/unique-list-link-extractors 2023-01-11 18:15:39 +01:00
Andrey Rakhmatullin 4a5ef81604
Merge pull request #5777 from Malkiz223/fix/http2_cookies 
Fix overwriting repeated headers in HTTP2
 2023-01-11 21:05:48 +05:00
Adrián Chaves 520be4ff0b Merge remote-tracking branch 'scrapy/master' into fix/http2_cookies 2023-01-11 15:59:59 +01:00
Adrián Chaves d9f6de6bf5 Add a test for receiving duplicate headers 2023-01-11 15:59:45 +01:00
Adrián Chaves 1ab900659e
Fix typo: finis → finish 2023-01-11 14:05:13 +01:00
Mikhail Korobov 3252097b37
Merge pull request #2918 from HarrisonGregg/fix/inspect-response-signal-handling 
Fix SIGINT handling when using inspect_response
 2023-01-11 17:24:04 +05:00
Andrey Rakhmatullin 90a52957e6
Merge pull request #5786 from Gallaecio/ci-pypy 
Minimum cryptography: 3.3 → 3.4.6
 2023-01-08 00:48:40 +05:00
Adrián Chaves 16546564f6 Minimum cryptography: 3.3 → 3.4.6 2023-01-06 20:16:54 +01:00
Adrián Chaves 724b033287
Fix CI issues related to asyncio (#5782) 2023-01-06 19:51:07 +01:00
Adrián Chaves fd6742e811
Fix tests for pygments 2.14 (#5783) 2023-01-02 19:13:31 +01:00
Andrey Rakhmatullin 3e03004b3c
Merge pull request #5781 from Gallaecio/ci-clang 
Remove Reppy from CI
 2023-01-02 20:13:45 +05:00
Andrey Rakhmatullin 80d35a777d
Merge pull request #5780 from Gallaecio/ci 
Fix test_pinned_twisted_version
 2023-01-02 20:12:52 +05:00
Adrián Chaves 016d1de64e Remove Reppy from CI 2023-01-02 14:13:04 +01:00
Adrián Chaves 6084e8f627 Do not use -U for pip in Tox 2023-01-02 14:00:37 +01:00
Adrián Chaves e47ada2c7c Add CC to tox.ini:[testenv]passenv 2023-01-02 13:49:25 +01:00
Adrián Chaves c4d7f5e7a9 Use CLang to build Reppy 2023-01-02 13:41:08 +01:00
Laerte Pereira deaf1fb6cf
Stop using setup.py (#5776) 2022-12-31 20:11:45 +01:00
Malkiz223 517ed0749b Fix overwriting repeated headers 2022-12-31 00:51:43 +03:00
Emmanuel Rondan 1ebcd86c04 ignoring last changes made by black for blame 2022-12-29 12:51:05 -03:00
Emmanuel Rondan c5cdd0d30c reaplying black again and removing line length on pre-commit black config 2022-12-29 12:48:20 -03:00