RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
10,710 Commits 50 Branches 132 Tags 142 MiB
Commit Graph

10710 Commits

Author SHA1 Message Date
Jalil SA a5c1ef8276 sort imports with isort 2023-01-25 14:25:15 -06:00
Jalil SA 6d0f9df8c1 added isort.cfg 2023-01-25 14:22:42 -06:00
Andrey Rakhmatullin 69bb9a7859 Install types-Pillow and types-Pygments. 2023-01-25 23:52:46 +04:00
Andrey Rakhmatullin a4edff31b9 Replace lxml-stubs with types-lxml. 2023-01-25 23:30:21 +04:00
Andrey Rakhmatullin e9094d1f38 Address remaining typing issues in scrapy.core. 2023-01-25 23:22:18 +04:00
Andrey Rakhmatullin 5fde6d5339 Don't type-check Twisted interfaces. 2023-01-25 22:54:46 +04:00
Andrey Rakhmatullin 764a9d47bb Fix typing of inlineCallbacks-decorated functions. 2023-01-25 22:31:12 +04:00
Andrey Rakhmatullin 232aab53b3 Fix most of the new typing issues in utils. 2023-01-25 22:28:15 +04:00
Andrey Rakhmatullin afd5d85320 Fix remaining issues in tests. 2023-01-25 22:15:10 +04:00
Andrey Rakhmatullin 2e33fb812b Silence improper typing of twisted.internet.reactor in tests. 2023-01-25 22:15:07 +04:00
Andrey Rakhmatullin c0ea7fd4fd Remove obsolete top-level run code in tests. 2023-01-25 22:14:24 +04:00
Andrey Rakhmatullin 73f697f1db Re-enable follow_imports. 2023-01-25 22:11:26 +04:00
Adrián Chaves 1f3e42897a _NoCallback → NoCallbackType 2023-01-25 18:30:29 +01:00
Adrián Chaves 9d07be61b4 Merge remote-tracking branch 'Gallaecio/no-callback' into no-callback 2023-01-25 17:49:36 +01:00
Adrián Chaves c883a13006 Make the _set_xback condition more readable 2023-01-25 17:43:10 +01:00
Adrián Chaves 9272c4af0c Merge remote-tracking branch 'scrapy/master' into no-callback 2023-01-25 17:41:41 +01:00
Adrián Chaves e71eab6932
Use black (#5734) 2023-01-25 12:03:46 +01:00
Alex 42e8d5a615 fixing type declerations 2023-01-25 01:03:27 -08:00
Alex 7c753adbe5 revert mypy fix didn't work 2023-01-24 23:05:17 -08:00
Alex 44512bebc8 fixed mypy warnings with type declaration for os.PathLike 2023-01-24 22:57:25 -08:00
Alex 84fb234cae fixed additional trigger in FilesPipeline 2023-01-24 22:47:38 -08:00
Emmanuel Rondan 72a853c751 fixing contributing page with suggestions 2023-01-23 14:56:48 -03:00
Alex 085b340e8a
Merge branch 'scrapy:master' into path_object_error_#5739 2023-01-22 21:46:28 -08:00
Laerte Pereira 0cfe81d1d3
`set-output` command is deprecated 2023-01-21 16:57:31 -03:00
Emmanuel Rondan f2c22aaabb Merge remote-tracking branch 'upstream/master' into add-black-formatter 2023-01-20 17:08:07 -03:00
Emmanuel Rondan 8ee4817471 reaplying black, fixing conflicts and ignoring bandit checks on test directory 2023-01-20 10:55:46 -03:00
Andrey Rakhmatullin 9cb757d239
Merge pull request #5800 from Laerte/chore/feed-export-encoding 
Set `FEED_EXPORT_ENCODING='utf-8'` in the default template
 2023-01-20 17:47:43 +05:00
Adrián Chaves 818d69fa00
Fix typo: it → is 
Co-authored-by: Andrey Rakhmatullin <wrar@wrar.name>
 2023-01-20 12:38:07 +01:00
Laerte Pereira b611848029
fix(docs): Change `versionchanged` value 2023-01-20 08:35:17 -03:00
Laerte Pereira 973f0cf567
fix: line break 2023-01-20 08:23:05 -03:00
Laerte Pereira 8270df754d
Set `FEED_EXPORT_ENCODING='utf-8'` in the default template 2023-01-20 07:55:16 -03:00
Alex b1dd893fbb Support Path Objects Issue #5739 2023-01-20 02:17:02 -08:00
Adrián Chaves 4242ae405d Restore Python 3.7 support 2023-01-19 20:37:24 +01:00
Adrián Chaves 5c1559f60e Address typing issues 2023-01-19 20:30:22 +01:00
Adrián Chaves a493464942 Update the screenshot pipeline code example 2023-01-19 19:53:53 +01:00
Tobias Mayr f449ee5377
Fix SMTP STARTTLS for Twisted >= 21.2.0 (#5406) 2023-01-19 19:44:55 +01:00
Adrián Chaves 50500a6b28 Implement a NO_CALLBACK value for Request.callback 2023-01-19 17:14:18 +01:00
Emmanuel Rondan 23e8b553b4 fixing docs with suggestions 2023-01-18 11:46:12 -03:00
Emmanuel Rondan 482a0b79e3 explaining pre-commit on documentation 2023-01-17 14:26:12 -03:00
Serhii A caaeb235a0
scrapy.utils.console.DEFAULT_PYTHON_SHELLS: OrderedDict → dict (#5795) 2023-01-17 12:52:41 +01:00
Andrey Rakhmatullin 2f12f5c259
Merge pull request #5790 from scrapy/ssl-legacy-reneg 
Enable unsafe legacy renegotiation
 2023-01-17 16:47:23 +05:00
Andrey Rakhmatullin 43ab8bd16a Roll back the get_openssl_version() type change. 2023-01-13 20:51:07 +04:00
Andrey Rakhmatullin fb52918d23 Set OP_LEGACY_SERVER_CONNECT to support some old servers when using OpenSSL 3. 2023-01-13 20:46:55 +04:00
Andrey Rakhmatullin 93ad6a4bc2 Simplify code for modern pyOpenSSL. 2023-01-13 20:39:44 +04:00
Andrey Rakhmatullin 4af5a06842
Merge pull request #5540 from Gallaecio/download-delay-documentation 
Document how DOWNLOAD_DELAY affects per-domain concurrency
 2023-01-13 13:00:15 +05:00
Andrey Rakhmatullin 74b8c34de6
Merge pull request #5458 from reidemeister94/fix/unique-list-link-extractors 
fix: return unique_list only when link_extractor.unique is True
 2023-01-13 01:13:45 +05:00
Andrey Rakhmatullin f87d061069
Merge branch 'master' into download-delay-documentation 2023-01-13 00:22:48 +05:00
Andrey Rakhmatullin 604ddf82fc
Merge pull request #5758 from MattyMay/finish_exporting_for_each_start_exporting 
Finish exporting for each start exporting
 2023-01-13 00:17:17 +05:00
Andrey Rakhmatullin 2944894c4d
Merge pull request #5764 from jsoref/spelling 
Spelling
 2023-01-13 00:15:36 +05:00
Adrián Chaves 36b89a4b20
Remove trailing whitespace 2023-01-12 08:36:31 +01:00