RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
10,237 Commits 49 Branches 132 Tags 130 MiB
Commit Graph

10237 Commits

Author SHA1 Message Date
Andrey Rakhmatullin 53539483c3 Refactor _StreamReader.read(). 2023-08-07 15:13:20 +04:00
Andrey Rakhmatullin 2c7484d433 Merge remote-tracking branch 'origin/master' into typing-utils-2 2023-08-07 14:55:38 +04:00
Andrey Rakhmatullin 110d5fffb4
Update tool versions. (#6002) 2023-08-07 10:57:48 +02:00
Andrey Rakhmatullin 23af21491d Move definitions around to woark around a pypy3.8 bug. 2023-08-07 00:21:06 +04:00
Andrey Rakhmatullin 644a71bfd4 Use ftp:// URLs in FTP tests. 2023-08-07 00:17:52 +04:00
Andrey Rakhmatullin 471281d29e Fixes for scrapy/utils/iterators.py typing. 2023-08-06 23:05:02 +04:00
Andrey Rakhmatullin f5f593e5f5 Remove a workaround for a w3lib typing bug. 2023-08-06 17:46:28 +04:00
Andrey Rakhmatullin e2adec629b Fix regressions in typing. 2023-08-06 17:44:24 +04:00
Andrey Rakhmatullin 518e56046e Check for async callbacks in contracts. 2023-08-06 17:28:34 +04:00
Andrey Rakhmatullin 66bad1150c Add more typing for scrapy/utils/signal.py. 2023-08-06 00:35:33 +04:00
Andrey Rakhmatullin 9fe662d856 Add typing for scrapy/utils/testproc.py. 2023-08-06 00:35:33 +04:00
Andrey Rakhmatullin d1f87e4f08 More typing for scrapy/utils/iterators.py. 2023-08-06 00:35:33 +04:00
Andrey Rakhmatullin c43798cb9b More typing for scrapy/utils/defer.py and scrapy/utils/spider.py. 2023-08-06 00:35:33 +04:00
Andrey Rakhmatullin d015329d75 Add more typing for scrapy/utils/log.py. 2023-08-06 00:35:33 +04:00
Andrey Rakhmatullin d31829b72f More typing for scrapy/utils. 2023-08-06 00:35:33 +04:00
Andrey Rakhmatullin 88327c7c58 Bump version: 2.9.0 → 2.10.0 2023-08-04 17:23:30 +04:00
Andrey Rakhmatullin 4d288c8bf3
Merge pull request #6001 from scrapy/relnotes-2.10 
Add release notes for 2.10.0.
 2023-08-04 17:22:16 +04:00
Andrey Rakhmatullin 022ef0f86b
Apply suggestions from code review 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2023-08-04 17:05:09 +04:00
Andrey Rakhmatullin 7fe4c0c9f7
Update docs/news.rst 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2023-08-04 16:56:39 +04:00
Andrey Rakhmatullin c14a0a9d5d Add release notes for 2.10.0. 2023-08-04 16:36:27 +04:00
Andrey Rakhmatullin 12638386dc
Merge pull request #6000 from Gallaecio/asyncio-module-level-twisted-imports-issue 
asyncio docs: cover accidental bad reactor installation
 2023-08-04 15:26:50 +04:00
Georgiy Zatserklianyi e9b088f1fb periodic_log: typing 2023-08-04 12:49:22 +03:00
Georgiy Zatserklianyi 8b6a50a935 periodic_log: docs added 2023-08-04 11:12:07 +03:00
Adrián Chaves 72de48be6d asyncio: cover accidental bad reactor installation, sort sections, reword the Windows section 2023-08-04 09:56:30 +02:00
Laerte Pereira 09c63a178b
Remove the deprecated spider parameter from the engine (#5998) 2023-08-04 07:53:04 +02:00
Andrey Rakhmatullin e58c8ca638
Merge pull request #5999 from Laerte/chore/enable-python3.11-on-ci 
Enable Python 3.11 on Windows CI
 2023-08-04 02:18:05 +04:00
Laerte Pereira 8a0a9e6d3e
Enable Python 3.11 on Windows CI 2023-08-03 18:31:12 -03:00
Laerte Pereira b9c32a0cfd
Remove functions deprecated in 2.6.0 (#5996) 2023-08-03 17:06:55 +02:00
Andrey Rakhmatullin 7c6aaedda2
Merge pull request #5846 from jxlil/docs/spiders 
Added documentation for Spider.update_settings
 2023-08-02 21:09:44 +04:00
Andrey Rakhmatullin af1be835e4
Apply suggestions from code review 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2023-08-02 19:46:16 +04:00
Andrey Rakhmatullin 9f9a2292e0
Deprecate the custom attribute of build_component_list(). (#5993) 2023-08-02 14:21:06 +02:00
Andrey Rakhmatullin 72462a53e2 Add more docs for update_settings(). 2023-08-02 12:32:53 +04:00
Andrey Rakhmatullin 06ebdee35d
Merge pull request #5950 from wRAR/addons 
Add-ons
 2023-08-01 22:18:57 +04:00
Andrey Rakhmatullin e58b8078f0 Improve NotConfigured handling when clspath is a class. 2023-08-01 20:20:15 +04:00
Andrey Rakhmatullin f803ad63f3 Fix a typing issue. 2023-08-01 17:23:09 +04:00
Andrey Rakhmatullin 7fdeb5c5c1 Improve NotConfigured handling in add-ons. 2023-08-01 16:58:18 +04:00
Andrey Rakhmatullin cf55eb05f5 Fix a typo. 2023-08-01 13:30:56 +04:00
Andrey Rakhmatullin 41a4a163e3 Handle NotConfigured in add-ons. 2023-07-31 21:09:18 +04:00
Andrey Rakhmatullin b67a81b81d Use the MyHandler class directly. 2023-07-31 20:25:56 +04:00
Andrey Rakhmatullin d8c5b41559 Add more addon tests. 2023-07-31 19:09:21 +04:00
Andrey Rakhmatullin bddbbc522a
Merge pull request #5979 from BurnzZ/closespider-timeout-no-item 2023-07-28 12:56:44 +04:00
freddiewanah c4f0aa4fdf
Refactor test cases to improve unit test quality (#5986) 2023-07-26 13:09:03 +02:00
Andrey Rakhmatullin 6e3e3c2172
Merge pull request #5977 from scrapy/typing-settings 
Typing for scrapy.settings.BaseSettings
 2023-07-24 21:40:52 +04:00
Andrey Rakhmatullin 7a1afff655
Merge pull request #5980 from BurnzZ/s3-region 
expose AWS_REGION_NAME in S3FeedStorage
 2023-07-24 21:40:37 +04:00
Andrey Rakhmatullin 3ba2dc4d68 Fixes for addon docs. 2023-07-24 17:49:04 +04:00
Kevin Lloyd Bernal a689fe5baf move region_name param as kwargs 2023-07-24 16:37:52 +08:00
Kevin Lloyd Bernal 9a1bf40c2f expose AWS_REGION_NAME in S3FeedStorage 2023-07-24 16:37:52 +08:00
Laerte Pereira 7522aeed35
fix: -O/-o option does not work with absolute paths on Windows (#5971) 2023-07-24 09:53:41 +02:00
Andrey Rakhmatullin 5e1582491b mypy --show-error-codes is the default now. 2023-07-22 23:19:25 +04:00
Mikhail Korobov af2aa4b421
Merge pull request #5847 from namelessGonbai/feat/FixFeedExport 
Fix FeedExporter not to export empty file
 2023-07-22 23:18:36 +05:00