RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
10,021 Commits 49 Branches 132 Tags 141 MiB
Commit Graph

10021 Commits

Author SHA1 Message Date
Andrey Rakhmatullin 9df67a554e Add RequestFingerprinterProtocol. 2023-08-10 22:53:22 +04:00
Andrey Rakhmatullin b50268c100 Full typing for scrapy/link.py. 2023-08-09 23:56:16 +04:00
Andrey Rakhmatullin e6d919497d More typing for scrapy/core/scheduler.py. 2023-08-09 23:56:16 +04:00
Andrey Rakhmatullin 7dca18e2e7 Full typing for scrapy/responsetypes.py. 2023-08-09 23:56:16 +04:00
Andrey Rakhmatullin c5885fc13b Full typing for scrapy/exceptions.py. 2023-08-09 23:56:16 +04:00
Andrey Rakhmatullin 9960c62b87 Full typing for scrapy/logformatter.py. 2023-08-09 23:56:16 +04:00
Andrey Rakhmatullin 89503ae3f1 Full typing for scrapy/dupefilters.py. 2023-08-09 23:56:16 +04:00
Andrey Rakhmatullin dc6e142096 Full typing for scrapy/spiderloader.py. 2023-08-09 23:56:16 +04:00
Andrey Rakhmatullin 084a9ba076 Full typing for scrapy/crawler.py and scrapy/spiders/__init__.py. 2023-08-09 23:56:16 +04:00
Andrey Rakhmatullin 85696d7bab
Merge pull request #6003 from wRAR/typing-utils-2 
Typing for scrapy/utils, second pass
 2023-08-09 23:56:03 +04:00
Andrey Rakhmatullin 8050257c14 Small cleanup. 2023-08-09 23:17:32 +04:00
Andrey Rakhmatullin 53539483c3 Refactor _StreamReader.read(). 2023-08-07 15:13:20 +04:00
Andrey Rakhmatullin 2c7484d433 Merge remote-tracking branch 'origin/master' into typing-utils-2 2023-08-07 14:55:38 +04:00
Andrey Rakhmatullin 110d5fffb4
Update tool versions. (#6002) 2023-08-07 10:57:48 +02:00
Andrey Rakhmatullin 23af21491d Move definitions around to woark around a pypy3.8 bug. 2023-08-07 00:21:06 +04:00
Andrey Rakhmatullin 644a71bfd4 Use ftp:// URLs in FTP tests. 2023-08-07 00:17:52 +04:00
Andrey Rakhmatullin 471281d29e Fixes for scrapy/utils/iterators.py typing. 2023-08-06 23:05:02 +04:00
Andrey Rakhmatullin f5f593e5f5 Remove a workaround for a w3lib typing bug. 2023-08-06 17:46:28 +04:00
Andrey Rakhmatullin e2adec629b Fix regressions in typing. 2023-08-06 17:44:24 +04:00
Andrey Rakhmatullin 518e56046e Check for async callbacks in contracts. 2023-08-06 17:28:34 +04:00
Andrey Rakhmatullin 66bad1150c Add more typing for scrapy/utils/signal.py. 2023-08-06 00:35:33 +04:00
Andrey Rakhmatullin 9fe662d856 Add typing for scrapy/utils/testproc.py. 2023-08-06 00:35:33 +04:00
Andrey Rakhmatullin d1f87e4f08 More typing for scrapy/utils/iterators.py. 2023-08-06 00:35:33 +04:00
Andrey Rakhmatullin c43798cb9b More typing for scrapy/utils/defer.py and scrapy/utils/spider.py. 2023-08-06 00:35:33 +04:00
Andrey Rakhmatullin d015329d75 Add more typing for scrapy/utils/log.py. 2023-08-06 00:35:33 +04:00
Andrey Rakhmatullin d31829b72f More typing for scrapy/utils. 2023-08-06 00:35:33 +04:00
Andrey Rakhmatullin 88327c7c58 Bump version: 2.9.0 → 2.10.0 2023-08-04 17:23:30 +04:00
Andrey Rakhmatullin 4d288c8bf3
Merge pull request #6001 from scrapy/relnotes-2.10 
Add release notes for 2.10.0.
 2023-08-04 17:22:16 +04:00
Andrey Rakhmatullin 022ef0f86b
Apply suggestions from code review 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2023-08-04 17:05:09 +04:00
Andrey Rakhmatullin 7fe4c0c9f7
Update docs/news.rst 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2023-08-04 16:56:39 +04:00
Andrey Rakhmatullin c14a0a9d5d Add release notes for 2.10.0. 2023-08-04 16:36:27 +04:00
Andrey Rakhmatullin 12638386dc
Merge pull request #6000 from Gallaecio/asyncio-module-level-twisted-imports-issue 
asyncio docs: cover accidental bad reactor installation
 2023-08-04 15:26:50 +04:00
Adrián Chaves 72de48be6d asyncio: cover accidental bad reactor installation, sort sections, reword the Windows section 2023-08-04 09:56:30 +02:00
Laerte Pereira 09c63a178b
Remove the deprecated spider parameter from the engine (#5998) 2023-08-04 07:53:04 +02:00
Andrey Rakhmatullin e58c8ca638
Merge pull request #5999 from Laerte/chore/enable-python3.11-on-ci 
Enable Python 3.11 on Windows CI
 2023-08-04 02:18:05 +04:00
Laerte Pereira 8a0a9e6d3e
Enable Python 3.11 on Windows CI 2023-08-03 18:31:12 -03:00
Laerte Pereira b9c32a0cfd
Remove functions deprecated in 2.6.0 (#5996) 2023-08-03 17:06:55 +02:00
Andrey Rakhmatullin 7c6aaedda2
Merge pull request #5846 from jxlil/docs/spiders 
Added documentation for Spider.update_settings
 2023-08-02 21:09:44 +04:00
Andrey Rakhmatullin af1be835e4
Apply suggestions from code review 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2023-08-02 19:46:16 +04:00
Andrey Rakhmatullin 9f9a2292e0
Deprecate the custom attribute of build_component_list(). (#5993) 2023-08-02 14:21:06 +02:00
Andrey Rakhmatullin 72462a53e2 Add more docs for update_settings(). 2023-08-02 12:32:53 +04:00
Andrey Rakhmatullin 06ebdee35d
Merge pull request #5950 from wRAR/addons 
Add-ons
 2023-08-01 22:18:57 +04:00
Andrey Rakhmatullin e58b8078f0 Improve NotConfigured handling when clspath is a class. 2023-08-01 20:20:15 +04:00
Andrey Rakhmatullin f803ad63f3 Fix a typing issue. 2023-08-01 17:23:09 +04:00
Andrey Rakhmatullin 7fdeb5c5c1 Improve NotConfigured handling in add-ons. 2023-08-01 16:58:18 +04:00
Andrey Rakhmatullin cf55eb05f5 Fix a typo. 2023-08-01 13:30:56 +04:00
Andrey Rakhmatullin 41a4a163e3 Handle NotConfigured in add-ons. 2023-07-31 21:09:18 +04:00
Andrey Rakhmatullin b67a81b81d Use the MyHandler class directly. 2023-07-31 20:25:56 +04:00
Andrey Rakhmatullin d8c5b41559 Add more addon tests. 2023-07-31 19:09:21 +04:00
Andrey Rakhmatullin bddbbc522a
Merge pull request #5979 from BurnzZ/closespider-timeout-no-item 2023-07-28 12:56:44 +04:00