RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
10,030 Commits 49 Branches 132 Tags 182 MiB
Commit Graph

10030 Commits

Author SHA1 Message Date
Jalil SA 19867659f3 fix: response.json() call makes unnecessary memory allocation 2023-08-17 10:22:17 -06:00
Andrey Rakhmatullin 3318971512
Merge pull request #6013 from Laerte/master 
Handle Tuple type on getdictorlist method, bump 3.12 python version
 2023-08-14 19:55:38 +04:00
Laerte Pereira b06936f111 Handle Tuple type on getdictorlist method, bump 3.12 python version 2023-08-14 10:33:48 -03:00
Andrey Rakhmatullin 7c497688f8
Merge pull request #6005 from wRAR/typing-crawler 
More typing for scrapy/*.py
 2023-08-11 14:41:47 +04:00
Adrián Chaves 8a0108b19c
Merge branch 'master' into typing-crawler 2023-08-11 10:42:45 +02:00
Andrey Rakhmatullin 34d050cfe5
Remove deprecated CrawlerRunner.spiders. (#6010) 2023-08-11 10:41:05 +02:00
Andrey Rakhmatullin 44b15c3004 Remove typing for CrawlerRunner.spider_loader. 2023-08-10 23:17:06 +04:00
Andrey Rakhmatullin 9df67a554e Add RequestFingerprinterProtocol. 2023-08-10 22:53:22 +04:00
Laerte Pereira 9e74748fca
Remove extra spider parameter in item pipeline docs (#6009) 2023-08-10 13:48:43 +02:00
Laerte Pereira 4a090d951a
Remove deprecated PythonItemExporter.binary (#6007) 2023-08-10 07:36:42 +02:00
Andrey Rakhmatullin b50268c100 Full typing for scrapy/link.py. 2023-08-09 23:56:16 +04:00
Andrey Rakhmatullin e6d919497d More typing for scrapy/core/scheduler.py. 2023-08-09 23:56:16 +04:00
Andrey Rakhmatullin 7dca18e2e7 Full typing for scrapy/responsetypes.py. 2023-08-09 23:56:16 +04:00
Andrey Rakhmatullin c5885fc13b Full typing for scrapy/exceptions.py. 2023-08-09 23:56:16 +04:00
Andrey Rakhmatullin 9960c62b87 Full typing for scrapy/logformatter.py. 2023-08-09 23:56:16 +04:00
Andrey Rakhmatullin 89503ae3f1 Full typing for scrapy/dupefilters.py. 2023-08-09 23:56:16 +04:00
Andrey Rakhmatullin dc6e142096 Full typing for scrapy/spiderloader.py. 2023-08-09 23:56:16 +04:00
Andrey Rakhmatullin 084a9ba076 Full typing for scrapy/crawler.py and scrapy/spiders/__init__.py. 2023-08-09 23:56:16 +04:00
Andrey Rakhmatullin 85696d7bab
Merge pull request #6003 from wRAR/typing-utils-2 
Typing for scrapy/utils, second pass
 2023-08-09 23:56:03 +04:00
Andrey Rakhmatullin 8050257c14 Small cleanup. 2023-08-09 23:17:32 +04:00
Andrey Rakhmatullin 53539483c3 Refactor _StreamReader.read(). 2023-08-07 15:13:20 +04:00
Andrey Rakhmatullin 2c7484d433 Merge remote-tracking branch 'origin/master' into typing-utils-2 2023-08-07 14:55:38 +04:00
Andrey Rakhmatullin 110d5fffb4
Update tool versions. (#6002) 2023-08-07 10:57:48 +02:00
Andrey Rakhmatullin 23af21491d Move definitions around to woark around a pypy3.8 bug. 2023-08-07 00:21:06 +04:00
Andrey Rakhmatullin 644a71bfd4 Use ftp:// URLs in FTP tests. 2023-08-07 00:17:52 +04:00
Andrey Rakhmatullin 471281d29e Fixes for scrapy/utils/iterators.py typing. 2023-08-06 23:05:02 +04:00
Andrey Rakhmatullin f5f593e5f5 Remove a workaround for a w3lib typing bug. 2023-08-06 17:46:28 +04:00
Andrey Rakhmatullin e2adec629b Fix regressions in typing. 2023-08-06 17:44:24 +04:00
Andrey Rakhmatullin 518e56046e Check for async callbacks in contracts. 2023-08-06 17:28:34 +04:00
Andrey Rakhmatullin 66bad1150c Add more typing for scrapy/utils/signal.py. 2023-08-06 00:35:33 +04:00
Andrey Rakhmatullin 9fe662d856 Add typing for scrapy/utils/testproc.py. 2023-08-06 00:35:33 +04:00
Andrey Rakhmatullin d1f87e4f08 More typing for scrapy/utils/iterators.py. 2023-08-06 00:35:33 +04:00
Andrey Rakhmatullin c43798cb9b More typing for scrapy/utils/defer.py and scrapy/utils/spider.py. 2023-08-06 00:35:33 +04:00
Andrey Rakhmatullin d015329d75 Add more typing for scrapy/utils/log.py. 2023-08-06 00:35:33 +04:00
Andrey Rakhmatullin d31829b72f More typing for scrapy/utils. 2023-08-06 00:35:33 +04:00
Andrey Rakhmatullin 88327c7c58 Bump version: 2.9.0 → 2.10.0 2023-08-04 17:23:30 +04:00
Andrey Rakhmatullin 4d288c8bf3
Merge pull request #6001 from scrapy/relnotes-2.10 
Add release notes for 2.10.0.
 2023-08-04 17:22:16 +04:00
Andrey Rakhmatullin 022ef0f86b
Apply suggestions from code review 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2023-08-04 17:05:09 +04:00
Andrey Rakhmatullin 7fe4c0c9f7
Update docs/news.rst 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2023-08-04 16:56:39 +04:00
Andrey Rakhmatullin c14a0a9d5d Add release notes for 2.10.0. 2023-08-04 16:36:27 +04:00
Andrey Rakhmatullin 12638386dc
Merge pull request #6000 from Gallaecio/asyncio-module-level-twisted-imports-issue 
asyncio docs: cover accidental bad reactor installation
 2023-08-04 15:26:50 +04:00
Adrián Chaves 72de48be6d asyncio: cover accidental bad reactor installation, sort sections, reword the Windows section 2023-08-04 09:56:30 +02:00
Laerte Pereira 09c63a178b
Remove the deprecated spider parameter from the engine (#5998) 2023-08-04 07:53:04 +02:00
Andrey Rakhmatullin e58c8ca638
Merge pull request #5999 from Laerte/chore/enable-python3.11-on-ci 
Enable Python 3.11 on Windows CI
 2023-08-04 02:18:05 +04:00
Laerte Pereira 8a0a9e6d3e
Enable Python 3.11 on Windows CI 2023-08-03 18:31:12 -03:00
Laerte Pereira b9c32a0cfd
Remove functions deprecated in 2.6.0 (#5996) 2023-08-03 17:06:55 +02:00
Andrey Rakhmatullin 7c6aaedda2
Merge pull request #5846 from jxlil/docs/spiders 
Added documentation for Spider.update_settings
 2023-08-02 21:09:44 +04:00
Andrey Rakhmatullin af1be835e4
Apply suggestions from code review 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2023-08-02 19:46:16 +04:00
Andrey Rakhmatullin 9f9a2292e0
Deprecate the custom attribute of build_component_list(). (#5993) 2023-08-02 14:21:06 +02:00
Andrey Rakhmatullin 72462a53e2 Add more docs for update_settings(). 2023-08-02 12:32:53 +04:00