RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
10,710 Commits 49 Branches 132 Tags 141 MiB
Commit Graph

10710 Commits

Author SHA1 Message Date
Georgiy Zatserklianyi d67be20b2d
Update docs/topics/extensions.rst 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2023-08-11 18:48:58 +03:00
Georgiy Zatserklianyi 3a4a949f9d
Update docs/topics/extensions.rst 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2023-08-11 18:48:48 +03:00
Georgiy Zatserklianyi e6bd9829bd
Update docs/topics/extensions.rst 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2023-08-11 18:48:31 +03:00
Georgiy Zatserklianyi 2f094a7a5c
Update docs/topics/extensions.rst 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2023-08-11 18:48:14 +03:00
Andrey Rakhmatullin 7c497688f8
Merge pull request #6005 from wRAR/typing-crawler 
More typing for scrapy/*.py
 2023-08-11 14:41:47 +04:00
Adrián Chaves 8a0108b19c
Merge branch 'master' into typing-crawler 2023-08-11 10:42:45 +02:00
Andrey Rakhmatullin 34d050cfe5
Remove deprecated CrawlerRunner.spiders. (#6010) 2023-08-11 10:41:05 +02:00
Andrey Rakhmatullin 44b15c3004 Remove typing for CrawlerRunner.spider_loader. 2023-08-10 23:17:06 +04:00
Andrey Rakhmatullin 9df67a554e Add RequestFingerprinterProtocol. 2023-08-10 22:53:22 +04:00
Georgiy Zatserklianyi 736a4b615c
Update scrapy/settings/default_settings.py 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2023-08-10 21:34:35 +03:00
Georgiy Zatserklianyi f05657e542 periodic_log: interval check moved 2023-08-10 21:31:10 +03:00
Laerte Pereira 9e74748fca
Remove extra spider parameter in item pipeline docs (#6009) 2023-08-10 13:48:43 +02:00
Laerte Pereira 4a090d951a
Remove deprecated PythonItemExporter.binary (#6007) 2023-08-10 07:36:42 +02:00
Andrey Rakhmatullin b50268c100 Full typing for scrapy/link.py. 2023-08-09 23:56:16 +04:00
Andrey Rakhmatullin e6d919497d More typing for scrapy/core/scheduler.py. 2023-08-09 23:56:16 +04:00
Andrey Rakhmatullin 7dca18e2e7 Full typing for scrapy/responsetypes.py. 2023-08-09 23:56:16 +04:00
Andrey Rakhmatullin c5885fc13b Full typing for scrapy/exceptions.py. 2023-08-09 23:56:16 +04:00
Andrey Rakhmatullin 9960c62b87 Full typing for scrapy/logformatter.py. 2023-08-09 23:56:16 +04:00
Andrey Rakhmatullin 89503ae3f1 Full typing for scrapy/dupefilters.py. 2023-08-09 23:56:16 +04:00
Andrey Rakhmatullin dc6e142096 Full typing for scrapy/spiderloader.py. 2023-08-09 23:56:16 +04:00
Andrey Rakhmatullin 084a9ba076 Full typing for scrapy/crawler.py and scrapy/spiders/__init__.py. 2023-08-09 23:56:16 +04:00
Andrey Rakhmatullin 85696d7bab
Merge pull request #6003 from wRAR/typing-utils-2 
Typing for scrapy/utils, second pass
 2023-08-09 23:56:03 +04:00
Andrey Rakhmatullin 8050257c14 Small cleanup. 2023-08-09 23:17:32 +04:00
Andrey Rakhmatullin 53539483c3 Refactor _StreamReader.read(). 2023-08-07 15:13:20 +04:00
Andrey Rakhmatullin 2c7484d433 Merge remote-tracking branch 'origin/master' into typing-utils-2 2023-08-07 14:55:38 +04:00
Andrey Rakhmatullin 110d5fffb4
Update tool versions. (#6002) 2023-08-07 10:57:48 +02:00
Andrey Rakhmatullin 23af21491d Move definitions around to woark around a pypy3.8 bug. 2023-08-07 00:21:06 +04:00
Andrey Rakhmatullin 644a71bfd4 Use ftp:// URLs in FTP tests. 2023-08-07 00:17:52 +04:00
Andrey Rakhmatullin 471281d29e Fixes for scrapy/utils/iterators.py typing. 2023-08-06 23:05:02 +04:00
Andrey Rakhmatullin f5f593e5f5 Remove a workaround for a w3lib typing bug. 2023-08-06 17:46:28 +04:00
Andrey Rakhmatullin e2adec629b Fix regressions in typing. 2023-08-06 17:44:24 +04:00
Andrey Rakhmatullin 518e56046e Check for async callbacks in contracts. 2023-08-06 17:28:34 +04:00
Andrey Rakhmatullin 66bad1150c Add more typing for scrapy/utils/signal.py. 2023-08-06 00:35:33 +04:00
Andrey Rakhmatullin 9fe662d856 Add typing for scrapy/utils/testproc.py. 2023-08-06 00:35:33 +04:00
Andrey Rakhmatullin d1f87e4f08 More typing for scrapy/utils/iterators.py. 2023-08-06 00:35:33 +04:00
Andrey Rakhmatullin c43798cb9b More typing for scrapy/utils/defer.py and scrapy/utils/spider.py. 2023-08-06 00:35:33 +04:00
Andrey Rakhmatullin d015329d75 Add more typing for scrapy/utils/log.py. 2023-08-06 00:35:33 +04:00
Andrey Rakhmatullin d31829b72f More typing for scrapy/utils. 2023-08-06 00:35:33 +04:00
Andrey Rakhmatullin 88327c7c58 Bump version: 2.9.0 → 2.10.0 2023-08-04 17:23:30 +04:00
Andrey Rakhmatullin 4d288c8bf3
Merge pull request #6001 from scrapy/relnotes-2.10 
Add release notes for 2.10.0.
 2023-08-04 17:22:16 +04:00
Andrey Rakhmatullin 022ef0f86b
Apply suggestions from code review 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2023-08-04 17:05:09 +04:00
Andrey Rakhmatullin 7fe4c0c9f7
Update docs/news.rst 
Co-authored-by: Adrián Chaves <adrian@chaves.io>
 2023-08-04 16:56:39 +04:00
Andrey Rakhmatullin c14a0a9d5d Add release notes for 2.10.0. 2023-08-04 16:36:27 +04:00
Andrey Rakhmatullin 12638386dc
Merge pull request #6000 from Gallaecio/asyncio-module-level-twisted-imports-issue 
asyncio docs: cover accidental bad reactor installation
 2023-08-04 15:26:50 +04:00
Georgiy Zatserklianyi e9b088f1fb periodic_log: typing 2023-08-04 12:49:22 +03:00
Georgiy Zatserklianyi 8b6a50a935 periodic_log: docs added 2023-08-04 11:12:07 +03:00
Adrián Chaves 72de48be6d asyncio: cover accidental bad reactor installation, sort sections, reword the Windows section 2023-08-04 09:56:30 +02:00
Laerte Pereira 09c63a178b
Remove the deprecated spider parameter from the engine (#5998) 2023-08-04 07:53:04 +02:00
Andrey Rakhmatullin e58c8ca638
Merge pull request #5999 from Laerte/chore/enable-python3.11-on-ci 
Enable Python 3.11 on Windows CI
 2023-08-04 02:18:05 +04:00
Laerte Pereira 8a0a9e6d3e
Enable Python 3.11 on Windows CI 2023-08-03 18:31:12 -03:00