RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
10,880 Commits 49 Branches 132 Tags 145 MiB
Commit Graph

10880 Commits

Author SHA1 Message Date
Adrián Chaves 28df50ddcc Minor edits around Optimization 2025-03-31 17:13:40 +02:00
Adrián Chaves a858ddfef9 Use the default scheduler for the front-load test 2025-03-31 16:46:52 +02:00
Adrián Chaves fdf242475e Test raising CloseSpider when the spider has been already closed 2025-03-31 16:12:42 +02:00
Adrián Chaves 5c9a931e8b Re-implement idle support 2025-03-31 15:18:38 +02:00
Adrián Chaves a04e85e08b Re-implement front-load support 2025-03-31 11:49:28 +02:00
Adrián Chaves 27ae12dc59 Fix method reference in the docs 2025-03-31 10:05:34 +02:00
Adrián Chaves 43e789f776 Use self 2025-03-31 10:02:31 +02:00
Adrián Chaves 9417de1df9 Review uses of seed 2025-03-31 09:53:52 +02:00
Adrián Chaves e984326777 Improve test reliability 2025-03-31 09:52:34 +02:00
Adrián Chaves 9fc4c449a7 Merge branch 'minimal-async-seeds' into async-seeds 2025-03-31 09:30:24 +02:00
Adrián Chaves 6cf308fbdd Fix comment about typing.Self Python requirement 2025-03-31 09:29:59 +02:00
Adrián Chaves a9ce836f98 Fix test expectations and improve reliability 2025-03-28 16:20:15 +01:00
Adrián Chaves 85e3dc13f1 Merge branch 'minimal-async-seeds' into async-seeds 2025-03-28 15:54:23 +01:00
Adrián Chaves 8e3d211ad7 Fix test_close_during_start_iteration on default-reactor 2025-03-27 16:37:19 +01:00
Adrián Chaves 7d159b2140 Privatize engine.start_request_processing() 2025-03-27 15:56:34 +01:00
Adrián Chaves 2a148d07b0 Increase coverage 2025-03-27 15:51:08 +01:00
Adrián Chaves 40adc6a356 Increase coverage 2025-03-27 15:39:37 +01:00
Adrián Chaves e360a4cc98 Increase coverage 2025-03-27 15:24:57 +01:00
Adrián Chaves 8057f06b39 Increase coverage 2025-03-27 15:16:02 +01:00
Adrián Chaves c67edb78b9 Deprecate calls to Spider.start_requests 2025-03-27 15:04:34 +01:00
Adrián Chaves 5e18a132da Clean up from self-review 2025-03-27 14:03:39 +01:00
Adrián Chaves 6a378bb94a Remove enum-tools 2025-03-27 12:05:20 +01:00
Adrián Chaves 581c969ead Remove tests for undefined behavior 2025-03-27 00:11:30 +01:00
Adrián Chaves 49b839b270 Reliability improvements 2025-03-26 23:28:29 +01:00
Adrián Chaves 7668a693e8 Do not install the requested event loop if it happens to match the existing one 2025-03-26 23:07:39 +01:00
Adrián Chaves 476234b07a Fix tests 2025-03-26 22:28:02 +01:00
Adrián Chaves 4a23215ce3 Address typing issues 2025-03-26 21:13:18 +01:00
Adrián Chaves d2bb2579f7 Clean up 2025-03-26 20:49:44 +01:00
Adrián Chaves c5518bc9fe Merge remote-tracking branch 'scrapy/master' into minimal-async-seeds 2025-03-26 19:45:03 +01:00
Adrián Chaves bfb720764b Restore old issue title reference 2025-03-26 19:44:29 +01:00
Adrián Chaves 313f9de28d Implement lazy support 2025-03-26 19:40:53 +01:00
Adrián Chaves 9726538cec Fix expectations for old Twisted 2025-03-26 11:30:13 +01:00
Adrián Chaves fdba9843bb Implement a simple scheduler_empty signal 2025-03-26 11:26:11 +01:00
Adrián Chaves 7b89aeba0b Fix tests 2025-03-26 10:40:27 +01:00
Adrián Chaves 701f582f27 Implement a replacement for the removed test_graceful_crawl_error_handling 2025-03-25 17:51:50 +01:00
Adrián Chaves 97a0fed020 Document the execution order change of non-generator start_requests, for the sake of completion 2025-03-25 17:27:58 +01:00
Adrián Chaves 1a0b9d4f56 Cover start request sorting examples in the tests 2025-03-25 17:16:05 +01:00
Adrián Chaves 406d2fb100 Update test expectations for the default reactor 2025-03-25 17:06:55 +01:00
Adrián Chaves eddf582ba9 Error out on uncompatible spider middlewares 2025-03-25 16:44:27 +01:00
Adrián Chaves 72f4877d76 Address feedback 2025-03-25 15:39:24 +01:00
Adrián Chaves 19c910f731 Complete the new loop implementation (no lazy support yet) 2025-03-25 15:28:21 +01:00
Adrián Chaves 17d85b8ad7 WIP 2025-03-25 12:52:37 +01:00
Adrián Chaves 52f931088c partial coroutine support → coroutine support 2025-03-25 11:02:32 +01:00
Adrián Chaves 5d43d91a95 WIP 2025-03-25 10:59:50 +01:00
Adrián Chaves 68f63e1430 Fix bad ports from the main PR 2025-03-24 17:29:04 +01:00
Adrián Chaves 4ac921f389 WIP 2025-03-24 17:26:58 +01:00
Adrián Chaves b37f3b5422 Fix text replacement artifacts 2025-03-24 11:22:41 +01:00
Adrián Chaves cc49ea9f18 Inclued () in …start_requests mentions on news.rst 2025-03-24 10:58:19 +01:00
Andrey Rakhmatullin 9f99da8f86
Convert test_downloadermiddleware_robotstxt.py from callbacks to awaits. (#6743) 2025-03-24 09:26:25 +01:00
Suejung Shin e50914e0f5
Codecov: Add test analytics (#6741) 2025-03-21 12:28:47 +01:00