RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
10,887 Commits 49 Branches 132 Tags 182 MiB
Commit Graph

10887 Commits

Author SHA1 Message Date
Adrián Chaves 156308f7b6 Merge branch 'minimal-async-seeds' into async-seeds 2025-04-07 12:38:51 +02:00
Adrián Chaves ac5a5b7811 Address feedback 2025-04-07 12:37:31 +02:00
Adrián Chaves 76ccc50622 Add an example of higher-priority leaf requests 2025-04-01 13:16:14 +02:00
Adrián Chaves 9dc9999eaa Add docs about universal start request definition 2025-04-01 12:13:59 +02:00
Adrián Chaves 6c1852d313 Update the FAQ 2025-04-01 11:07:20 +02:00
Adrián Chaves 891adcd8e2 Mark a line intentionally without coverage 2025-04-01 10:32:37 +02:00
Adrián Chaves 4e63b76851 Remove debugging leftover 2025-03-31 17:19:13 +02:00
Adrián Chaves 28df50ddcc Minor edits around Optimization 2025-03-31 17:13:40 +02:00
Adrián Chaves a858ddfef9 Use the default scheduler for the front-load test 2025-03-31 16:46:52 +02:00
Adrián Chaves fdf242475e Test raising CloseSpider when the spider has been already closed 2025-03-31 16:12:42 +02:00
Adrián Chaves 5c9a931e8b Re-implement idle support 2025-03-31 15:18:38 +02:00
Adrián Chaves a04e85e08b Re-implement front-load support 2025-03-31 11:49:28 +02:00
Adrián Chaves 27ae12dc59 Fix method reference in the docs 2025-03-31 10:05:34 +02:00
Adrián Chaves 43e789f776 Use self 2025-03-31 10:02:31 +02:00
Adrián Chaves 9417de1df9 Review uses of seed 2025-03-31 09:53:52 +02:00
Adrián Chaves e984326777 Improve test reliability 2025-03-31 09:52:34 +02:00
Adrián Chaves 9fc4c449a7 Merge branch 'minimal-async-seeds' into async-seeds 2025-03-31 09:30:24 +02:00
Adrián Chaves 6cf308fbdd Fix comment about typing.Self Python requirement 2025-03-31 09:29:59 +02:00
Adrián Chaves a9ce836f98 Fix test expectations and improve reliability 2025-03-28 16:20:15 +01:00
Adrián Chaves 85e3dc13f1 Merge branch 'minimal-async-seeds' into async-seeds 2025-03-28 15:54:23 +01:00
Adrián Chaves 8e3d211ad7 Fix test_close_during_start_iteration on default-reactor 2025-03-27 16:37:19 +01:00
Adrián Chaves 7d159b2140 Privatize engine.start_request_processing() 2025-03-27 15:56:34 +01:00
Adrián Chaves 2a148d07b0 Increase coverage 2025-03-27 15:51:08 +01:00
Adrián Chaves 40adc6a356 Increase coverage 2025-03-27 15:39:37 +01:00
Adrián Chaves e360a4cc98 Increase coverage 2025-03-27 15:24:57 +01:00
Adrián Chaves 8057f06b39 Increase coverage 2025-03-27 15:16:02 +01:00
Adrián Chaves c67edb78b9 Deprecate calls to Spider.start_requests 2025-03-27 15:04:34 +01:00
Adrián Chaves 5e18a132da Clean up from self-review 2025-03-27 14:03:39 +01:00
Adrián Chaves 6a378bb94a Remove enum-tools 2025-03-27 12:05:20 +01:00
Adrián Chaves 581c969ead Remove tests for undefined behavior 2025-03-27 00:11:30 +01:00
Adrián Chaves 49b839b270 Reliability improvements 2025-03-26 23:28:29 +01:00
Adrián Chaves 7668a693e8 Do not install the requested event loop if it happens to match the existing one 2025-03-26 23:07:39 +01:00
Adrián Chaves 476234b07a Fix tests 2025-03-26 22:28:02 +01:00
Adrián Chaves 4a23215ce3 Address typing issues 2025-03-26 21:13:18 +01:00
Adrián Chaves d2bb2579f7 Clean up 2025-03-26 20:49:44 +01:00
Adrián Chaves c5518bc9fe Merge remote-tracking branch 'scrapy/master' into minimal-async-seeds 2025-03-26 19:45:03 +01:00
Adrián Chaves bfb720764b Restore old issue title reference 2025-03-26 19:44:29 +01:00
Adrián Chaves 313f9de28d Implement lazy support 2025-03-26 19:40:53 +01:00
Adrián Chaves 9726538cec Fix expectations for old Twisted 2025-03-26 11:30:13 +01:00
Adrián Chaves fdba9843bb Implement a simple scheduler_empty signal 2025-03-26 11:26:11 +01:00
Adrián Chaves 7b89aeba0b Fix tests 2025-03-26 10:40:27 +01:00
Adrián Chaves 701f582f27 Implement a replacement for the removed test_graceful_crawl_error_handling 2025-03-25 17:51:50 +01:00
Adrián Chaves 97a0fed020 Document the execution order change of non-generator start_requests, for the sake of completion 2025-03-25 17:27:58 +01:00
Adrián Chaves 1a0b9d4f56 Cover start request sorting examples in the tests 2025-03-25 17:16:05 +01:00
Adrián Chaves 406d2fb100 Update test expectations for the default reactor 2025-03-25 17:06:55 +01:00
Adrián Chaves eddf582ba9 Error out on uncompatible spider middlewares 2025-03-25 16:44:27 +01:00
Adrián Chaves 72f4877d76 Address feedback 2025-03-25 15:39:24 +01:00
Adrián Chaves 19c910f731 Complete the new loop implementation (no lazy support yet) 2025-03-25 15:28:21 +01:00
Adrián Chaves 17d85b8ad7 WIP 2025-03-25 12:52:37 +01:00
Adrián Chaves 52f931088c partial coroutine support → coroutine support 2025-03-25 11:02:32 +01:00