RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Update docs/topics/broad-crawls.rst 

Co-Authored-By: whalebot-helmsman <whalebot.helmsman@gmail.com>
This commit is contained in:
Mikhail Korobov 2019-03-27 08:49:19 +00:00 committed by GitHub
parent 73e4ff5304
commit 845bae6637
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
docs/topics/broad-crawls.rst
View File

@ -42,7 +42,7 @@ efficient broad crawl.
Use proper :setting:`SCHEDULER_PRIORITY_QUEUE`
==============================================
Default scrapy's scheduler priority queue is ``'queuelib.PriorityQueue'``.
Default scrapy's scheduler priority queue is ``'scrapy.pqueues.ScrapyPriorityQueue'``.
It works best during single domain crawl. And it does not work well with crawling
many different domains in parallel