RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
scrapy/docs/topics/scheduler.rst

903 B
Raw Permalink Blame History

<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en"> <head> </head>

Scheduler

System Message: ERROR/3 (<stdin>, line 7)

Unknown directive type "module".

.. module:: scrapy.core.scheduler

The scheduler component receives requests from the :ref:`engine <component-engine>` and stores them into persistent and/or non-persistent data structures. It also gets those requests and feeds them back to the engine when it asks for a next request to be downloaded.

System Message: ERROR/3 (<stdin>, line 9); backlink

Unknown interpreted text role "ref".

Overriding the default scheduler

You can use your own custom scheduler class by supplying its full Python path in the :setting:`SCHEDULER` setting.

System Message: ERROR/3 (<stdin>, line 18); backlink

Unknown interpreted text role "setting".

Minimal scheduler interface

System Message: ERROR/3 (<stdin>, line 25)

Unknown directive type "autoclass".

.. autoclass:: BaseScheduler
   :members:

Default scheduler

System Message: ERROR/3 (<stdin>, line 32)

Unknown directive type "autoclass".

.. autoclass:: Scheduler()
   :members:
   :special-members: __init__, __len__

Priority queues

System Message: ERROR/3 (<stdin>, line 40)

Unknown directive type "autoclass".

.. autoclass:: scrapy.pqueues.DownloaderAwarePriorityQueue

System Message: ERROR/3 (<stdin>, line 41)

Unknown directive type "autoclass".

.. autoclass:: scrapy.pqueues.ScrapyPriorityQueue
</html>