From ea7bd39529347af3b8e30c0588428ac442151673 Mon Sep 17 00:00:00 2001 From: Jose Ricardo Date: Tue, 18 Oct 2016 11:48:58 -0200 Subject: [PATCH] Make architecture overview references a little more clear on the docs Expliciting what actually happens by adding links to the respective methods that are invoked in each processing phase. --- docs/topics/architecture.rst | 15 ++++++++------- 1 file changed, 8 insertions(+), 7 deletions(-) diff --git a/docs/topics/architecture.rst b/docs/topics/architecture.rst index 91c80acc0..ea0cb0ea7 100644 --- a/docs/topics/architecture.rst +++ b/docs/topics/architecture.rst @@ -41,25 +41,26 @@ this: 4. The :ref:`Engine ` sends the Requests to the :ref:`Downloader `, passing through the - :ref:`Downloader Middleware ` - (requests direction). + :ref:`Downloader Middlewares ` (see + :meth:`~scrapy.downloadermiddlewares.DownloaderMiddleware.process_request`). 5. Once the page finishes downloading the :ref:`Downloader ` generates a Response (with that page) and sends it to the Engine, passing through the - :ref:`Downloader Middleware ` - (response direction). + :ref:`Downloader Middlewares ` (see + :meth:`~scrapy.downloadermiddlewares.DownloaderMiddleware.process_response`). 6. The :ref:`Engine ` receives the Response from the :ref:`Downloader ` and sends it to the :ref:`Spider ` for processing, passing - through the :ref:`Spider Middleware ` - (input direction). + through the :ref:`Spider Middleware ` (see + :meth:`~scrapy.spidermiddlewares.SpiderMiddleware.process_spider_input`). 7. The :ref:`Spider ` processes the Response and returns scraped items and new Requests (to follow) to the :ref:`Engine `, passing through the - :ref:`Spider Middleware ` (output direction). + :ref:`Spider Middleware ` (see + :meth:`~scrapy.spidermiddlewares.SpiderMiddleware.process_spider_output`). 8. The :ref:`Engine ` sends processed items to :ref:`Item Pipelines `, then send processed Requests to