From 5ddb37d28ce4ea1a910be87d6a902d14f0356ba2 Mon Sep 17 00:00:00 2001 From: Ishaan Kapur <64529428+ishaanlabs-gg@users.noreply.github.com> Date: Wed, 1 Jul 2026 08:47:47 +0530 Subject: [PATCH] Document additional pre-crawler settings --- docs/topics/settings.rst | 18 ++++++++++++++++++ 1 file changed, 18 insertions(+) diff --git a/docs/topics/settings.rst b/docs/topics/settings.rst index 11251a92c..8ca008d31 100644 --- a/docs/topics/settings.rst +++ b/docs/topics/settings.rst @@ -305,6 +305,9 @@ These settings cannot be :ref:`set from a spider `. These settings are: +- :setting:`ADDONS` +- :setting:`COMMANDS_MODULE` +- :setting:`FORCE_CRAWLER_PROCESS` - :setting:`TWISTED_REACTOR_ENABLED` - :setting:`SPIDER_LOADER_CLASS` and settings used by the corresponding spider loader class, e.g. :setting:`SPIDER_MODULES` and @@ -409,6 +412,8 @@ Default: ``{}`` A dict containing paths to the add-ons enabled in your project and their priorities. For more information, see :ref:`topics-addons`. +.. note:: This is a :ref:`pre-crawler setting `. + .. setting:: AWS_ACCESS_KEY_ID AWS_ACCESS_KEY_ID @@ -521,6 +526,17 @@ project name). This name will be used for the logging too. It's automatically populated with your project name when you create your project with the :command:`startproject` command. +.. setting:: COMMANDS_MODULE + +COMMANDS_MODULE +--------------- + +Default: ``""`` + +The module where Scrapy will look for custom commands. + +.. note:: This is a :ref:`pre-crawler setting `. + .. setting:: CONCURRENT_ITEMS CONCURRENT_ITEMS @@ -1377,6 +1393,8 @@ If ``True``, these commands will always use Set this to ``True`` if you want to set :setting:`TWISTED_REACTOR` to a non-default value in :ref:`per-spider settings `. +.. note:: This is a :ref:`pre-crawler setting `. + .. setting:: FTP_PASSIVE_MODE FTP_PASSIVE_MODE