Document that process_value runs before allow and deny (#7940)

This commit is contained in:
Adrian 2026-08-09 11:13:29 +02:00 committed by GitHub
parent fc9c505e79
commit b4279e243b
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 6 additions and 0 deletions

View File

@ -282,6 +282,12 @@ class LxmlLinkExtractor:
if m:
return m.group(1)
``process_value`` is called before the filtering parameters, such as
``allow`` and ``deny``, which match the value that it returns. To drop
links based on their final URL, use the ``process_links`` parameter of
:class:`~scrapy.spiders.Rule`, which only receives links that those
parameters kept.
:type process_value: collections.abc.Callable
:param strip: whether to strip whitespaces from extracted attributes.