diff --git a/docs/topics/downloader-middleware.rst b/docs/topics/downloader-middleware.rst index be96425cf..192bfd19a 100644 --- a/docs/topics/downloader-middleware.rst +++ b/docs/topics/downloader-middleware.rst @@ -1021,7 +1021,7 @@ RobotFileParser ~~~~~~~~~~~~~~~ `RobotFileParser `_ is -Python's inbuilt robots.txt_ parser. The parser is fully compliant with `Martijn Koster's +Python's built-in robots.txt_ parser. The parser is fully compliant with `Martijn Koster's 1996 draft specification `_. It lacks support for wildcard matching.