RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
scrapy/docs/experimental/crawlspider-v2.rst

1.8 KiB
Raw Blame History

<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en"> <head> </head>

CrawlSpider v2

Introduction

TODO: introduction

Rules Matching

TODO: describe purpose of rules

Request Extractors & Processors

TODO: describe purpose of extractors & processors

Examples

TODO: plenty of examples

System Message: ERROR/3 (<stdin>, line 28)

Unknown directive type "module".

.. module:: scrapy.contrib_exp.crawlspider.spider
    :synopsis: CrawlSpider

Reference

CrawlSpider

TODO: describe crawlspider

TODO: describe class

System Message: ERROR/3 (<stdin>, line 45)

Unknown directive type "module".

.. module:: scrapy.contrib_exp.crawlspider.rules
    :synopsis: Rules

Rules

TODO: describe spider rules

TODO: describe Rules class

System Message: ERROR/3 (<stdin>, line 58)

Unknown directive type "module".

.. module:: scrapy.contrib_exp.crawlspider.reqext
    :synopsis: Request Extractors

Request Extractors

TODO: describe extractors purpose

TODO: describe base extractor

TODO: describe sgml extractor

TODO: describe xpath request extractor

System Message: ERROR/3 (<stdin>, line 79)

Unknown directive type "module".

.. module:: scrapy.contrib_exp.crawlspider.reqproc
    :synopsis: Request Processors

Request Processors

TODO: describe request processors

TODO: describe proc

TODO: describe unique

TODO: describe filter domain

TODO: describe filter url

System Message: ERROR/3 (<stdin>, line 104)

Unknown directive type "module".

.. module:: scrapy.contrib_exp.crawlspider.matchers
    :synopsis: Matchers

Request/Response Matchers

TODO: describe matchers

TODO: describe base matcher

TODO: describe url matcher

TODO: describe UrlListMatcher

TODO: describe url list matcher

</html>