mirror of https://github.com/scrapy/scrapy.git
constructor (domain prioritizers will be refactored later anyway) and simplified Scrapy Manager code thanks to this. Added make_request_from_url method to BaseSpider, splitting funtionality to create requests from URLs which was previously done all in start_requests. |
||
|---|---|---|
| bin | ||
| docs | ||
| examples | ||
| extras/sql | ||
| profiling/priorityqueue | ||
| scrapy | ||
| scripts | ||
| .hgignore | ||
| AUTHORS | ||
| INSTALL | ||
| LICENSE | ||
| README | ||
| setup.cfg | ||
| setup.py | ||
README
This is Scrapy, an opensource screen scraping framework written in Python. For more visit the project home page at http://scrapy.org