mirror of https://github.com/scrapy/scrapy.git
Execution Manager: * added control_reactor argument to delegate external twisted reactor control (for example by twistd) * now it loads spiders (if not already loaded) * now it stars the log (if not already started) * removed *args from configure() method * removed **opts from runonce and start methods Execution engine: * added control_reactor argument to to delegate external twisted reactor control (for example by twistd) * changed some functions and method names for clarity * improve handling of exceptions in st() method * regrouped close_domain, closed_domain, and _close_domain method for legibilty Scheduler: * replaced pending_domains_count (dict) by pending_domains (set) * simplified some doc |
||
|---|---|---|
| bin | ||
| docs | ||
| examples | ||
| extras/sql | ||
| profiling/priorityqueue | ||
| scrapy | ||
| scripts | ||
| .hgignore | ||
| AUTHORS | ||
| INSTALL | ||
| LICENSE | ||
| README | ||
| setup.cfg | ||
| setup.py | ||
README
This is Scrapy, an opensource screen scraping framework written in Python. For more visit the project home page at http://scrapy.org