mirror of https://github.com/scrapy/scrapy.git
db5c3df679
* Rename BaseSpider.domain_name to BaseSpider.name
This patch implements the domain_name to name change in BaseSpider class and
change all spider instantiations to use the new attribute.
* Add allowed_domains to spider
This patch implements the merging of spider.domain_name and
spider.extra_domain_names in spider.allowed_domains for offsite checking
purposes.
Note that spider.domain_name is not touched by this patch, only not used.
* Remove spider.domain_name references from scrapy.stats
* Rename domain_stats to spider_stats in MemoryStatsCollector
* Use ``spider`` instead of ``domain`` in SimpledbStatsCollector
* Rename domain_stats_history table to spider_data_history and rename domain
field to spider in MysqlStatsCollector
* Refactor genspider command
The new signature for genspider is: genspider [options] <domain_name>.
Genspider uses domain_name for spider name and for the module name.
* Remove spider.domain_name references
* Update crawl command signature <spider|url>
* docs: updated references to domain_name
* examples/experimental: use spider.name
* genspider: require <name> <domain>
* spidermanager: renamed crawl_domain to crawl_spider_name
* spiderctl: updated references of *domain* to spider
* added backward compatiblity with legacy spider's attributes
'domain_name' and 'extra_domain_names'
|
||
|---|---|---|
| .. | ||
| _images | ||
| architecture.rst | ||
| downloader-middleware.rst | ||
| email.rst | ||
| exceptions.rst | ||
| exporters.rst | ||
| extensions.rst | ||
| firebug.rst | ||
| firefox.rst | ||
| images.rst | ||
| item-pipeline.rst | ||
| items.rst | ||
| leaks.rst | ||
| link-extractors.rst | ||
| loaders.rst | ||
| logging.rst | ||
| request-response.rst | ||
| scrapy-ctl.rst | ||
| selectors.rst | ||
| settings.rst | ||
| shell.rst | ||
| signals.rst | ||
| spider-middleware.rst | ||
| spiders.rst | ||
| stats.rst | ||
| telnetconsole.rst | ||
| webconsole.rst | ||