DOCS removed .tld suffix for spider names for the sake of consistency.

This commit is contained in:
Rolando Espinoza La fuente 2013-10-19 23:03:20 -04:00
parent c2ced9a234
commit 34543c2b2e
2 changed files with 3 additions and 3 deletions

View File

@ -137,7 +137,7 @@ Finally, here's the spider code::
class MininovaSpider(CrawlSpider):
name = 'mininova.org'
name = 'mininova'
allowed_domains = ['mininova.org']
start_urls = ['http://www.mininova.org/today']
rules = [Rule(SgmlLinkExtractor(allow=['/tor/\d+']), 'parse_torrent')]
@ -161,7 +161,7 @@ Run the spider to extract the data
Finally, we'll run the spider to crawl the site an output file
``scraped_data.json`` with the scraped data in JSON format::
scrapy crawl mininova.org -o scraped_data.json -t json
scrapy crawl mininova -o scraped_data.json -t json
This uses :ref:`feed exports <topics-feed-exports>` to generate the JSON file.
You can easily change the export format (XML or CSV, for example) or the

View File

@ -56,7 +56,7 @@ Settings attribute.
Example::
scrapy crawl domain.com -s LOG_FILE=scrapy.log
scrapy crawl myspider -s LOG_FILE=scrapy.log
2. Project settings module
--------------------------