RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

add instructions about how to define output file when running scrapy from script instead of cmd

This commit is contained in:
Deschner, Magdalena 2019-07-16 13:53:56 +02:00
parent fa6a0d799b
commit e892a484e8
1 changed files with 6 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

7
docs/topics/practices.rst
View File

@ -35,12 +35,17 @@ Here's an example showing how to run a single spider with it.
...
process = CrawlerProcess({
'USER_AGENT': 'Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1)'
'USER_AGENT': 'Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1)',
'FEED_FORMAT':'json',
'FEED_URI':'items.json'
})
process.crawl(MySpider)
process.start() # the script will block here until the crawling is finished
Define settings within dictionary in
CrawlerProcess. FEED_FORMAT and FEED_URI are the equivalent to "-o items.json" when using the scrapy crawl shell command.
Make sure to check :class:`~scrapy.crawler.CrawlerProcess` documentation to get
acquainted with its usage details.