From e892a484e823470cf37e66904ffbfdb240438842 Mon Sep 17 00:00:00 2001 From: "Deschner, Magdalena" Date: Tue, 16 Jul 2019 13:53:56 +0200 Subject: [PATCH] add instructions about how to define output file when running scrapy from script instead of cmd --- docs/topics/practices.rst | 7 ++++++- 1 file changed, 6 insertions(+), 1 deletion(-) diff --git a/docs/topics/practices.rst b/docs/topics/practices.rst index 298a078a7..4566eeb6e 100644 --- a/docs/topics/practices.rst +++ b/docs/topics/practices.rst @@ -35,12 +35,17 @@ Here's an example showing how to run a single spider with it. ... process = CrawlerProcess({ - 'USER_AGENT': 'Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1)' + 'USER_AGENT': 'Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1)', + 'FEED_FORMAT':'json', + 'FEED_URI':'items.json' }) process.crawl(MySpider) process.start() # the script will block here until the crawling is finished +Define settings within dictionary in +CrawlerProcess. FEED_FORMAT and FEED_URI are the equivalent to "-o items.json" when using the scrapy crawl shell command. + Make sure to check :class:`~scrapy.crawler.CrawlerProcess` documentation to get acquainted with its usage details.