scrapy

Commit Graph

Author	SHA1	Message	Date
nyov	a34c366fa4	DOC linkcheck run; https and 301 link updates. Closes #4359	2020-02-25 16:51:33 +00:00
elacuesta	35dafef7f1	Specify Twisted reactor (TWISTED_REACTOR setting) (#4294 ) * Add the ability to install a specific reactor * Add docs for the TWISTED_REACTOR setting * Add tests for the TWISTED_REACTOR setting * Update asyncio reactor test * Ignore W503 globally W503 is not PEP8-compliant: `c59c4376ad` * Line length adjustment * Adjust asyncio reactor tests * Merge ASYNCIO_ENABLED and TWISTED_REACTOR settings * More docs about TWISTED_REACTOR * Fix asyncio reactor test * Docs: fix title * Reword docs * Check the TWISTED_REACTOR setting outside of the installing function * Remove unrelated change * Update scrapy/utils/log.py Co-Authored-By: Adrián Chaves <adrian@chaves.io> * Update docs/topics/settings.rst Co-Authored-By: Adrián Chaves <adrian@chaves.io> * Update docs/topics/settings.rst Co-Authored-By: Adrián Chaves <adrian@chaves.io> Co-authored-by: Adrián Chaves <adrian@chaves.io>	2020-02-06 22:42:34 +05:00
Adrián Chaves	ed487b7db3	broad-crawls.rst: Refactor the memory usage section	2019-07-11 11:14:22 +02:00
Robin	5cdf277017	Update broad-crawls.rst Added section on how to treat memory consumption problems of broad crawls.	2019-07-11 08:49:24 +02:00
Vostretsov Nikita	1c6733454e	added underlines	2019-03-29 10:44:55 +00:00
Vostretsov Nikita	ef743983a9	change wording	2019-03-29 10:38:13 +00:00
Adrián Chaves	bd228f1d96	Update docs/topics/broad-crawls.rst Co-Authored-By: whalebot-helmsman <whalebot.helmsman@gmail.com>	2019-03-29 10:29:04 +00:00
Adrián Chaves	e3df6be360	Update docs/topics/broad-crawls.rst Co-Authored-By: whalebot-helmsman <whalebot.helmsman@gmail.com>	2019-03-29 10:28:52 +00:00
Adrián Chaves	46b9ab0c58	Update docs/topics/broad-crawls.rst Co-Authored-By: whalebot-helmsman <whalebot.helmsman@gmail.com>	2019-03-29 10:28:36 +00:00
Mikhail Korobov	845bae6637	Update docs/topics/broad-crawls.rst Co-Authored-By: whalebot-helmsman <whalebot.helmsman@gmail.com>	2019-03-27 08:49:19 +00:00
Vostretsov Nikita	338b78d796	Add documentation add section to broad-crawl topic reword in accord with broad-crawl topic add documentation for new priority queue	2019-03-22 15:40:37 +03:00
david watson	71d5b7d75a	fix typo (#2867 )	2017-08-01 14:49:22 -03:00
Claus Conrad	18b96dd82a	Spelling mistake	2017-07-15 11:31:09 +02:00
carlosp420	e15f361b05	fixed typo You -> you	2016-01-19 11:12:43 -05:00
David Chen	0025d5a943	Fixed minor grammar issues.	2015-11-16 07:30:17 +08:00
Alexander Sibiryakov	b794cdaf4b	Broad crawls notes.	2015-04-01 12:07:03 +02:00
Mikhail Korobov	b03fe04999	Rename AjaxCrawlableMiddleware to AjaxCrawlMiddleware	2014-01-16 23:09:37 +06:00
Mikhail Korobov	e0cebbfc8f	add a remark about 1%	2013-12-20 23:12:37 +06:00
Mikhail Korobov	943a0bd264	AjaxCrawlableMiddleware in Broad Crawl docs	2013-12-19 01:01:26 +06:00
Pablo Hoffman	51b8feb4ce	fixed doc typos	2012-12-26 16:16:53 -02:00
Pablo Hoffman	1e2ee76df2	add documentation topics: Broad Crawls & Common Practies	2012-12-26 14:02:13 -02:00

21 Commits