Commit Graph

1803 Commits

Author SHA1 Message Date
Mikhail Korobov 4d4bd0e823
Merge pull request #3609 from Gallaecio/2253
Document FilesPipeline.file_path and ImagesPipeline.file_path
2019-07-04 22:05:46 +05:00
Mikhail Korobov 4c755f1ddc
Merge pull request #3692 from anubhavp28/doc-patch
[MRG+1] doc for creating custom cache storage backend.
2019-07-02 20:18:14 +05:00
Eugenio Lacuesta 428309ba1a Merge remote-tracking branch 'origin/master' into callback_kwargs 2019-06-26 11:03:31 -03:00
Mikhail Korobov c81d120bde
Merge pull request #3768 from Gallaecio/meta-ignore-tags
Implement the METAREFRESH_IGNORE_TAGS setting
2019-06-25 23:25:58 +03:00
Mikhail Korobov e5f12faf5f
Merge pull request #3703 from Gallaecio/ajax-docs
Add a topic about reaching data that selectors cannot reach
2019-06-25 23:11:59 +03:00
Adrián Chaves d7795484dc Document scrapy.crawler.Crawler.stop() 2019-06-25 17:29:49 +02:00
Adrián Chaves 8a3b15eb91 Document how to select dynamically-loaded content 2019-06-24 16:06:21 +02:00
Daniel Graña cdfb20aee8
Merge pull request #3739 from Matthijsy/feature/scrapy_check_env
[MRG+1] Add SCRAPY_CHECK environment variable
2019-06-13 19:43:01 -03:00
Daniel Graña 8a022ac6ea
Merge pull request #3810 from Gallaecio/documentation-coverage
Skip scrapy.contracts private APIs in the documentation coverage report
2019-06-13 17:16:07 -03:00
Adrián Chaves c7ba72b5dc Skip scrapy.contracts private APIs in the documentation coverage report 2019-06-07 13:14:33 +02:00
Artem Kuchumov c81e15ed6e
Tutorial: scrapy shell example should say "text" not "title" (#3807)
Tutorial: scrapy shell example should say "text" not "title"
2019-06-05 13:15:23 +05:00
Mikhail Korobov f755507d68
Merge pull request #3567 from Gallaecio/documentation-coverage
Add a Sphinx extension to generate documentation coverage information
2019-06-04 18:47:24 +05:00
Adrián Chaves c7b5ad0e20 Add a Sphinx extension to generate documentation coverage information 2019-06-04 15:03:25 +02:00
Adrián Chaves ea209a0ea7 Fix module double indexing issues in the documentation 2019-06-04 14:35:27 +02:00
Mikhail Korobov 890e7fbd5b
Merge pull request #3791 from barraponto/patch-3
[MRG+1] Fix documentation for spiderloader
2019-05-28 19:16:12 +01:00
Mikhail Korobov 8d50384210
Merge pull request #3797 from mar-heaven/master
[MRG+1] remove a "is"
2019-05-28 19:12:04 +01:00
mar-heaven 18f01ea6ec
remove a "is"
When I translated in Chinese, I found a needless "is"
2019-05-27 17:15:30 +08:00
Anubhav Patel da82ede8a0
describe method as a command 2019-05-25 17:19:10 +05:30
Capi Etheriel 7d36fa7435
Fix documentation for spiderloader 2019-05-24 10:32:55 -03:00
Mikhail Korobov a3d38041e2
Merge pull request #3764 from Jeffallan/patch-1
[MRG+1] Update telnetconsole.rst
2019-05-09 20:59:30 +05:00
Mikhail Korobov 137a3d8146
Merge pull request #3762 from Vandenn/update-logging-docs
[MRG+1] doc: update configure_logging docs to discourage use with CrawlerProcess
2019-05-09 20:59:20 +05:00
Adrián Chaves 611249bb7f Implement the METAREFRESH_IGNORE_TAGS setting 2019-05-08 12:52:29 +02:00
Aditya 3a7850fa15
Update contributing.rst 2019-05-05 18:45:40 +05:30
Jeffallan 5814344adf
Update telnetconsole.rst
Change spelling of bellow to below.
2019-05-04 14:15:47 -05:00
Adrián Chaves bc1a929213
Improve the documentation about detecting check runs 2019-05-03 14:42:12 +02:00
Matthijs Vos 8bd207a2f6 Add documentation 2019-05-03 13:50:24 +02:00
Vandenn 122ca62119 doc: update configure_logging docs to discourage use with CrawlerProcess 2019-05-03 16:39:26 +08:00
Mikhail Korobov 6e49c379a8
Merge pull request #3748 from Gallaecio/docstring-conventions
Cover PEP 257 in the documentation policies
2019-04-17 13:22:11 +05:00
Mikhail Korobov 5b667b6156
Merge pull request #3707 from Gallaecio/pytest-xdist
Use pytest-xdist
2019-04-17 13:20:37 +05:00
Adrián Chaves 5a6fb3daa6 Use pytest-xdist 2019-04-17 09:02:34 +02:00
Adrián Chaves fbb42fe14e Cover PEP 257 in the documentation policies 2019-04-17 08:25:22 +02:00
Adrián Chaves 92fa657f9e
Merge pull request #3730 from ankostis/doc_logstats_delay
[MRG+1] doc: document LOGSTATS_INTERVAL setting
2019-04-11 17:34:45 +02:00
Mikhail Korobov 9280185054
Merge pull request #3520 from whalebot-helmsman/round-robin-scheduler-tested
[MRG+1] Downloader-aware Priority Queue for Scrapy
2019-04-07 00:06:08 +05:00
Kostis Anagnostopoulos a8f83ab967 doc: document LOGSTATS_INTERVAL setting 2019-04-06 14:58:32 +02:00
float13 a101d5fe5c text edit - delete 2 extra words 2019-04-05 01:12:20 -04:00
float13 77e3695686 grammar fix - add apostrophe-s to browser 2019-04-05 01:04:59 -04:00
float13 d711ecfc18 grammar fix - delete extra word "shell" 2019-04-05 00:56:51 -04:00
float13 6336e1d1f3 grammar fix - delete unneeded apostrophe in "lets" 2019-04-05 00:54:46 -04:00
Konstantin Lopuhin b5c552d17f
Merge pull request #2061 from elacuesta/process_spider_exception_generator
[MRG+1] process_spider_exception on generators
2019-04-01 10:43:19 +03:00
Eugenio Lacuesta 294ef51bb2 parse command: update docs about passing callback keyword arguments 2019-03-29 16:12:55 -03:00
Eugenio Lacuesta ccb56a317e Update docs about cb_kwargs and meta 2019-03-29 14:13:50 -03:00
Vostretsov Nikita 1c6733454e added underlines 2019-03-29 10:44:55 +00:00
Vostretsov Nikita ef743983a9 change wording 2019-03-29 10:38:13 +00:00
Adrián Chaves 1ee99e1f42
Update docs/topics/settings.rst
Co-Authored-By: whalebot-helmsman <whalebot.helmsman@gmail.com>
2019-03-29 10:29:15 +00:00
Adrián Chaves bd228f1d96
Update docs/topics/broad-crawls.rst
Co-Authored-By: whalebot-helmsman <whalebot.helmsman@gmail.com>
2019-03-29 10:29:04 +00:00
Adrián Chaves e3df6be360
Update docs/topics/broad-crawls.rst
Co-Authored-By: whalebot-helmsman <whalebot.helmsman@gmail.com>
2019-03-29 10:28:52 +00:00
Adrián Chaves 46b9ab0c58
Update docs/topics/broad-crawls.rst
Co-Authored-By: whalebot-helmsman <whalebot.helmsman@gmail.com>
2019-03-29 10:28:36 +00:00
Eugenio Lacuesta 8fb077694f Request.cb_kwargs: Update docs 2019-03-28 16:32:35 -03:00
Eugenio Lacuesta e8af6331b5 Add cb_kwargs option to the parse command 2019-03-28 15:03:40 -03:00
Eugenio Lacuesta 3efe3bea1c Update docs about cb_kwargs and meta 2019-03-28 14:16:03 -03:00