f72d4e93e6
[Docs] 2 typos + 1 clarification in docs
...
Fixing 2 small typos and adding 1 word as clarification in the downloader-middlewares.
Also, I was confused with the entries like `ref:Reppy <reppy-parser>` and similar entries.
Are these supposed to be links to other parts of the doc, or is this the intended way of showing these references ?
2020-01-26 10:48:28 +01:00
8b8df31961
Merge pull request #4227 from elacuesta/name-resolver
...
Name resolver with IPv6 support
2020-01-25 05:03:13 +05:00
fc98aa6b67
Merge branch 'master' into ftp_files#3928
2020-01-24 14:52:40 +02:00
bd54f22fef
Merge pull request #4282 from petervandenabeele/patch-1
...
fix logical documentation error with PER_DOMAIN or PER_DOMAIN
2020-01-24 02:01:22 +05:00
6a98d660e5
Merge pull request #3551 from jpbalarini/change_scraper_slot
...
[MRG+1] Add ability to change max_active_size by setting
2020-01-23 23:40:05 +05:00
7d5cebcf77
fix logical documentation error with PER_DOMAIN or PER_DOMAIN
2020-01-23 09:08:21 +01:00
c75cf15b7a
Update CSS selectors in tutorial
2020-01-22 10:38:59 -03:00
0f2d871d88
Use PEP 515 style for SCRAPER_SLOT_MAX_ACTIVE_SIZE documentation
2020-01-20 11:28:28 -03:00
eaa8ed02d0
Add ability to change max_active_size by settings
2020-01-20 11:27:58 -03:00
b471765d40
[doc] FAQ entry about the IPv6 and the DNS_RESOLVER setting
2020-01-18 01:52:29 -03:00
302d3f552b
[doc] DNS_RESOLVER setting
2020-01-18 01:46:24 -03:00
2e405d2d5c
Merge branch 'master' into response_follow_all
2020-01-05 00:33:19 -03:00
14d4428e70
Rephrasing documentation for image and file pipelines ( #4252 )
...
* scrapy#4034 Clarify documentation for image and file pipelines
* scrapy#4034 Clarify documentation for file pipeline
* scrapy#4034 Simplify documentation for pipeline
* scrapy#4034 Simplify documentation for pipeline
* scrapy#4034 Clarify documentation for image and file pipelines
* scrapy#4034 Clarify documentation for file pipeline
* scrapy#4034 Simplify documentation for pipeline
* scrapy#4034 Simplify documentation for pipeline
* scrapy#4034 Revert image, file pipeline docs. Enhance custom media pipeline docs.
* scrapy#4034 rebase master
* scrapy#4034 Clarify documentation for image and file pipelines
* scrapy#4034 Clarify documentation for file pipeline
* scrapy#4034 Simplify documentation for pipeline
* scrapy#4034 Simplify documentation for pipeline
* scrapy#4034 Clarify documentation for image and file pipelines
* scrapy#4034 Clarify documentation for file pipeline
* scrapy#4034 Simplify documentation for pipeline
* scrapy#4034 Simplify documentation for pipeline
* scrapy#4034 Revert image, file pipeline docs. Enhance custom media pipeline docs.
* scrapy#4034 rebase master
* Rebase master
* Add class to media pipeline docs
Co-Authored-By: elacuesta <elacuesta@users.noreply.github.com>
Co-authored-by: elacuesta <elacuesta@users.noreply.github.com>
2019-12-30 00:56:22 +05:00
f0ae673452
Merge pull request #4258 from atul-g/patch-1
...
Edited the link provided to homepage of lxml's website
2019-12-30 00:55:15 +05:00
82861c73c8
Edited the link of the homepage of lxml website
...
The link "https://lxml.de " is redirecting to a completely different and unintended website. I changed the link to the index page of lxml's official website. I thought of changing it to the PyPi page of lxml, but even they are providing the same "https://lxml.de " link which doesn't seem to be working now.
2019-12-27 22:57:58 +05:30
dc1ee09481
Rename ASYNCIO_ENABLED to ASYNCIO_REACTOR, change the logic accordingly.
2019-12-27 21:56:28 +05:00
20289be810
Merge remote-tracking branch 'origin/master' into asyncio-base
2019-12-20 19:31:20 +05:00
fb3fb17c28
Merge pull request #4045 from Gallaecio/documentation-coverage
...
Deprecate FilteringLinkExtractor direct usage; add API docs for scrapy.linkextractors
2019-12-20 02:01:45 +05:00
6a32a36e09
Merge pull request #4143 from Gallaecio/undent-rst-doctests
...
Do not indent doctests from the documentation unnecessarily
2019-12-20 01:59:07 +05:00
b4a2d985a7
Merge branch 'master' into undent-rst-doctests
2019-12-19 12:39:17 +01:00
16b363de31
Merge branch 'master' into fix_typos
2019-12-19 10:02:21 +01:00
23a67cec27
fix first letter capitalization for Raring and Scrapy
2019-12-19 09:57:17 +01:00
8f7faaa63d
Merge pull request #4190 from Gallaecio/doctest
...
Make developer-tools doctests pass
2019-12-18 23:40:21 +05:00
c0d84f0962
fix typos
2019-12-18 19:39:21 +01:00
916382e109
Add errback parameter to scrapy.spiders.crawl.Rule ( #4000 )
...
* Add errback parameter to scrapy.spiders.crawl.Rule
* CrawlSpider: optimize by reducing iterations
* [test] Rule.errback
* [doc] Rule.errback
* [doc] Use autoclass in docs/topics/spiders.rst
Co-Authored-By: Adrián Chaves <adrian@chaves.io>
* Rule.process_links takes a list
* Fix aesthetic issue reported by Flake8
2019-12-18 20:05:33 +05:00
053319334c
Merge pull request #4179 from Gallaecio/user-friendlier-tox
...
Make tox configuration more user friendly
2019-12-18 18:35:19 +05:00
012533924a
remove requirements from here too
2019-12-18 11:13:36 +00:00
607815dfc2
Merge branch 'master' into documentation-coverage
2019-12-17 16:54:27 +01:00
b8cf522916
Merge branch 'master' into user-friendlier-tox
2019-12-17 16:53:08 +01:00
a59bb279d1
add year through code
2019-12-15 17:33:00 +01:00
1aab20e1ce
update copyright notice year
2019-12-14 10:37:31 +01:00
e3a3ad4aaf
remove reference to old (Python 2.7) environment
2019-12-14 10:34:31 +01:00
3560123090
Rename ASYNCIO_SUPPORT to ASYNCIO_ENABLED.
2019-12-13 18:07:47 +05:00
352ddbb336
Merge remote-tracking branch 'origin/master' into asyncio-base
2019-12-13 18:07:23 +05:00
21a2f8c6f8
Merge branch 'master' into response_follow_all
2019-12-10 17:30:59 -03:00
1fc2b140c1
Merge branch 'master' into documentation-coverage
2019-12-05 14:43:36 +01:00
d7b1c138f1
Merge branch 'master' into user-friendlier-tox
2019-12-05 14:02:24 +01:00
83b8046fdc
Do not indent doctests from the documentation unnecessarily
2019-12-05 13:52:31 +01:00
af624ef414
Update overview.rst | Fix an inconsistency
...
There exists an inconsistency between the code (line 37 - 38) and the output 'quotes.json' (line 56 - 68).
Note that even though according to line 53 - 54 'quotes.json' is "reformatted here for better readability", it cannot explain why the "author" field precedes the "text" field.
Intended output for the code BEFORE change:
[{
"text": "\u201cThe person, be it gentleman or lady, who has not pleasure in a good novel, must be intolerably stupid.\u201d",
"author": "Jane Austen"
},
{
"text": "\u201cOutside of a dog, a book is man's best friend. Inside of a dog it's too dark to read.\u201d",
"author": "Groucho Marx"
},
{
"text": "\u201cA day without sunshine is like, you know, night.\u201d",
"author": "Steve Martin"
},
...]
Intended output for the code After change (the inconsistency is fixed):
[{
"author": "Jane Austen",
"text": "\u201cThe person, be it gentleman or lady, who has not pleasure in a good novel, must be intolerably stupid.\u201d"
},
{
"author": "Groucho Marx",
"text": "\u201cOutside of a dog, a book is man's best friend. Inside of a dog it's too dark to read.\u201d"
},
{
"author": "Steve Martin",
"text": "\u201cA day without sunshine is like, you know, night.\u201d"
},
...]
2019-12-05 09:29:12 +08:00
ed34ce14c0
Add the ASYNCIO_SUPPORT setting, reshuffle other logic accordingly.
2019-12-04 21:32:56 +05:00
9b7452211a
Merge pull request #4099 from BurnzZ/itemloader-docs
...
update docs of scrapy.loader.ItemLoader.item
2019-12-03 13:14:45 +05:00
5980b0f284
Don’t use follow_all where a single item is expected ( #4 )
2019-12-02 12:47:44 -03:00
b73fc99b60
Use InterSphinx for coverage links
2019-11-26 10:31:55 +01:00
dd12f5fdcd
Use Response.follow_all in the documentation where appropiate
2019-11-25 11:59:59 -03:00
54b056c4be
Make developer-tools doctests pass
2019-11-25 12:32:35 +01:00
40b5cfc0a4
Item loaders: allow single-argument processors (unbound methods)
2019-11-22 20:47:22 -03:00
6fa8f06b64
Merge remote-tracking branch 'upstream/master' into response_follow_all
2019-11-22 13:05:06 -03:00
0d416c6191
Merge pull request #4185 from Gallaecio/intersphinx
...
Use InterSphinx for links to the pytest and tox documentation
2019-11-21 23:27:57 +05:00
82c01c261f
Merge pull request #4184 from Gallaecio/doctest
...
Make debug doctests pass
2019-11-21 20:53:56 +05:00
fcfcabf1bd
Use InterSphinx for links to the pytest and tox documentation
2019-11-21 12:15:13 +01:00
Peter Vandenabeele
Mikhail Korobov
OmarFarrag
Eugenio Lacuesta
JP Balarini
1um0s
Atul Gopinathan
Andrey Rakhmatullin
Adrián Chaves
Marc Hernandez Cabot
elacuesta
Vostretsov Nikita
marc
Wang Qin