6c747953f9
Cover 2.0.1 in the release notes ( #4437 )
2020-03-18 19:17:16 +01:00
533131a30f
Remove Guppy-specific code and documentation ( #4343 )
2020-03-17 10:12:49 +01:00
dfbe1d9507
Remove object base class ( #4430 )
2020-03-16 20:12:46 +01:00
f9bf4b8d4d
Remove all top-level imports for twisted.internet.reactor ( #4406 )
2020-03-14 10:39:00 +01:00
49156f2ecb
[doc] Feed exports: full local path as example
2020-03-11 20:45:54 -03:00
ada37c5409
Export to multiple formats in a single crawl
2020-03-05 09:33:57 -03:00
6aa0ba4553
Write release notes for Scrapy 2.0.0 ( #4329 )
2020-03-03 09:11:11 +01:00
ef00f8eb8e
updated with new macOS name ( #4308 ) ( #4323 )
...
* changed for new name as "macOS" (issue #4308 )
* updated macOS name
* update macOS name
* updated macOS name
* update for new macOS name
* docs/intro/install.rst: fix macOS header symbols
Co-Authored-By: elacuesta <elacuesta@users.noreply.github.com>
Co-authored-by: Adrián Chaves <adrian@chaves.io>
Co-authored-by: elacuesta <elacuesta@users.noreply.github.com>
2020-02-29 00:42:07 +05:00
a34c366fa4
DOC linkcheck run; https and 301 link updates.
...
Closes #4359
2020-02-25 16:51:33 +00:00
9d983c1b99
Expose certificate for HTTPS responses ( #4054 )
...
* Expose certificate for HTTPS responses
* Fix test (missing inlineCallbacks decorator)
* Note about Response.certificate
* Explicitly cover None as the default value of Response.certificate
Co-authored-by: Adrián Chaves <adrian@chaves.io>
2020-02-22 17:20:31 +05:00
88179027de
Merge pull request #4331 from Gallaecio/response-cb-kwargs
...
Implement Response.cb_kwargs
2020-02-19 22:40:14 +05:00
182445f9d9
Fix a spelling error: ie. → i.e. ( #4338 )
2020-02-18 17:58:31 +01:00
a04dd13cd0
ie. → i.e.
2020-02-14 22:31:30 +01:00
5ae3e1678f
ie. → i.e.
...
Co-Authored-By: elacuesta <elacuesta@users.noreply.github.com>
2020-02-14 22:30:36 +01:00
df937d8280
Implement Response.cb_kwargs
2020-02-13 22:33:36 +01:00
59653ebac6
Update installation instructions regarding Python 3 and virtual environments
2020-02-07 21:07:57 +01:00
b0eaf114e5
Merge pull request #4197 from elacuesta/sphinx-twisted-api
...
[Docs] Fix Twisted links
2020-02-07 23:51:15 +05:00
c3b690a5b5
Merge pull request #4290 from dekimsey/patch-1
...
FilesPipeline.file_path has optional arguments
2020-02-07 23:41:31 +05:00
afbaf9d430
Merge pull request #4303 from whalebot-helmsman/request_left_downloader_signal
...
request_left_downloader signal
2020-02-07 23:33:51 +05:00
153b78e53f
Update docs/topics/signals.rst
...
Co-Authored-By: elacuesta <elacuesta@users.noreply.github.com>
2020-02-07 11:08:55 +05:00
8817b9e8e9
Update docs/topics/signals.rst
...
Co-Authored-By: Adrián Chaves <adrian@chaves.io>
2020-02-07 11:07:53 +05:00
2f83f3e2cb
Update docs/topics/signals.rst
...
Co-Authored-By: Adrián Chaves <adrian@chaves.io>
2020-02-07 11:07:43 +05:00
84b55b7364
Update docs/topics/signals.rst
...
Co-Authored-By: Adrián Chaves <adrian@chaves.io>
2020-02-07 11:07:35 +05:00
4f31c3ce01
Document a backward incompatibility that may affect custom schedulers ( #4274 )
2020-02-06 22:21:33 +01:00
042e71e2b8
Merge pull request #4311 from Gallaecio/metarefresh-ignore-tags
...
Make METAREFRESH_IGNORE_TAGS an empty list by default
2020-02-06 23:40:45 +05:00
8d2705f23c
Merge pull request #4305 from Respawnz/patch-1
...
fix a typo in devloper-tools.rst
2020-02-06 23:17:28 +05:00
35dafef7f1
Specify Twisted reactor (TWISTED_REACTOR setting) ( #4294 )
...
* Add the ability to install a specific reactor
* Add docs for the TWISTED_REACTOR setting
* Add tests for the TWISTED_REACTOR setting
* Update asyncio reactor test
* Ignore W503 globally
W503 is not PEP8-compliant:
c59c4376ad
2020-02-06 22:42:34 +05:00
6733f4d976
Update docs/topics/signals.rst
...
Co-Authored-By: elacuesta <elacuesta@users.noreply.github.com>
2020-02-06 18:40:42 +05:00
576663e5a7
Make METAREFRESH_IGNORE_TAGS an empty list by default
2020-02-06 10:43:20 +01:00
c2cca36821
typo
2020-02-06 05:39:15 +08:00
aab39f6341
docummentation for new signal
2020-02-05 11:35:03 +00:00
47b9de93a9
Merge pull request #4288 from petervandenabeele/patch-1
...
[Docs] 2 typos + 1 clarification in docs
2020-01-30 03:15:18 +05:00
752e8f7018
FilesPipeline.file_path has optional arguments
...
Documented signature doesn't match the actual interface in [files.py](https://github.com/scrapy/scrapy/blob/master/scrapy/pipelines/files.py#L520 ).
Specifically, it looks like it may be [called](https://github.com/scrapy/scrapy/blob/master/scrapy/pipelines/files.py#L422 ) without a response value.
I found this when I was implementing the pipeline with the signature `file_path(self, request, response, info)` and the following error was being return in my results :
[(False, <twisted.python.failure.Failure builtins.TypeError: file_path() missing 1 required positional argument: 'response'>)]
Scrapy==1.8.0
2020-01-28 15:21:15 -06:00
f72d4e93e6
[Docs] 2 typos + 1 clarification in docs
...
Fixing 2 small typos and adding 1 word as clarification in the downloader-middlewares.
Also, I was confused with the entries like `ref:Reppy <reppy-parser>` and similar entries.
Are these supposed to be links to other parts of the doc, or is this the intended way of showing these references ?
2020-01-26 10:48:28 +01:00
f3374a5047
Fix variable name `author_page_links`
...
I did not test this code, but the change from `href` to this
author_page_links seems to have a typo ?
2020-01-25 16:53:29 +01:00
8b8df31961
Merge pull request #4227 from elacuesta/name-resolver
...
Name resolver with IPv6 support
2020-01-25 05:03:13 +05:00
fc98aa6b67
Merge branch 'master' into ftp_files#3928
2020-01-24 14:52:40 +02:00
bd54f22fef
Merge pull request #4282 from petervandenabeele/patch-1
...
fix logical documentation error with PER_DOMAIN or PER_DOMAIN
2020-01-24 02:01:22 +05:00
6a98d660e5
Merge pull request #3551 from jpbalarini/change_scraper_slot
...
[MRG+1] Add ability to change max_active_size by setting
2020-01-23 23:40:05 +05:00
7d5cebcf77
fix logical documentation error with PER_DOMAIN or PER_DOMAIN
2020-01-23 09:08:21 +01:00
c75cf15b7a
Update CSS selectors in tutorial
2020-01-22 10:38:59 -03:00
0f2d871d88
Use PEP 515 style for SCRAPER_SLOT_MAX_ACTIVE_SIZE documentation
2020-01-20 11:28:28 -03:00
eaa8ed02d0
Add ability to change max_active_size by settings
2020-01-20 11:27:58 -03:00
b471765d40
[doc] FAQ entry about the IPv6 and the DNS_RESOLVER setting
2020-01-18 01:52:29 -03:00
302d3f552b
[doc] DNS_RESOLVER setting
2020-01-18 01:46:24 -03:00
2e405d2d5c
Merge branch 'master' into response_follow_all
2020-01-05 00:33:19 -03:00
14d4428e70
Rephrasing documentation for image and file pipelines ( #4252 )
...
* scrapy#4034 Clarify documentation for image and file pipelines
* scrapy#4034 Clarify documentation for file pipeline
* scrapy#4034 Simplify documentation for pipeline
* scrapy#4034 Simplify documentation for pipeline
* scrapy#4034 Clarify documentation for image and file pipelines
* scrapy#4034 Clarify documentation for file pipeline
* scrapy#4034 Simplify documentation for pipeline
* scrapy#4034 Simplify documentation for pipeline
* scrapy#4034 Revert image, file pipeline docs. Enhance custom media pipeline docs.
* scrapy#4034 rebase master
* scrapy#4034 Clarify documentation for image and file pipelines
* scrapy#4034 Clarify documentation for file pipeline
* scrapy#4034 Simplify documentation for pipeline
* scrapy#4034 Simplify documentation for pipeline
* scrapy#4034 Clarify documentation for image and file pipelines
* scrapy#4034 Clarify documentation for file pipeline
* scrapy#4034 Simplify documentation for pipeline
* scrapy#4034 Simplify documentation for pipeline
* scrapy#4034 Revert image, file pipeline docs. Enhance custom media pipeline docs.
* scrapy#4034 rebase master
* Rebase master
* Add class to media pipeline docs
Co-Authored-By: elacuesta <elacuesta@users.noreply.github.com>
Co-authored-by: elacuesta <elacuesta@users.noreply.github.com>
2019-12-30 00:56:22 +05:00
f0ae673452
Merge pull request #4258 from atul-g/patch-1
...
Edited the link provided to homepage of lxml's website
2019-12-30 00:55:15 +05:00
82861c73c8
Edited the link of the homepage of lxml website
...
The link "https://lxml.de " is redirecting to a completely different and unintended website. I changed the link to the index page of lxml's official website. I thought of changing it to the PyPi page of lxml, but even they are providing the same "https://lxml.de " link which doesn't seem to be working now.
2019-12-27 22:57:58 +05:30
dc1ee09481
Rename ASYNCIO_ENABLED to ASYNCIO_REACTOR, change the logic accordingly.
2019-12-27 21:56:28 +05:00
Adrián Chaves
sakshamb2113
elacuesta
Aditya Kumar
Eugenio Lacuesta
MaliCN
nyov
Andrey Rahmatullin
Akshay Sharma
Mikhail Korobov
Vostretsov Nikita
Joy Bhalla
Respawnz
Daniel Kimsey
Peter Vandenabeele
OmarFarrag
JP Balarini
1um0s
Atul Gopinathan