RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
8,703 Commits 49 Branches 132 Tags 145 MiB
Commit Graph

8703 Commits

Author SHA1 Message Date
Adrián Chaves 5ba31cd1a2 HTTP/2 stream close reason handling: Use else + assert instead of elif 2021-02-23 11:57:33 +01:00
Adrián Chaves bd29f32dee HTTP/2: do not make conn_lost_deferred optional 2021-02-23 06:42:28 +01:00
Adrián Chaves 7605f19ec4 HTTP/2: test 2 concurrent requests to the same domain 2021-02-23 05:54:48 +01:00
Eugenio Lacuesta 6326178bc5
http2: acceptable protocol update, tests (#4994) 2021-02-22 16:50:51 +01:00
Eugenio Lacuesta 4418f78941
Simplify check for negotiated protocol 
negotiatedProtocol's type is Optional[bytes]

See https://github.com/twisted/twisted/blob/twisted-20.3.0/src/twisted/protocols/tls.py#L563-L587
and https://www.pyopenssl.org/en/20.0.1/api/ssl.html#OpenSSL.SSL.Connection.get_alpn_proto_negotiated

Note that OpenSSL.SSL.Connection.get_next_proto_negotiated is deprecated:
https://www.pyopenssl.org/en/20.0.0/changelog.html#backward-incompatible-changes
 2021-02-17 18:36:52 -03:00
Eugenio Lacuesta e80f37bd3f
Test http2 agent for unsupported scheme 2021-02-17 16:34:29 -03:00
Eugenio Lacuesta ac82a4a8a0
Merge remote-tracking branch 'upstream/master' into http2 2021-02-17 16:33:57 -03:00
Adrián Chaves ea92b49aaa
Merge pull request #4986 from wRAR/uvloop-py36 
Skip uvloop 0.15.0+ on py36.
 2021-02-11 12:07:28 +01:00
Andrey Rakhmatullin 54fd371481 Skip uvloop 0.15.0+ on py36. 2021-02-11 14:24:11 +05:00
Adrián Chaves 15b501c089 Do not force string interpolation while logging 2021-02-10 18:10:57 +01:00
Adrián Chaves 9ac5b1d021 Adjust test constraints 2021-02-09 09:13:25 +01:00
Adrián Chaves bb72bba178 tox: apply upper constraints to all non-pinned package installations 2021-02-09 09:13:25 +01:00
Adrián Chaves 45345ba6b5 Use constraints.txt to limit pip resolver backtracking 2021-02-09 09:13:25 +01:00
Adrián Chaves de82ca8547
Merge pull request #4982 from wRAR/refactor-spidermiddlewaremanager 
Refactor SpiderMiddlewareManager.scrape_response.
 2021-02-08 21:27:21 +01:00
Andrey Rakhmatullin 1e9b52c3e0 Refactor SpiderMiddlewareManager.scrape_response. 2021-02-08 22:02:03 +05:00
Adrián Chaves 8527b53e14 Revert "Use --use-deprecated=legacy-resolver" 
This reverts commit 7b11b74c77.
 2021-02-05 13:06:27 +01:00
Adrián Chaves 7afcd634ab Remove unused import 2021-02-05 13:04:54 +01:00
Adrián Chaves 7b11b74c77 Use --use-deprecated=legacy-resolver 
Let’s see how test results change
 2021-02-04 11:08:01 +01:00
Adrián Chaves 0e4b291701 HTTP/2: fix canceling a request before a connection has been established 2021-02-03 21:28:04 +01:00
Adrián Chaves 248800328c Fix test_pinned_twisted_version 2021-02-03 21:13:43 +01:00
Adrián Chaves 4c801551fa Document that the bytes_received signal is not yet implemented for HTTP/2 2021-02-03 21:11:46 +01:00
Adrián Chaves 1a7bde0d8e Document that HTTP/2 server pushes are ignored 2021-02-03 10:55:11 +01:00
Adrián Chaves c8d8b180bf Merge remote-tracking branch 'upstream/master' into http2 2021-02-03 09:37:35 +01:00
Adrián Chaves 536e749ecc HTTP/2: remove verbose protocol-handling logging 2021-02-03 09:22:02 +01:00
Adrián Chaves d1024566d8 setup.py: Twisted → Twisted[http2] 2021-02-03 09:13:45 +01:00
Adrián Chaves 2ce8e0c742 Document the (hard-coded) maximum HTTP/2 frame size accepted from servers 2021-02-03 09:09:53 +01:00
Mikhail Korobov 904a50138b
Merge pull request #4973 from Gallaecio/zyte 
Scrapinghub → Zyte
 2021-02-03 01:10:52 +05:00
Adrián Chaves f30f53b3cc Scrapinghub → Zyte 2021-02-02 15:03:20 +01:00
Mikhail Korobov 28262d4b24
Merge pull request #4956 from Gallaecio/readme-contributors 
Mention contributors in the README
 2021-01-14 19:58:52 +05:00
Adrián Chaves 6e7ae789f9
Reuse the text from https://scrapy.org/ 2021-01-14 11:59:38 +01:00
M Ikram Ullah Khan 0a1e2fefab
Docs: fix typo in news.rst (#4942) 2021-01-04 10:30:23 -03:00
Eugenio Lacuesta 80db569aea
Migrate CI to GitHub actions (#4924) 2021-01-01 19:13:39 -03:00
Eugenio Lacuesta e494a3f733
protocol attribute for h2 responses 2020-12-31 11:50:15 -03:00
Eugenio Lacuesta d698b5147b
Merge branch 'master' into http2 2020-12-31 11:13:25 -03:00
Kader DJEHAF 44a7ab5bf0
Fix warning: Expected type 'bool', got 'int' instead (#4940) 
* Fix warning: Expected type 'bool', got 'int' instead

* Update defer.py
 2020-12-30 11:22:27 -03:00
Adrián Chaves 39bc9a4d28
Merge pull request #4814 from dswij/tox-pip20.2 
add pip 20.2 test for tox
 2020-12-24 15:31:42 +01:00
Adrián Chaves 24e1b350ae
Merge pull request #4936 from timgates42/bugfix_typo_without 
docs: fix simple typo, wihout -> without
 2020-12-22 13:57:03 +01:00
Tim Gates 6dccf82eaa
docs: fix simple typo, wihout -> without 
There is a small typo in scrapy/http/request/form.py.

Should read `without` rather than `wihout`.
 2020-12-22 07:49:13 +11:00
Eugenio Lacuesta b83a1a6fbf Disable test under pypy 2020-12-21 17:21:08 +01:00
Adrián Chaves 45eb099ed1 Maybe it’s about having a newer libssl 2020-12-21 15:37:02 +01:00
Adrián Chaves 1c1255a75d Use sudo for apt-get 2020-12-21 14:41:02 +01:00
Adrián Chaves 798a818caf Move apt-get command from Tox to Travis CI 2020-12-21 13:35:40 +01:00
Adrián Chaves 0dff5781bc Blind attempt to fix the build of the cryptography-provided OpenSSL 2020-12-21 11:13:14 +01:00
Adrián Chaves 0567fdc56e Merge remote-tracking branch 'upstream/master' into tox-pip20.2 2020-12-21 11:02:05 +01:00
Adrián Chaves d0af008608
Merge pull request #4878 from elacuesta/response-protocol-attribute 
Response.protocol attribute
 2020-12-16 15:27:40 +01:00
Mikhail Korobov 212163e199
Merge pull request #4912 from elacuesta/remove_deprecated_pickled_settings_to_override 
Remove deprecated SCRAPY_PICKLED_SETTINGS_TO_OVERRIDE
 2020-12-04 01:36:47 +05:00
gunadhya db10aaf9eb
Update links in installation guide (#4899) 2020-12-03 10:56:36 +01:00
Eugenio Lacuesta 6091f3cc03
Remove unused pickle import 2020-12-01 10:26:21 -03:00
Eugenio Lacuesta a80bafe5cd
Remove deprecated SCRAPY_PICKLED_SETTINGS_TO_OVERRIDE 2020-11-30 19:03:13 -03:00
Kader DJEHAF 7fec9f991f
[Cleaned] PEP 8: E251 unexpected spaces around keyword / parameter equals (#4911) 
[Cleaned] PEP 8: E251 unexpected spaces around keyword / parameter equals
 2020-11-30 17:47:28 -03:00