Commit Graph

125 Commits

Author SHA1 Message Date
Adrián Chaves efc11b3b7e zope.interface: 4.4.2 → 5.0.0 (setuptools #2017) 2022-09-26 22:55:15 +02:00
Adrián Chaves 9f443e8944 zope.interface: 4.1.3 → 4.4.2 2022-09-26 22:45:15 +02:00
Gábor Lipták 889f649567 Match pyOpenSSL and service_identity to Twisted
Signed-off-by: Gábor Lipták <gliptak@gmail.com>
2022-09-26 21:57:00 +02:00
Adrián Chaves e865c4430e
Merge pull request from GHSA-mfjm-vh54-3f96
* Ignore cookies with a public suffix as domain unless it matches the request domain

* Fix the merge of 1.8.2 release notes

* Re-apply removal of tldextract restriction
2022-03-01 12:38:19 +01:00
Eugenio Lacuesta cfff79cee6
Make Python 3.10 support official (#5265) 2021-10-18 22:09:17 +02:00
Adrián Chaves c5b1ee8101
Make Twisted[http2] installation optional (#5113)
Co-authored-by: Eugenio Lacuesta <eugenio.lacuesta@gmail.com>
2021-05-11 09:04:53 +02:00
Tomáš Hrnčiar 4f500342c8
Require setuptools, scrapy/cmdline.py, /setup.py and tests/test_webclient.py import pkg_resources 2021-04-28 11:57:44 +02:00
Eugenio Lacuesta 1d200258a5
Adjust h2 version requirement (#5066) 2021-03-26 14:45:26 +01:00
Adrián Chaves 1d83697990
Merge pull request #4769 from scrapy/http2
Implement experimental HTTP/2 support
2021-03-18 22:18:12 +01:00
vinayak 42e4dbb23d
Support Python 3.9 (#4759)
* Update .travis.yml

* Update .travis.yml

* updage travis.yml

* Make 3.9 support official

* Upgrade mitmproxy for Python 3.9

* Restore the Pylint job

* Undo unintended change to mitmproxy requirement

* Enable Python 3.9 in GitHub Actions

* Work around reppy’s Python version limitation

* Disable tests in Windows / Python 3.9 due to a Twisted bug

Co-authored-by: Adrián Chaves <adrian@chaves.io>
2021-03-18 09:40:03 -03:00
Adrián Chaves d1024566d8 setup.py: Twisted → Twisted[http2] 2021-02-03 09:13:45 +01:00
Eugenio Lacuesta d698b5147b
Merge branch 'master' into http2 2020-12-31 11:13:25 -03:00
Adrián Chaves 0567fdc56e Merge remote-tracking branch 'upstream/master' into tox-pip20.2 2020-12-21 11:02:05 +01:00
Kader DJEHAF 7fec9f991f
[Cleaned] PEP 8: E251 unexpected spaces around keyword / parameter equals (#4911)
[Cleaned] PEP 8: E251 unexpected spaces around keyword / parameter equals
2020-11-30 17:47:28 -03:00
Adrián Chaves 7187247c01 Add PyDispatcher>=2.0.5 back to dependencies for old pip 2020-10-30 10:23:59 +01:00
dswij 9f02df20c5 Remove PyDispatcher from general requirements 2020-10-07 01:10:23 +07:00
Adrián Chaves 8a3ba34a75 Merge remote-tracking branch 'upstream/master' into http2 2020-08-31 16:43:32 +02:00
Adrián Chaves 195f738bba
Update Python version references after dropping support for 3.5 (#4742)
* Update Python version references after dropping support for 3.5

* Remove outdated test

* Undo change affecting collect_asyncgen

* Undo change to be handled by #4743

* Remove unused import

* Remove unused import

* Update tests/requirements-py3.txt

Co-authored-by: Mikhail Korobov <kmike84@gmail.com>

Co-authored-by: Mikhail Korobov <kmike84@gmail.com>
2020-08-27 15:43:43 +05:00
Aditya 5e36f539e2 chore: remove typing-extensions dependency 2020-08-27 15:12:22 +05:30
Aditya 1432161477 fix: bump min typing-extensions version to 3.7.4
- typing-extensions>=3.7.4 only supports TypedDict
2020-08-24 15:40:01 +05:30
Aditya 26d344b762 Merge branch 'http2' of https://github.com/scrapy/scrapy into h2-client-protocol 2020-08-24 14:58:23 +05:30
Hugo van Kemenade a57db9e302
Bitbucket no longer supports Mercurial repositories (#4738) 2020-08-19 17:45:24 +02:00
Aditya a87ab71d10 refactor(http2): metadata for Stream
- Add Note about HTTP/2 Cleartext not supported in settings.rst
2020-08-18 05:52:40 +05:30
Aditya f9f008e935 test: add typing-extensions 2020-08-16 17:04:40 +05:30
Aditya d97cf973dd Merge branch 'master' of https://github.com/scrapy/scrapy into h2-client-protocol 2020-08-16 11:31:10 +05:30
linchiwei123 4dc09f09aa
Update setup.py 2020-08-05 22:23:19 +08:00
Adrián Chaves d29bec60d7
Upgrade PyPy for CI, and test both 3.5 (oldest) and 3.6 (newest) (#4504)
* Upgrade PyPy for CI, and test both 3.5 (oldest) and 3.6 (newest)

* Log a detailed error message to discover why MockServer is not working

* Go for all lines!

* Disable tests based on mitmproxy while running on PyPy

* Fix test_get_func_args for PyPy 3.6+

* Make testPayloadDefaultCiphers work regardless of OpenSSL default ciphers

* Crossing fingers…

* Rename: testPayloadDefaultCiphers → testPayloadDisabledCipher

* Test the PyPy version currently documented as the minimum required version

* Fix the PYPY_VERSION tag

* Update the documentation about supported PyPy versions

* Also test the latest 3.5 Python version with PyPy

* Fix the PYPY_VERSION value for the latest 3.5 version

* Use pinned dependencies for asyncio and PyPy tests against oldest supported Python versions

* Fix PyPy installation for the pypy3-pinned Tox environment

* Try installing Cython

* Maybe PyPy requires lxml 3.6.0?

* install.rst: minor clarification

* lxml 4.0.0 is required on PyPy

* Require setuptools 18.5+

* Revert "Require setuptools 18.5+"

This reverts commit 017ec33ac2.

* Maintain lxml as a dependency if setuptools < 18.5 is used
2020-07-17 02:19:24 +05:00
Júlio César Batista 38496a00b7
Use the itemlaoders library (#4516) 2020-07-15 12:08:36 +02:00
Aditya 7f5bb6b34c chore: add h2 to setup.py, tox.ini
- Change log level for hpack to ERROR
2020-07-06 13:12:04 +05:30
Aditya 7b1ad995a4 test: query params, certificate & ip_address
- refactor from str.format() to f-strings
2020-07-01 10:45:36 +05:30
Aditya 23906b6bee refactor: move TypedDict types to types.py
- rename LOGGER -> logger
- remove self._write_to_transport from Stream class and handle all
transport related activities inside HTTP2ClientProtocol class
2020-06-29 18:21:05 +05:30
Aditya 690dd7f38b test: GET & POST request test for h2 client
- Remove repeated dependency Twisted from setup.py
- Test for both GET & POST when
  - Only 1 request
  - Large number (=20) of requests
and
  - Small Data (10 KB) per request
  - Large Data (10 MB) per request
- Test when request is cancelled by the client'

BREAKING CHANGES
Tests raises OpenSSL.SSL.Error when run using tox. However, all tests
passes when ran using `python -m unittest`.
2020-06-28 16:38:49 +05:30
Aditya 69f6d038c0 feat: TypedDict for Stream._response
- remove test_protocol.py as working testing environment is setup 🙂🙃
- Add typing_extensions as dependency to support TypedDict for
python<3.8
2020-06-24 07:50:21 +05:30
Aditya 700df3eeb7 test: mockserver with h2 protocol for tests
- add Twisted[http2] in setup.py requirements
- add test_protocol.py to test the current implementation

BREAKING CHANGES
test_download times out because of no protocol negotiated between
Mockserver and HTTP/2 client
2020-06-17 21:02:14 +05:30
Eugenio Lacuesta ec98dabfab
Support for dataclass and attrs items (#3881) 2020-06-14 11:45:27 +02:00
Eugenio Lacuesta 8b549392f9
Bump minimum Python version to 3.5.2 (#4615) 2020-06-11 14:53:59 +02:00
Vostretsov Nikita 16f2cb4a83 project URLs in machine-readable format for showing in pypi 2020-03-26 12:57:39 +00:00
Eugenio Lacuesta 0c4e5b68ea
Remove six from requirements and setup files 2019-11-03 12:30:34 -03:00
Andrey Rahmatullin 229e722a03 Initial Python 2 removal (#4091) 2019-10-31 10:46:02 +01:00
Roy 9b47dc6a70 [travis, setup] Adding official python 3.8 support
https://github.com/scrapy/scrapy/issues/4085
2019-10-28 11:24:52 +00:00
Roy Healy 179dc916ff
Update setup.py
Updating setup.py to remove python 3.8 support for now
2019-10-27 16:48:20 +00:00
Roy 4e939ca75d [setup.py] Added python 3.8 fields
https://github.com/scrapy/scrapy/issues/4085
2019-10-21 18:33:18 +01:00
Vostretsov Nikita c7f2bdfdbe add protego to install_requires 2019-09-10 08:58:52 +00:00
elacuesta 5dbeece8da [MRG+1] Drop py34 support - Update CI envs (#3892)
* Drop py34 support

* Travis experiments

* More Travis experiments

* Bump Twisted version for py35+ (stretch)

* Remove Debian build

* Remove pinned lxml for Py34

* Fix merge error

* Remove unused tox env

* Add environment with pinned versions for py36

* Bump minimum Twisted version in py27; Envs with pinned versions for py27 and py35

* Add botocore as extra dep for py27 tests

* Update requirements-py2.txt

* Add botocore and Pillow as extra dependencies
2019-08-07 12:36:52 +05:00
Renne Rocha a25e09ecdd Added constrain on lxml version based on Python version 2019-07-30 23:24:41 -03:00
Adrián Chaves 0da972339b Require Twisted<=19.2.0 for Python 3.4 2019-06-11 14:11:38 +02:00
Mikhail Korobov cdd04dfb1d declare Python 3.7 support in setup.py 2018-12-26 13:13:49 +05:00
Mikhail Korobov 25ac4691b4 require parsel 1.5+ 2018-09-12 17:57:27 +05:00
Eugenio Lacuesta 0d87e77afe Bump parsel dependency 2018-02-08 15:03:57 -03:00
Mikhail Korobov 1058169f0e setup.py: mention that we support PyPy. See GH-2213. 2017-12-25 15:31:07 +05:00