mirror of https://github.com/scrapy/scrapy.git
Closes #7499 When DOWNLOADER_CLIENT_TLS_CIPHERS is set to None, acceptableCiphers was still passed to CertificateOptions (as None), causing Twisted to fall back to OpenSSL's DEFAULT cipher list instead of using its own curated, stricter defaults. Fix: omit the acceptableCiphers kwarg entirely when tls_ciphers is None, letting Twisted use its own internal defaults. Changes: - contextfactory.py: conditionally include acceptableCiphers kwarg - tls.py: remove deprecated DEFAULT_CIPHERS attribute (no callers) - tests: update test_none to assert acceptableCiphers is not in kwargs |
||
|---|---|---|
| .github | ||
| docs | ||
| extras | ||
| scrapy | ||
| sep | ||
| tests | ||
| tests_typing | ||
| .git-blame-ignore-revs | ||
| .gitattributes | ||
| .gitignore | ||
| .pre-commit-config.yaml | ||
| .readthedocs.yml | ||
| AUTHORS | ||
| CITATION.cff | ||
| CODE_OF_CONDUCT.md | ||
| CONTRIBUTING.md | ||
| INSTALL.md | ||
| LICENSE | ||
| NEWS | ||
| README.rst | ||
| SECURITY.md | ||
| codecov.yml | ||
| conftest.py | ||
| pyproject.toml | ||
| tox.ini | ||
README.rst
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
<head>
</head>
</html>
Scrapy is a web scraping framework to extract structured data from websites. It is cross-platform, and requires Python 3.10+. It is maintained by Zyte (formerly Scrapinghub) and many other contributors.
Install with:
System Message: WARNING/2 (<stdin>, line 52)
Cannot analyze code. Pygments package not found.
.. code:: bash
pip install scrapy
And follow the documentation to learn how to use it.
If you wish to contribute, see Contributing.