Commit Graph

9359 Commits

Author SHA1 Message Date
Andrey Rakhmatullin 20b79a0f2e Bump version: 2.6.2 → 2.7.0 2022-10-17 19:09:22 +06:00
Adrián Chaves 06c8f673af
2.7 release notes (#5680)
* Fix the display name of documented fingerprinter class methods

* Initial draft for the Scrapy 2.7 release notes

* Update VERSION and PREVIOUS_VERSION references

* Clarify the restrictions lifted for item field output names

* Fix the description of the BOM bug fix

* Fix the note about changes in MIME sniffing

* Fix typo

* Extend highlights

* Fyx typo
2022-10-17 18:04:29 +05:00
Andrey Rahmatullin ea6315b404
Merge pull request #5679 from wRAR/template-asyncio-reactor
Change TWISTED_REACTOR in the default template.
2022-10-15 14:54:59 +05:00
Adrián Chaves 960a7f68f6
Verify that the installed asyncio event loop matches ASYNCIO_EVENT_LOOP (#5529)
Co-authored-by: Laerte Pereira <5853172+Laerte@users.noreply.github.com>
2022-10-15 11:27:00 +02:00
Adrián Chaves 75bb516edb Adapt tests to the new value of TWISTED_REACTOR for new projects 2022-10-15 10:26:38 +02:00
Mohammadtaher Abbasi 043575123c
Add async callback support to the parse command (#5577) 2022-10-15 10:11:05 +02:00
Nirjas Jakilim 22a59d0005
CI: use the latest version of Ubuntu (#5675) 2022-10-14 19:41:50 +02:00
Andrey Rakhmatullin 62cc26e209 Change TWISTED_REACTOR in the default template. 2022-10-14 22:03:54 +06:00
gabrielztk 715c05d504
transport.producer.loseConnection() → transport.loseConnection() (#4995) 2022-10-13 12:22:10 +02:00
Laerte Pereira da9a2f8a94
Remove mention of minimum PyPy versions from the documentation (#5678) 2022-10-12 16:10:39 +02:00
Mikhail Korobov e4f6545fe9
Merge pull request #5665 from Abinashbunty/master
Update and rename INSTALL to INSTALL.md
2022-10-12 00:14:03 +05:00
Abdul Rauf 96fb663ae1
README: set Bash highlighting for pip install (#5648) 2022-10-11 19:34:18 +02:00
Derek d12fcc555b
Link to the Code of Conduct (#5659) 2022-10-11 19:32:45 +02:00
Mikhail Korobov 1c7f3ebd75
Merge pull request #5674 from Nirzak/master
Updated setup-python and checkout actions workflow
2022-10-10 20:18:04 +05:00
Mikhail Korobov f36d054a80
Merge pull request #5670 from scrapy/classifier-3.11
Add a classifier for Python 3.11.
2022-10-10 12:09:01 +05:00
Mikhail Korobov 767b4be508
Merge pull request #5668 from scrapy/update-tools
Update tool versions
2022-10-10 11:58:05 +05:00
Nirjas Jakilim b792632046
updated setup-python and checkout workflow 2022-10-10 11:47:02 +06:00
Andrey Rakhmatullin 5bf4260679 Update flake8. 2022-10-10 11:14:20 +06:00
Andrey Rakhmatullin eeb199adda Fix flake8 issues in previously ignored files. 2022-10-10 11:10:59 +06:00
Andrey Rakhmatullin 5fa613b419 Run flake8 directly. 2022-10-10 11:04:00 +06:00
Mikhail Korobov 1197a94557
Merge pull request #5672 from wRAR/ci-libxml
Remove a pin on libxml2-dev.
2022-10-10 01:54:13 +05:00
Andrey Rakhmatullin 92f2d75ed3 Add a classifier for Python 3.11. 2022-10-08 19:12:32 +06:00
Andrey Rakhmatullin ed9bc84d55 Remove a pin on libxml2-dev. 2022-10-08 19:11:16 +06:00
Mikhail Korobov 1b11f70cc0
Merge pull request #5667 from wRAR/ci-pypy
Simplify the PyPy installation in CI
2022-10-08 02:21:49 +05:00
Andrey Rakhmatullin d1515cc075 Update pylint. 2022-10-07 15:30:44 +06:00
Andrey Rakhmatullin ccb6a8c098 Add a note about flake8. 2022-10-07 15:27:14 +06:00
Andrey Rakhmatullin 424849b275 Update mypy. 2022-10-07 15:17:55 +06:00
Andrey Rakhmatullin 4aea925714 Update action versions. 2022-10-07 15:01:50 +06:00
Andrey Rakhmatullin 300c42bfdf Install PyPy using actions/setup-python. 2022-10-07 14:53:19 +06:00
Andrey Rahmatullin 2f6e8e26d6
Merge pull request #5664 from wRAR/ci-3.11
Python 3.11 support
2022-10-07 12:05:11 +05:00
Abinash Satapathy e60e8224a2
Update and rename INSTALL to INSTALL.md 2022-10-06 19:58:48 +02:00
Andrey Rakhmatullin fa58ab21e4 Replace _getargspec_py23() with inspect.getfullargspec(). 2022-10-06 20:59:06 +06:00
Andrey Rakhmatullin 82d10f0914 Add Ubuntu tests for Python 3.11rc2. 2022-10-06 20:27:06 +06:00
Andrey Rahmatullin d96c465dde
Merge pull request #5639 from Laerte/fix/test_batch_path_differ
fix: `batch_path_differ` test
2022-10-05 14:44:30 +05:00
Andrey Rahmatullin 28d65c88b1
Merge pull request #5662 from gliptak/pyopenssl1
Match pyOpenSSL and types-pyOpenSSL versions
2022-10-04 12:54:30 +05:00
Mikhail Korobov 019e1c3c5e
Merge pull request #5645 from gliptak/version1
Correct distutils deprecation warning
2022-10-04 11:12:04 +05:00
Andrey Rahmatullin 125d0fcb8b
Merge pull request #5649 from oscard0m/patch-1
ci(tests-windows): upgrade actions/setup-python to v4
2022-10-03 17:13:05 +05:00
Andrey Rahmatullin 94f5737169
Merge pull request #5650 from oscard0m/patch-2
ci(tests-windows): upgrade actions/checkout to v3
2022-10-03 17:12:47 +05:00
Andrey Rahmatullin 029591616c
Merge pull request #5651 from oscard0m/patch-3
ci(test-macos): upgrade actions/checkout to v3
2022-10-03 17:12:35 +05:00
Andrey Rahmatullin c962dae420
Merge pull request #5652 from oscard0m/patch-4
ci(test-macos): upgrade actions/setup-python to v4
2022-10-03 17:11:52 +05:00
Andrey Rahmatullin a193d14af2
Merge pull request #5657 from elacuesta/crawlspider-support-async-def-callback
CrawlSpider: add support for async callbacks
2022-10-03 17:09:53 +05:00
Andrey Rahmatullin 2d1c0552f5
Merge pull request #5656 from armujahid/twinecheck
CI: add Twine check in check workflow
2022-10-03 17:00:35 +05:00
Andrey Rahmatullin a7f916b96f
Merge pull request #5661 from felipeands/refact/improve-code-base
refact: add Osx DS_Store file to gitignore
2022-10-03 16:54:16 +05:00
Felipe A 41041ae740
refact: add Osx DS_Store file to gitignore 2022-10-03 00:48:12 -03:00
Eugenio Lacuesta da8f915091
Adapt for asyng generator callbacks 2022-10-02 17:37:10 -03:00
Mikhail Korobov 4f296b61b0
Merge pull request #5608 from zaid-ismail031/master
Changed incorrect info in documentation regarding the return type of parse method.
2022-10-03 00:19:08 +05:00
Eugenio Lacuesta 80194f1c03
CrawlSpider: add support for async def callbacks 2022-10-02 15:22:06 -03:00
Abdul Rauf 69bf5c6625 CI: move twinecheck to tox env 2022-10-02 20:27:24 +05:00
Abdul Rauf c7d800ab22 CI: add Twine check in check workflow 2022-10-02 19:12:48 +05:00
Gábor Lipták 759ad5dee4
Require packaging 2022-10-02 09:09:04 -04:00