RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
9,378 Commits 49 Branches 132 Tags 129 MiB
Commit Graph

9378 Commits

Author SHA1 Message Date
എതിരാളിക്കൊരു പോരാളി 9f45be439d
Update Code of Conduct to Contributor Covenant v2.1 2022-10-28 02:13:37 +02:00
Magnus Offermanns fd692f3091
Prevent running the -O and -t command-line options together (#5605) 
Co-authored-by: Andrey Rakhmatullin <wrar@wrar.name>
 2022-10-27 14:43:31 +02:00
Godson 3a34fa8399
Get the event loop from event_loop_policy to avoid a deprecation warning (#5689) 2022-10-27 14:02:12 +02:00
Andrey Rahmatullin b654183084
Use Python 3.11 as the default in CI (#5696) 2022-10-27 14:00:36 +02:00
Mikhail Korobov 9fbd819b0e
Merge pull request #5695 from jidicula/patch-2 
ci: Update macos runner
 2022-10-27 12:45:43 +05:00
Johanan Idicula a214147359
ci: Update macos runner 
The GitHub Actions macos-10.15 runner image is now deprecated, and GitHub
Actions has begun to temporarily fail jobs referencing it during brownout
periods. The image will be fully unsupported by 2022-12-01, which is just about
a month away.

This change updates the macOS runner image to the latest generally-available
version, to help reduce spurious CI failures during the brownout periods, and to
stay abreast of the sunsetting of the macos-10.15 image.

See also: actions/runner-images#5583
 2022-10-26 21:44:47 -04:00
Andrei Andrukhovich b394f2165a
Fix typo: [they] depends → depend (#5694) 2022-10-26 22:11:28 +02:00
Laerte Pereira 2464939b7e
Fixed deprecation warning in scrapy.core.engine (#5589) 
* Change `download` function logic

* Fix CI error in 3.7 checks

* Make `spider` parameter optional in `_download` function, assign spider value from self if `None`
 2022-10-26 23:58:20 +05:00
Mikhail Korobov a1075b8979
Merge pull request #5626 from Gallaecio/more-lenient-proxying 
Relax Proxy-Authorization restrictions
 2022-10-26 23:36:29 +05:00
Adrián Chaves 46dd152b3e Merge remote-tracking branch 'upstream/master' into more-lenient-proxying 2022-10-26 16:55:04 +02:00
Andrey Rahmatullin 92be5ba257
Merge pull request #5691 from Godson-Gnanaraj/5323-fix-unable-to-parse-decorated-method 
Replace indentation of source before parsing with ast.
 2022-10-26 12:47:08 +05:00
Godson-Gnanaraj b0ddffc47b Misc. changes: 
- compile regex
  - readability improvements
 2022-10-26 06:53:43 +05:30
Godson-Gnanaraj 830e1c5dd8 Add test for parsing decorated methods 2022-10-26 01:26:54 +05:30
Kaushal Sharma f4e2a10ed6
Image.ANTIALIAS → Image.Resampling.LANCZOS (#5692) 2022-10-25 11:45:46 +02:00
Godson-Gnanaraj b61b71c6f0 Replace indentation of source before parsing with ast. 
closes #5323
 2022-10-25 08:54:16 +05:30
Andrey Rahmatullin b33244e2f0
Fix the flake8 per-file ignore syntax (#5688) 2022-10-21 16:17:04 +02:00
Mikhail Korobov 82f25bc44a
Merge pull request #5681 from mattkohl-flex/master 
Documentation: typo fixes
 2022-10-18 15:27:52 +05:00
Andrey Rakhmatullin 20b79a0f2e Bump version: 2.6.2 → 2.7.0 2022-10-17 19:09:22 +06:00
Adrián Chaves 06c8f673af
2.7 release notes (#5680) 
* Fix the display name of documented fingerprinter class methods

* Initial draft for the Scrapy 2.7 release notes

* Update VERSION and PREVIOUS_VERSION references

* Clarify the restrictions lifted for item field output names

* Fix the description of the BOM bug fix

* Fix the note about changes in MIME sniffing

* Fix typo

* Extend highlights

* Fyx typo
 2022-10-17 18:04:29 +05:00
mattkohl-flex c49764ffd7 typo fixes 2022-10-17 11:15:17 +01:00
Andrey Rahmatullin ea6315b404
Merge pull request #5679 from wRAR/template-asyncio-reactor 
Change TWISTED_REACTOR in the default template.
 2022-10-15 14:54:59 +05:00
Adrián Chaves 960a7f68f6
Verify that the installed asyncio event loop matches ASYNCIO_EVENT_LOOP (#5529) 
Co-authored-by: Laerte Pereira <5853172+Laerte@users.noreply.github.com>
 2022-10-15 11:27:00 +02:00
Adrián Chaves 75bb516edb Adapt tests to the new value of TWISTED_REACTOR for new projects 2022-10-15 10:26:38 +02:00
Mohammadtaher Abbasi 043575123c
Add async callback support to the parse command (#5577) 2022-10-15 10:11:05 +02:00
Nirjas Jakilim 22a59d0005
CI: use the latest version of Ubuntu (#5675) 2022-10-14 19:41:50 +02:00
Andrey Rakhmatullin 62cc26e209 Change TWISTED_REACTOR in the default template. 2022-10-14 22:03:54 +06:00
gabrielztk 715c05d504
transport.producer.loseConnection() → transport.loseConnection() (#4995) 2022-10-13 12:22:10 +02:00
Laerte Pereira da9a2f8a94
Remove mention of minimum PyPy versions from the documentation (#5678) 2022-10-12 16:10:39 +02:00
Mikhail Korobov e4f6545fe9
Merge pull request #5665 from Abinashbunty/master 
Update and rename INSTALL to INSTALL.md
 2022-10-12 00:14:03 +05:00
Abdul Rauf 96fb663ae1
README: set Bash highlighting for pip install (#5648) 2022-10-11 19:34:18 +02:00
Derek d12fcc555b
Link to the Code of Conduct (#5659) 2022-10-11 19:32:45 +02:00
Mikhail Korobov 1c7f3ebd75
Merge pull request #5674 from Nirzak/master 
Updated setup-python and checkout actions workflow
 2022-10-10 20:18:04 +05:00
Mikhail Korobov f36d054a80
Merge pull request #5670 from scrapy/classifier-3.11 
Add a classifier for Python 3.11.
 2022-10-10 12:09:01 +05:00
Mikhail Korobov 767b4be508
Merge pull request #5668 from scrapy/update-tools 
Update tool versions
 2022-10-10 11:58:05 +05:00
Nirjas Jakilim b792632046
updated setup-python and checkout workflow 2022-10-10 11:47:02 +06:00
Andrey Rakhmatullin 5bf4260679 Update flake8. 2022-10-10 11:14:20 +06:00
Andrey Rakhmatullin eeb199adda Fix flake8 issues in previously ignored files. 2022-10-10 11:10:59 +06:00
Andrey Rakhmatullin 5fa613b419 Run flake8 directly. 2022-10-10 11:04:00 +06:00
Mikhail Korobov 1197a94557
Merge pull request #5672 from wRAR/ci-libxml 
Remove a pin on libxml2-dev.
 2022-10-10 01:54:13 +05:00
Andrey Rakhmatullin 92f2d75ed3 Add a classifier for Python 3.11. 2022-10-08 19:12:32 +06:00
Andrey Rakhmatullin ed9bc84d55 Remove a pin on libxml2-dev. 2022-10-08 19:11:16 +06:00
Mikhail Korobov 1b11f70cc0
Merge pull request #5667 from wRAR/ci-pypy 
Simplify the PyPy installation in CI
 2022-10-08 02:21:49 +05:00
Andrey Rakhmatullin d1515cc075 Update pylint. 2022-10-07 15:30:44 +06:00
Andrey Rakhmatullin ccb6a8c098 Add a note about flake8. 2022-10-07 15:27:14 +06:00
Andrey Rakhmatullin 424849b275 Update mypy. 2022-10-07 15:17:55 +06:00
Andrey Rakhmatullin 4aea925714 Update action versions. 2022-10-07 15:01:50 +06:00
Andrey Rakhmatullin 300c42bfdf Install PyPy using actions/setup-python. 2022-10-07 14:53:19 +06:00
Andrey Rahmatullin 2f6e8e26d6
Merge pull request #5664 from wRAR/ci-3.11 
Python 3.11 support
 2022-10-07 12:05:11 +05:00
Abinash Satapathy e60e8224a2
Update and rename INSTALL to INSTALL.md 2022-10-06 19:58:48 +02:00
Andrey Rakhmatullin fa58ab21e4 Replace _getargspec_py23() with inspect.getfullargspec(). 2022-10-06 20:59:06 +06:00