RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
9,389 Commits 49 Branches 132 Tags 129 MiB
Commit Graph

9389 Commits

Author SHA1 Message Date
Andrey Rakhmatullin 6ded3cf4cd Bump version: 2.7.0 → 2.7.1 2022-11-02 17:00:47 +06:00
Andrey Rahmatullin 95880c5de1
Merge pull request #5701 from scrapy/relnotes-2.7.1 2022-11-02 15:42:52 +05:00
Andrey Rakhmatullin 5ec175b8bb Small relnotes fixes. 2022-11-02 13:54:00 +06:00
Andrey Rakhmatullin 940a73863b Release notes for 2.7.1. 2022-11-01 19:00:33 +06:00
Andrey Rahmatullin a95a338eea
Merge pull request #5599 from tonal/patch-1 
Partial in is_generator_with_return_value
 2022-10-31 20:08:16 +05:00
Andrey Rahmatullin 9077d0f9b4
Merge pull request #5698 from pankali/patch-1 
Update Code of Conduct to Contributor Covenant v2.1
 2022-10-28 12:51:38 +05:00
Andrey Rahmatullin 76c2cb070e
Merge pull request #5697 from iamkaushal/#5686_fix 
added typing.io and typing.re in pytest warning filter to ignore
 2022-10-28 11:38:55 +05:00
എതിരാളിക്കൊരു പോരാളി 9f45be439d
Update Code of Conduct to Contributor Covenant v2.1 2022-10-28 02:13:37 +02:00
iamkaushal bd9e482c2f added typing.io and typing.re in pytest warning filter to ignore 2022-10-27 23:21:55 +05:30
Magnus Offermanns fd692f3091
Prevent running the -O and -t command-line options together (#5605) 
Co-authored-by: Andrey Rakhmatullin <wrar@wrar.name>
 2022-10-27 14:43:31 +02:00
Andrey Rakhmatullin b71d0292d5 Add a test for processing partial callbacks. 2022-10-27 18:13:47 +06:00
Godson 3a34fa8399
Get the event loop from event_loop_policy to avoid a deprecation warning (#5689) 2022-10-27 14:02:12 +02:00
Andrey Rahmatullin b654183084
Use Python 3.11 as the default in CI (#5696) 2022-10-27 14:00:36 +02:00
Mikhail Korobov 9fbd819b0e
Merge pull request #5695 from jidicula/patch-2 
ci: Update macos runner
 2022-10-27 12:45:43 +05:00
Andrey Rahmatullin c20b76d98f
Merge branch 'master' into patch-1 2022-10-27 12:04:00 +05:00
Johanan Idicula a214147359
ci: Update macos runner 
The GitHub Actions macos-10.15 runner image is now deprecated, and GitHub
Actions has begun to temporarily fail jobs referencing it during brownout
periods. The image will be fully unsupported by 2022-12-01, which is just about
a month away.

This change updates the macOS runner image to the latest generally-available
version, to help reduce spurious CI failures during the brownout periods, and to
stay abreast of the sunsetting of the macos-10.15 image.

See also: actions/runner-images#5583
 2022-10-26 21:44:47 -04:00
Andrei Andrukhovich b394f2165a
Fix typo: [they] depends → depend (#5694) 2022-10-26 22:11:28 +02:00
Laerte Pereira 2464939b7e
Fixed deprecation warning in scrapy.core.engine (#5589) 
* Change `download` function logic

* Fix CI error in 3.7 checks

* Make `spider` parameter optional in `_download` function, assign spider value from self if `None`
 2022-10-26 23:58:20 +05:00
Mikhail Korobov a1075b8979
Merge pull request #5626 from Gallaecio/more-lenient-proxying 
Relax Proxy-Authorization restrictions
 2022-10-26 23:36:29 +05:00
Adrián Chaves 46dd152b3e Merge remote-tracking branch 'upstream/master' into more-lenient-proxying 2022-10-26 16:55:04 +02:00
Andrey Rahmatullin 92be5ba257
Merge pull request #5691 from Godson-Gnanaraj/5323-fix-unable-to-parse-decorated-method 
Replace indentation of source before parsing with ast.
 2022-10-26 12:47:08 +05:00
Godson-Gnanaraj b0ddffc47b Misc. changes: 
- compile regex
  - readability improvements
 2022-10-26 06:53:43 +05:30
Godson-Gnanaraj 830e1c5dd8 Add test for parsing decorated methods 2022-10-26 01:26:54 +05:30
Kaushal Sharma f4e2a10ed6
Image.ANTIALIAS → Image.Resampling.LANCZOS (#5692) 2022-10-25 11:45:46 +02:00
Godson-Gnanaraj b61b71c6f0 Replace indentation of source before parsing with ast. 
closes #5323
 2022-10-25 08:54:16 +05:30
Andrey Rahmatullin b33244e2f0
Fix the flake8 per-file ignore syntax (#5688) 2022-10-21 16:17:04 +02:00
Mikhail Korobov 82f25bc44a
Merge pull request #5681 from mattkohl-flex/master 
Documentation: typo fixes
 2022-10-18 15:27:52 +05:00
Andrey Rakhmatullin 20b79a0f2e Bump version: 2.6.2 → 2.7.0 2022-10-17 19:09:22 +06:00
Adrián Chaves 06c8f673af
2.7 release notes (#5680) 
* Fix the display name of documented fingerprinter class methods

* Initial draft for the Scrapy 2.7 release notes

* Update VERSION and PREVIOUS_VERSION references

* Clarify the restrictions lifted for item field output names

* Fix the description of the BOM bug fix

* Fix the note about changes in MIME sniffing

* Fix typo

* Extend highlights

* Fyx typo
 2022-10-17 18:04:29 +05:00
mattkohl-flex c49764ffd7 typo fixes 2022-10-17 11:15:17 +01:00
Andrey Rahmatullin ea6315b404
Merge pull request #5679 from wRAR/template-asyncio-reactor 
Change TWISTED_REACTOR in the default template.
 2022-10-15 14:54:59 +05:00
Adrián Chaves 960a7f68f6
Verify that the installed asyncio event loop matches ASYNCIO_EVENT_LOOP (#5529) 
Co-authored-by: Laerte Pereira <5853172+Laerte@users.noreply.github.com>
 2022-10-15 11:27:00 +02:00
Adrián Chaves 75bb516edb Adapt tests to the new value of TWISTED_REACTOR for new projects 2022-10-15 10:26:38 +02:00
Mohammadtaher Abbasi 043575123c
Add async callback support to the parse command (#5577) 2022-10-15 10:11:05 +02:00
Nirjas Jakilim 22a59d0005
CI: use the latest version of Ubuntu (#5675) 2022-10-14 19:41:50 +02:00
Andrey Rakhmatullin 62cc26e209 Change TWISTED_REACTOR in the default template. 2022-10-14 22:03:54 +06:00
gabrielztk 715c05d504
transport.producer.loseConnection() → transport.loseConnection() (#4995) 2022-10-13 12:22:10 +02:00
Laerte Pereira da9a2f8a94
Remove mention of minimum PyPy versions from the documentation (#5678) 2022-10-12 16:10:39 +02:00
Mikhail Korobov e4f6545fe9
Merge pull request #5665 from Abinashbunty/master 
Update and rename INSTALL to INSTALL.md
 2022-10-12 00:14:03 +05:00
Abdul Rauf 96fb663ae1
README: set Bash highlighting for pip install (#5648) 2022-10-11 19:34:18 +02:00
Derek d12fcc555b
Link to the Code of Conduct (#5659) 2022-10-11 19:32:45 +02:00
Mikhail Korobov 1c7f3ebd75
Merge pull request #5674 from Nirzak/master 
Updated setup-python and checkout actions workflow
 2022-10-10 20:18:04 +05:00
Mikhail Korobov f36d054a80
Merge pull request #5670 from scrapy/classifier-3.11 
Add a classifier for Python 3.11.
 2022-10-10 12:09:01 +05:00
Mikhail Korobov 767b4be508
Merge pull request #5668 from scrapy/update-tools 
Update tool versions
 2022-10-10 11:58:05 +05:00
Nirjas Jakilim b792632046
updated setup-python and checkout workflow 2022-10-10 11:47:02 +06:00
Andrey Rakhmatullin 5bf4260679 Update flake8. 2022-10-10 11:14:20 +06:00
Andrey Rakhmatullin eeb199adda Fix flake8 issues in previously ignored files. 2022-10-10 11:10:59 +06:00
Andrey Rakhmatullin 5fa613b419 Run flake8 directly. 2022-10-10 11:04:00 +06:00
Mikhail Korobov 1197a94557
Merge pull request #5672 from wRAR/ci-libxml 
Remove a pin on libxml2-dev.
 2022-10-10 01:54:13 +05:00
Andrey Rakhmatullin 92f2d75ed3 Add a classifier for Python 3.11. 2022-10-08 19:12:32 +06:00