RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
9,472 Commits 49 Branches 132 Tags 180 MiB
Commit Graph

9472 Commits

Author SHA1 Message Date
Andrey Rahmatullin 76c2cb070e
Merge pull request #5697 from iamkaushal/#5686_fix 
added typing.io and typing.re in pytest warning filter to ignore
 2022-10-28 11:38:55 +05:00
എതിരാളിക്കൊരു പോരാളി 9f45be439d
Update Code of Conduct to Contributor Covenant v2.1 2022-10-28 02:13:37 +02:00
iamkaushal bd9e482c2f added typing.io and typing.re in pytest warning filter to ignore 2022-10-27 23:21:55 +05:30
Magnus Offermanns fd692f3091
Prevent running the -O and -t command-line options together (#5605) 
Co-authored-by: Andrey Rakhmatullin <wrar@wrar.name>
 2022-10-27 14:43:31 +02:00
Andrey Rakhmatullin b71d0292d5 Add a test for processing partial callbacks. 2022-10-27 18:13:47 +06:00
Godson 3a34fa8399
Get the event loop from event_loop_policy to avoid a deprecation warning (#5689) 2022-10-27 14:02:12 +02:00
Andrey Rahmatullin b654183084
Use Python 3.11 as the default in CI (#5696) 2022-10-27 14:00:36 +02:00
Andrey Rakhmatullin ca50af6453 Remove an unused import. 2022-10-27 17:12:26 +06:00
Andrey Rahmatullin 5780ccba55
Merge branch 'master' into deprecate-NoimagesDrop 2022-10-27 15:46:32 +05:00
Mikhail Korobov 9fbd819b0e
Merge pull request #5695 from jidicula/patch-2 
ci: Update macos runner
 2022-10-27 12:45:43 +05:00
Andrey Rahmatullin c20b76d98f
Merge branch 'master' into patch-1 2022-10-27 12:04:00 +05:00
Johanan Idicula a214147359
ci: Update macos runner 
The GitHub Actions macos-10.15 runner image is now deprecated, and GitHub
Actions has begun to temporarily fail jobs referencing it during brownout
periods. The image will be fully unsupported by 2022-12-01, which is just about
a month away.

This change updates the macOS runner image to the latest generally-available
version, to help reduce spurious CI failures during the brownout periods, and to
stay abreast of the sunsetting of the macos-10.15 image.

See also: actions/runner-images#5583
 2022-10-26 21:44:47 -04:00
Andrei Andrukhovich b394f2165a
Fix typo: [they] depends → depend (#5694) 2022-10-26 22:11:28 +02:00
Laerte Pereira 2464939b7e
Fixed deprecation warning in scrapy.core.engine (#5589) 
* Change `download` function logic

* Fix CI error in 3.7 checks

* Make `spider` parameter optional in `_download` function, assign spider value from self if `None`
 2022-10-26 23:58:20 +05:00
Mikhail Korobov a1075b8979
Merge pull request #5626 from Gallaecio/more-lenient-proxying 
Relax Proxy-Authorization restrictions
 2022-10-26 23:36:29 +05:00
Adrián Chaves 46dd152b3e Merge remote-tracking branch 'upstream/master' into more-lenient-proxying 2022-10-26 16:55:04 +02:00
Andrey Rahmatullin 92be5ba257
Merge pull request #5691 from Godson-Gnanaraj/5323-fix-unable-to-parse-decorated-method 
Replace indentation of source before parsing with ast.
 2022-10-26 12:47:08 +05:00
Godson-Gnanaraj b0ddffc47b Misc. changes: 
- compile regex
  - readability improvements
 2022-10-26 06:53:43 +05:30
Godson-Gnanaraj 830e1c5dd8 Add test for parsing decorated methods 2022-10-26 01:26:54 +05:30
Kaushal Sharma f4e2a10ed6
Image.ANTIALIAS → Image.Resampling.LANCZOS (#5692) 2022-10-25 11:45:46 +02:00
Godson-Gnanaraj b61b71c6f0 Replace indentation of source before parsing with ast. 
closes #5323
 2022-10-25 08:54:16 +05:30
Matthew Donoughe 726680c712
change crawler_process to optional 2022-10-21 20:32:13 -04:00
Matthew Donoughe 28396c3497
convert _get_request_path back to str 2022-10-21 20:23:07 -04:00
Matthew Donoughe 69d1b8fc08
dirname cannot be falsey 2022-10-21 20:21:08 -04:00
Andrey Rahmatullin b33244e2f0
Fix the flake8 per-file ignore syntax (#5688) 2022-10-21 16:17:04 +02:00
Matthew Donoughe 607eece72a
move to after check 2022-10-20 20:18:06 -04:00
Matthew Donoughe 12a26755ae
improve render_templatefile 2022-10-20 20:14:43 -04:00
Matthew Donoughe 24d6ac1f52
downgrade the last 3.9 type hints 2022-10-20 20:03:38 -04:00
Matthew Donoughe c85de90819
fix path to tox.ini 2022-10-20 19:44:35 -04:00
Matthew Donoughe 065db7b566
fix some mypy issues 2022-10-19 08:28:26 -04:00
Matthew Donoughe 93d82648e5
resolve this path too 2022-10-19 08:08:21 -04:00
Matthew Donoughe fb26e6b650
resolve path to search in error 2022-10-18 20:21:11 -04:00
Matthew Donoughe 7daf735f45
downgrade type hint syntax 2022-10-18 20:07:29 -04:00
Mikhail Korobov 82f25bc44a
Merge pull request #5681 from mattkohl-flex/master 
Documentation: typo fixes
 2022-10-18 15:27:52 +05:00
Matthew Donoughe 40d9ca3bdd
use pathlib 2022-10-17 17:40:10 -04:00
Andrey Rakhmatullin 20b79a0f2e Bump version: 2.6.2 → 2.7.0 2022-10-17 19:09:22 +06:00
Adrián Chaves 06c8f673af
2.7 release notes (#5680) 
* Fix the display name of documented fingerprinter class methods

* Initial draft for the Scrapy 2.7 release notes

* Update VERSION and PREVIOUS_VERSION references

* Clarify the restrictions lifted for item field output names

* Fix the description of the BOM bug fix

* Fix the note about changes in MIME sniffing

* Fix typo

* Extend highlights

* Fyx typo
 2022-10-17 18:04:29 +05:00
mattkohl-flex c49764ffd7 typo fixes 2022-10-17 11:15:17 +01:00
Andrey Rahmatullin ea6315b404
Merge pull request #5679 from wRAR/template-asyncio-reactor 
Change TWISTED_REACTOR in the default template.
 2022-10-15 14:54:59 +05:00
Adrián Chaves 960a7f68f6
Verify that the installed asyncio event loop matches ASYNCIO_EVENT_LOOP (#5529) 
Co-authored-by: Laerte Pereira <5853172+Laerte@users.noreply.github.com>
 2022-10-15 11:27:00 +02:00
Adrián Chaves 75bb516edb Adapt tests to the new value of TWISTED_REACTOR for new projects 2022-10-15 10:26:38 +02:00
Mohammadtaher Abbasi 043575123c
Add async callback support to the parse command (#5577) 2022-10-15 10:11:05 +02:00
Nirjas Jakilim 22a59d0005
CI: use the latest version of Ubuntu (#5675) 2022-10-14 19:41:50 +02:00
Andrey Rakhmatullin 62cc26e209 Change TWISTED_REACTOR in the default template. 2022-10-14 22:03:54 +06:00
gabrielztk 715c05d504
transport.producer.loseConnection() → transport.loseConnection() (#4995) 2022-10-13 12:22:10 +02:00
Laerte Pereira da9a2f8a94
Remove mention of minimum PyPy versions from the documentation (#5678) 2022-10-12 16:10:39 +02:00
Mikhail Korobov e4f6545fe9
Merge pull request #5665 from Abinashbunty/master 
Update and rename INSTALL to INSTALL.md
 2022-10-12 00:14:03 +05:00
Abdul Rauf 96fb663ae1
README: set Bash highlighting for pip install (#5648) 2022-10-11 19:34:18 +02:00
Derek d12fcc555b
Link to the Code of Conduct (#5659) 2022-10-11 19:32:45 +02:00
Mikhail Korobov 1c7f3ebd75
Merge pull request #5674 from Nirzak/master 
Updated setup-python and checkout actions workflow
 2022-10-10 20:18:04 +05:00