RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
11,191 Commits 49 Branches 132 Tags 162 MiB
Commit Graph

11191 Commits

Author SHA1 Message Date
Andrey Rahmatullin bbe24d79a5
Fix test issues 2022-11-07 17:08:54 +05:00
Andrey Rahmatullin 6c0890ff54
Simplify the changes after the merge 2022-11-07 16:36:54 +05:00
Andrey Rahmatullin b03d84e9fb
Merge branch 'master' into 3689-update 2022-11-07 16:33:21 +05:00
Andrey Rahmatullin 77cd511a5e
Merge pull request #5489 from PluT00/deprecate-NoimagesDrop 
Deprecate scrapy.pipelines.images.NoimagesDrop
 2022-11-05 14:18:19 +05:00
srki24 a34b929a40 issues/5043 Detaching the stream 2022-11-04 18:00:17 +01:00
Andrey Rahmatullin 8004075823
Merge pull request #5699 from elacuesta/crawlspider-callback-keyword-arguments 
CrawlSpider: pass cb_kwargs from process_request
 2022-11-02 17:35:03 +05:00
Andrey Rakhmatullin 6ded3cf4cd Bump version: 2.7.0 → 2.7.1 2022-11-02 17:00:47 +06:00
Andrey Rahmatullin 95880c5de1
Merge pull request #5701 from scrapy/relnotes-2.7.1 2022-11-02 15:42:52 +05:00
Andrey Rakhmatullin 5ec175b8bb Small relnotes fixes. 2022-11-02 13:54:00 +06:00
Andrey Rakhmatullin 940a73863b Release notes for 2.7.1. 2022-11-01 19:00:33 +06:00
Andrey Rahmatullin a95a338eea
Merge pull request #5599 from tonal/patch-1 
Partial in is_generator_with_return_value
 2022-10-31 20:08:16 +05:00
Eugenio Lacuesta b18560315b
Add tests 2022-10-30 18:28:16 -03:00
Eugenio Lacuesta 3259a42525
CrawlSpider: pass cb_kwargs from process_request 2022-10-30 13:17:37 -03:00
Andrey Rahmatullin 9077d0f9b4
Merge pull request #5698 from pankali/patch-1 
Update Code of Conduct to Contributor Covenant v2.1
 2022-10-28 12:51:38 +05:00
Andrey Rahmatullin 76c2cb070e
Merge pull request #5697 from iamkaushal/#5686_fix 
added typing.io and typing.re in pytest warning filter to ignore
 2022-10-28 11:38:55 +05:00
എതിരാളിക്കൊരു പോരാളി 9f45be439d
Update Code of Conduct to Contributor Covenant v2.1 2022-10-28 02:13:37 +02:00
iamkaushal bd9e482c2f added typing.io and typing.re in pytest warning filter to ignore 2022-10-27 23:21:55 +05:30
Magnus Offermanns fd692f3091
Prevent running the -O and -t command-line options together (#5605) 
Co-authored-by: Andrey Rakhmatullin <wrar@wrar.name>
 2022-10-27 14:43:31 +02:00
Andrey Rakhmatullin b71d0292d5 Add a test for processing partial callbacks. 2022-10-27 18:13:47 +06:00
Godson 3a34fa8399
Get the event loop from event_loop_policy to avoid a deprecation warning (#5689) 2022-10-27 14:02:12 +02:00
Andrey Rahmatullin b654183084
Use Python 3.11 as the default in CI (#5696) 2022-10-27 14:00:36 +02:00
Andrey Rakhmatullin ca50af6453 Remove an unused import. 2022-10-27 17:12:26 +06:00
Andrey Rahmatullin 5780ccba55
Merge branch 'master' into deprecate-NoimagesDrop 2022-10-27 15:46:32 +05:00
Mikhail Korobov 9fbd819b0e
Merge pull request #5695 from jidicula/patch-2 
ci: Update macos runner
 2022-10-27 12:45:43 +05:00
Andrey Rahmatullin c20b76d98f
Merge branch 'master' into patch-1 2022-10-27 12:04:00 +05:00
Johanan Idicula a214147359
ci: Update macos runner 
The GitHub Actions macos-10.15 runner image is now deprecated, and GitHub
Actions has begun to temporarily fail jobs referencing it during brownout
periods. The image will be fully unsupported by 2022-12-01, which is just about
a month away.

This change updates the macOS runner image to the latest generally-available
version, to help reduce spurious CI failures during the brownout periods, and to
stay abreast of the sunsetting of the macos-10.15 image.

See also: actions/runner-images#5583
 2022-10-26 21:44:47 -04:00
Andrei Andrukhovich b394f2165a
Fix typo: [they] depends → depend (#5694) 2022-10-26 22:11:28 +02:00
Laerte Pereira 2464939b7e
Fixed deprecation warning in scrapy.core.engine (#5589) 
* Change `download` function logic

* Fix CI error in 3.7 checks

* Make `spider` parameter optional in `_download` function, assign spider value from self if `None`
 2022-10-26 23:58:20 +05:00
Mikhail Korobov a1075b8979
Merge pull request #5626 from Gallaecio/more-lenient-proxying 
Relax Proxy-Authorization restrictions
 2022-10-26 23:36:29 +05:00
Adrián Chaves 46dd152b3e Merge remote-tracking branch 'upstream/master' into more-lenient-proxying 2022-10-26 16:55:04 +02:00
Andrey Rahmatullin 92be5ba257
Merge pull request #5691 from Godson-Gnanaraj/5323-fix-unable-to-parse-decorated-method 
Replace indentation of source before parsing with ast.
 2022-10-26 12:47:08 +05:00
Godson-Gnanaraj b0ddffc47b Misc. changes: 
- compile regex
  - readability improvements
 2022-10-26 06:53:43 +05:30
Godson-Gnanaraj 830e1c5dd8 Add test for parsing decorated methods 2022-10-26 01:26:54 +05:30
Kaushal Sharma f4e2a10ed6
Image.ANTIALIAS → Image.Resampling.LANCZOS (#5692) 2022-10-25 11:45:46 +02:00
Godson-Gnanaraj b61b71c6f0 Replace indentation of source before parsing with ast. 
closes #5323
 2022-10-25 08:54:16 +05:30
Matthew Donoughe 726680c712
change crawler_process to optional 2022-10-21 20:32:13 -04:00
Matthew Donoughe 28396c3497
convert _get_request_path back to str 2022-10-21 20:23:07 -04:00
Matthew Donoughe 69d1b8fc08
dirname cannot be falsey 2022-10-21 20:21:08 -04:00
Andrey Rahmatullin b33244e2f0
Fix the flake8 per-file ignore syntax (#5688) 2022-10-21 16:17:04 +02:00
Matthew Donoughe 607eece72a
move to after check 2022-10-20 20:18:06 -04:00
Matthew Donoughe 12a26755ae
improve render_templatefile 2022-10-20 20:14:43 -04:00
Matthew Donoughe 24d6ac1f52
downgrade the last 3.9 type hints 2022-10-20 20:03:38 -04:00
Matthew Donoughe c85de90819
fix path to tox.ini 2022-10-20 19:44:35 -04:00
Matthew Donoughe 065db7b566
fix some mypy issues 2022-10-19 08:28:26 -04:00
Matthew Donoughe 93d82648e5
resolve this path too 2022-10-19 08:08:21 -04:00
Matthew Donoughe fb26e6b650
resolve path to search in error 2022-10-18 20:21:11 -04:00
Matthew Donoughe 7daf735f45
downgrade type hint syntax 2022-10-18 20:07:29 -04:00
Mikhail Korobov 82f25bc44a
Merge pull request #5681 from mattkohl-flex/master 
Documentation: typo fixes
 2022-10-18 15:27:52 +05:00
Matthew Donoughe 40d9ca3bdd
use pathlib 2022-10-17 17:40:10 -04:00
Andrey Rakhmatullin 20b79a0f2e Bump version: 2.6.2 → 2.7.0 2022-10-17 19:09:22 +06:00