RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
10,931 Commits 49 Branches 132 Tags 130 MiB
Commit Graph

83 Commits

Author SHA1 Message Date
Andrey Rakhmatullin 393d715205
Drop PyPy 3.10 support, restore coverage for subprocesses (#7050) 2025-09-15 11:24:09 +02:00
Andrey Rakhmatullin 4899d416e7
Add PyPy 3.11 to CI. (#6697) 2025-05-06 12:31:28 +02:00
Suejung Shin e50914e0f5
Codecov: Add test analytics (#6741) 2025-03-21 12:28:47 +01:00
Andrey Rakhmatullin d0dabbc097
Enable AsyncioSelectorReactor by default. (#6713) 
* Enable AsyncioSelectorReactor by default.

* Improve get_crawler(), switch more tests to it.

* Fix the remaining default-reactor test failures.

* Address documentation feedback.

* Make pinned envs more consistent.
 2025-03-12 01:18:30 +05:00
Adrián Chaves 26ecc93228
Run CI only on the main branch, on release branches and on PRs (#6720) 2025-03-11 14:12:11 +01:00
Adrián Chaves bee74fb753 Remove trailing whitespace 2025-03-11 11:56:44 +01:00
Andrey Rakhmatullin d4b152bbf6
Drop PyPy 3.9, add a pypy3-extra-deps CI job. (#6613) 2025-01-23 09:22:18 +01:00
Andrey Rakhmatullin 5d3aa80ad1
Switch CI to codecov/codecov-action and enable it on Windows. (#6609) 2025-01-07 10:52:26 +01:00
Andrey Rakhmatullin 4869315d10
Install libjpeg-dev on pinned envs to be able to install Pillow. (#6607) 2025-01-07 10:46:12 +01:00
Andrey Rakhmatullin 4a0c05749c Bump tool versions. 2024-12-29 14:29:27 +05:00
Daniel Graña dc4d6d16ea Verified PyPI releases (a.k.a. PEP740) 2024-11-15 00:09:00 -03:00
Andrey Rakhmatullin 845b1ffd44 Merge remote-tracking branch 'origin/master' into py313 2024-10-16 14:50:12 +05:00
Vsevolod Breus 5391663072
Drop Python 3.8 Support (#6472) 2024-10-16 10:03:16 +02:00
Klaus Rettinghaus 5ef5474172
update gh-action-pypi-publish 2024-10-09 20:38:50 +02:00
Andrey Rakhmatullin 29bb869284 Remove the beta block. 2024-10-08 15:43:17 +05:00
Andrey Rakhmatullin df6c51af0f Use the 3.13 release. 2024-10-08 15:37:49 +05:00
Andrey Rakhmatullin 1e68d3c0bf Merge branch 'master' into py313 2024-08-11 13:46:51 +05:00
Andrey Rakhmatullin 435686830c Bump the Python version for RTD. 2024-07-11 12:25:13 +05:00
Andrey Rakhmatullin 129dbfa0bf Bump tool versions. 2024-07-11 12:23:43 +05:00
Andrey Rakhmatullin 5755e224d5 Help with building lxml on 3.13beta1 for checks too. 2024-05-28 14:50:09 +05:00
Andrey Rakhmatullin 986d1ee1dd
Move CI from the decommissioned macos-11 to macos-latest. (#6372) 2024-05-28 10:37:19 +02:00
Andrey Rakhmatullin b6d3d9076f Help with building lxml on 3.13beta1. 2024-05-22 13:20:48 +05:00
Andrey Rakhmatullin 534a66e954 Bump 3.13 to beta1. 2024-05-22 13:16:00 +05:00
Andrey Rakhmatullin 85d7458651 Merge branch 'master' into py313 2024-05-22 13:14:59 +05:00
Andrey Rakhmatullin 93f0628530
Improve typing for Spider.parse(). (#6274) 2024-05-13 11:55:45 +02:00
Adrián Chaves c66b517706 Add Python 3.13 alpha to CI 2023-12-01 10:36:27 +01:00
Andrey Rakhmatullin 991121fa91
Re-enable uvloop tests on 3.12 (#6098) 2023-10-17 19:24:44 +02:00
Andrey Rakhmatullin c65567988d
Change supported PyPy versions to 3.9 and 3.10. (#6087) 
* Change support PyPy versions to 3.9 and 3.10.

* Update the RTD URL for coverage.

* Move pypy3-pinned back to pypy3.8.
 2023-10-06 11:27:02 +02:00
Andrey Rakhmatullin 5b0b00212e
Merge pull request #6083 from wRAR/py3.12-release 
Adapt to the Python 3.12 final release
 2023-10-03 20:20:12 +04:00
Klaus Rettinghaus 9ae8d97d81
Update GitHub Actions checkout action to version 4 (#6084) 2023-10-03 13:04:18 +02:00
Andrey Rakhmatullin 60d5f391c4 Use the 3.12 release, enable it for all OSes. 2023-10-02 21:35:45 +04:00
Andrew Armbruster 884840e3a3 Use concurrency groups to limit duplicate jobs 
Leverage concurrency groups along with cancel-in-progress to favor running the most recent job.

Concurrency groups are on a per workflow, per branch/tag basis. So, pushing newer updates to a branch, e.g. as part of a PR, should cancel any in progress runs of workflows that have been retriggered.

See:
- https://docs.github.com/en/enterprise-cloud@latest/actions/using-workflows/workflow-syntax-for-github-actions#concurrency
- https://docs.github.com/en/enterprise-cloud@latest/actions/learn-github-actions/contexts#github-context
 2023-10-01 12:12:24 +02:00
Andrey Rakhmatullin da39fbd270
Update tool versions (#6046) 2023-09-12 20:07:10 +02:00
Laerte Pereira b06936f111 Handle Tuple type on getdictorlist method, bump 3.12 python version 2023-08-14 10:33:48 -03:00
Laerte Pereira 8a0a9e6d3e
Enable Python 3.11 on Windows CI 2023-08-03 18:31:12 -03:00
Andrey Rakhmatullin 21b6dc5f9f Add 3.12 CI jobs. 2023-07-22 17:55:32 +04:00
Andrey Rakhmatullin 2122278d4b Drop Python 3.7 support. 2023-06-18 18:37:50 +04:00
Adrián Chaves 590955fac8 Provide separate test environments for botocore and boto3 extras; add extra-deps-pinned and remote extras from pinned 2023-03-15 16:03:44 +01:00
Andrey Rakhmatullin 824641e349 Merge remote-tracking branch 'origin/master' into mypy-imports 2023-02-11 22:02:19 +04:00
Mikhail Korobov a08d722ae8
Merge pull request #5802 from Laerte/chore/deprecate-set-output 
Simplify Publish workflow
 2023-02-02 19:59:57 +05:00
Laerte Pereira 4a424adfff
fix: action version 2023-02-02 09:21:53 -03:00
Laerte Pereira 12559ed21e
refactor: Publish workflow 2023-02-02 08:59:35 -03:00
Adrián Chaves 17354a61b1 Avoid duplicities in CI; remove pylint from pre-commit 2023-01-30 10:04:27 +01:00
Jalil SA 4bd48d2613 added pre-commit action 2023-01-27 15:06:54 -06:00
Andrey Rakhmatullin 5fa0f64db5 Ru typing on 3.8 as types-lxml isn't available for 3.7. 2023-01-27 23:29:23 +04:00
Laerte Pereira 0cfe81d1d3
`set-output` command is deprecated 2023-01-21 16:57:31 -03:00
Emmanuel Rondan 8ee4817471 reaplying black, fixing conflicts and ignoring bandit checks on test directory 2023-01-20 10:55:46 -03:00
Adrián Chaves 016d1de64e Remove Reppy from CI 2023-01-02 14:13:04 +01:00
Adrián Chaves c4d7f5e7a9 Use CLang to build Reppy 2023-01-02 13:41:08 +01:00
Laerte Pereira deaf1fb6cf
Stop using setup.py (#5776) 2022-12-31 20:11:45 +01:00