RomanNum3ral
/
scrapy
mirror of https://github.com/scrapy/scrapy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
10,710 Commits 49 Branches 132 Tags 141 MiB
Commit Graph

10710 Commits

Author SHA1 Message Date
Andrey Rakhmatullin 2cb1e10c76 Make shutdown tests more robust. 2023-10-17 23:56:54 +04:00
Andrey Rakhmatullin 991121fa91
Re-enable uvloop tests on 3.12 (#6098) 2023-10-17 19:24:44 +02:00
Andrey Rakhmatullin 5807970a22
Add typing hints to CaselessDict and Headers. (#6097) 2023-10-17 19:07:13 +02:00
Sandesh Pyakurel 064256b059
Typo fixed in news.rst file (#6094) 2023-10-17 18:39:39 +02:00
Andrey Rakhmatullin aa95ada42c
Merge pull request #6064 from wRAR/signals-proper 
Refactor installing signals.
 2023-10-17 17:08:23 +04:00
Andrey Rakhmatullin 029a56384d Increase the timeout. 2023-10-09 00:16:41 +04:00
Andrey Rakhmatullin 9910ccf3ae Merge remote-tracking branch 'origin/master' into signals-proper 2023-10-08 23:02:11 +04:00
Andrey Rakhmatullin 2f436c05e0 Use SIGBREAK in Windows tests. 2023-10-08 22:55:05 +04:00
Andrey Rakhmatullin c65567988d
Change supported PyPy versions to 3.9 and 3.10. (#6087) 
* Change support PyPy versions to 3.9 and 3.10.

* Update the RTD URL for coverage.

* Move pypy3-pinned back to pypy3.8.
 2023-10-06 11:27:02 +02:00
Andrey Rakhmatullin 5b0b00212e
Merge pull request #6083 from wRAR/py3.12-release 
Adapt to the Python 3.12 final release
 2023-10-03 20:20:12 +04:00
Andrey Rakhmatullin a338873e3a Re-enable bpython on Python 3.12. 2023-10-03 16:50:52 +04:00
Andrey Rakhmatullin fb4debda04 Use path_to_file_uri to fix the test on Windows. 2023-10-03 16:47:03 +04:00
Klaus Rettinghaus 9ae8d97d81
Update GitHub Actions checkout action to version 4 (#6084) 2023-10-03 13:04:18 +02:00
Andrey Rakhmatullin 60d5f391c4 Use the 3.12 release, enable it for all OSes. 2023-10-02 21:35:45 +04:00
Andrey Rakhmatullin 1ed9ed4f92 Require pyftpdlib that supports Python 3.12. 2023-10-02 21:33:02 +04:00
Andrey Rakhmatullin a96989c6f3
Merge pull request #6077 from 11-aryan/11-aryan 2023-10-02 20:40:25 +04:00
Andrey Rakhmatullin 01f164d331
Merge pull request #6078 from AndrewADev/ci-concurrency-groups 2023-10-02 20:38:49 +04:00
Adrián Chaves 42adbb2104
Update docs/topics/request-response.rst 2023-10-02 14:43:30 +02:00
kokobhara 8dc72dfc4d Cover PythonItemExporter backwaird-incompatible changes in 2.11 (#6081) 2023-10-02 14:48:44 +04:00
kokobhara ef1ed4fab7
Cover PythonItemExporter backwaird-incompatible changes in 2.11 (#6081) 2023-10-02 12:14:05 +02:00
Aryan e146c3a2fc removed the entire example for dont_merge_cookies 2023-10-02 15:36:29 +05:30
Andrew Armbruster 884840e3a3 Use concurrency groups to limit duplicate jobs 
Leverage concurrency groups along with cancel-in-progress to favor running the most recent job.

Concurrency groups are on a per workflow, per branch/tag basis. So, pushing newer updates to a branch, e.g. as part of a PR, should cancel any in progress runs of workflows that have been retriggered.

See:
- https://docs.github.com/en/enterprise-cloud@latest/actions/using-workflows/workflow-syntax-for-github-actions#concurrency
- https://docs.github.com/en/enterprise-cloud@latest/actions/learn-github-actions/contexts#github-context
 2023-10-01 12:12:24 +02:00
Aryan fe5ef0a80a Fixed the dont_merge_cookies example in docs 2023-10-01 11:47:51 +05:30
Andrey Rakhmatullin 0e64dec5dd
Merge pull request #6074 from mikkeschiren/master 
Add more common MS Office file extensions to exclude for documents
 2023-09-29 16:28:19 +04:00
Mikael Schirén da6e75d00a
Added more common MS Office file extensions 2023-09-29 09:44:04 +02:00
Mikael Schirén 83fff6c951
Add dotx to exclude for documents 2023-09-28 23:50:14 +02:00
Andrey Rakhmatullin 4abc54f0ec
Merge pull request #6066 from Gallaecio/questions 
Add a template for question/help issues
 2023-09-25 19:13:56 +04:00
Adrián Chaves 4c98d6068a Add a template for question/help issues 2023-09-25 10:18:35 +02:00
Andrey Rakhmatullin eb5e2e79ba Use SIGINT instead of SIGTERM to support Windows. 2023-09-24 23:31:46 +04:00
Andrey Rakhmatullin 4b5fb9b5a6 Add a test for SIGTERM handling. 2023-09-24 22:52:17 +04:00
Andrey Rakhmatullin d19e315b0b Add an interactive test for `scrapy shell`. 2023-09-24 21:51:19 +04:00
Andrey Rakhmatullin 0630e4aaa1 Fix `scrapy shell`. 2023-09-24 19:36:29 +04:00
Andrey Rakhmatullin 0c6440a427 Fix additional typing errors with new Twisted. 2023-09-24 19:25:59 +04:00
Yash nagarkar 197781e3af Cover the removal of is_botocore on the release notes (#6061) 2023-09-24 18:32:35 +04:00
Andrey Rakhmatullin 4b14215f83 Remove the Twisted version restriction. 2023-09-24 18:17:43 +04:00
Andrey Rakhmatullin 720f351a3e Refactor installing signals. 2023-09-24 18:12:52 +04:00
Yash nagarkar 908da8ba82
Cover the removal of is_botocore on the release notes (#6061) 2023-09-22 10:12:20 +02:00
Andrey Rakhmatullin 9bfe0def59
Merge pull request #6059 from Gallaecio/typing 
Add py.typed
 2023-09-21 17:30:04 +04:00
Adrián Chaves 11bdc3df59 Revert "Add package_data={"scrapy": "py.typed"} to setup.py" 
This reverts commit e84fb6d5cb.
 2023-09-21 13:40:40 +02:00
Adrián Chaves e84fb6d5cb Add package_data={"scrapy": "py.typed"} to setup.py 2023-09-21 13:39:39 +02:00
Adrián Chaves d5cc469ca9 Add py.typed 2023-09-21 13:06:12 +02:00
Andrey Rakhmatullin f2fb4760d2 Bump version: 2.10.1 → 2.11.0 2023-09-18 15:24:28 +04:00
Andrey Rakhmatullin efc594b53f
Merge pull request #6048 from wRAR/relnotes-2.11 
Release notes for 2.11.0
 2023-09-18 15:15:52 +04:00
Andrey Rakhmatullin 528911da85 Fix/reword the release notes. 2023-09-18 14:35:28 +04:00
Andrey Rakhmatullin 2fa768399a Replace the VERSION vars. 2023-09-15 19:19:42 +04:00
Andrey Rakhmatullin c2346b4a95 Update the release notes up to current master. 2023-09-15 19:15:05 +04:00
Andrey Rakhmatullin 3f34a5b151
Merge pull request #6050 from wRAR/retrymw-fix 
Improve the backwards compatibility for RetryMiddleware.EXCEPTIONS_TO_RETRY
 2023-09-15 17:51:04 +04:00
Andrey Rakhmatullin 800c1f112e Remove the constant. 2023-09-15 13:13:06 +04:00
Andrey Rakhmatullin 14c27d2215 Merge branch 'master' into relnotes-2.11 2023-09-14 16:38:15 +04:00
Andrey Rakhmatullin 922ff57384 Improve the backwards compatibility for RetryMiddleware.EXCEPTIONS_TO_RETRY. 2023-09-14 15:51:00 +04:00