bfc753dbee
Integrate Delta into all tox environments and clean up workflow
...
- Replace all bare pytest invocations with delta run -- in tox.ini:
[min], [testenv:pypy3], [testenv:min-pypy3], [testenv:botocore],
[testenv:min-botocore], [testenv:mitmproxy]
- Add deltatest-cli to [min] and [testenv:min-pypy3] deps
- Add passenv DELTA_* GITHUB_* to [min] and [testenv:min-pypy3]
- Add Configure Delta Cloud step to tests job in tests-ubuntu.yml
(writes ~/.delta/config.toml from secrets before tox runs)
- Remove standalone delta pre-check job; delta now runs inline
in every matrix runner via tox
2026-06-17 10:29:07 +03:00
3bce77074b
Configure DELTA_BRANCH env var as master for test runners
2026-06-17 03:32:12 +03:00
0dfff7301d
Pass DELTA_API_KEY and DELTA_REPO_ID to tox test runners
2026-06-17 03:26:48 +03:00
161d4ef918
feat: introduce delta testing mechanism with benchmark reporting and workflow updates
2026-06-17 01:28:17 +03:00
c70798b1fc
fix: update CI configuration to use echo for TOML generation and initialize Delta testing environment
2026-06-17 01:23:05 +03:00
aa54907a14
feat: implement delta-test benchmarking and test skipping infrastructure
2026-06-17 01:18:08 +03:00
16587d9abf
feat: add delta benchmark script and CI integration for testing efficiency monitoring
2026-06-17 01:12:55 +03:00
3cc4cda13f
feat: implement delta-based test selection and benchmarking workflow
2026-06-16 20:48:06 +03:00
38cbf73cb5
feat: add benchmark script and automated workflow for delta test coverage evaluation
2026-06-16 20:40:18 +03:00
852c692d20
Refactor DeltaTest workflow to conditionally install dependencies and use secrets for sensitive data
2026-06-16 20:29:47 +03:00
2e2975eba1
Update DeltaTest workflow to install dependencies from docs/requirements.txt
2026-06-16 20:22:40 +03:00
c0e9ec76cd
Merge branch 'master' of https://github.com/deltatest-org/scrapy
2026-06-16 10:41:26 +03:00
906e9ee3df
adding deltatest
2026-06-16 10:33:04 +03:00
5d07a95656
Create deltatest.yaml
2026-06-14 21:09:55 +03:00
0d8bbe9ca3
Create deltatest.properties.json
2026-06-14 21:09:20 +03:00
2d0a898e2d
tox.ini: pinned, typing → min, mypy ( #7595 )
2026-06-11 12:10:48 +05:00
2798c03bb0
Add Python 3.14 to CI. ( #6604 )
...
* Add Python 3.14 (alpha3) to CI.
* Disable mitmproxy on 3.14 for now.
* 3.14.0-alpha.4.
* 3.14.0-alpha.5
* 3.14.0-beta2.
* 3.14 release.
* Fix test_non_pickable_object.
* Fix handling of file:/path feed URIs.
* Better mocking of streams for TextTestResult.
* Do not use .php in test_file_path() as it's now a known extension.
* Fix the URL in TestFeedExporterSignals.
* Fix typing.
* Bump more envs to 3.14.
* Silence pylint.
* Fix another test for .php handling change.
* Remove test_install_asyncio_reactor.
* More bumps to 3.14.
* Revert docs-tests to use 3.13.
* Debug options for Windows.
* Re-enable xdist.
* Revert Windows PYTEST_ADDOPTS.
* Silence loop policy deprecation warnings.
* Restore a lost pylint suppression.
* Update asyncio_enabled_reactor_same_loop.py to new Twisted.
* Fix RobotFileParser tests for Python 3.14.5.
2026-05-12 23:49:37 +05:00
f8d103a65a
Add llms.txt and llms-full.txt generation ( #7380 )
2026-04-06 10:24:21 +02:00
74c33e5172
Use the spam label when auto-closing PRs
2026-03-30 17:43:59 +02:00
6cef717dad
Add a template for PRs ( #7381 )
2026-03-30 17:33:21 +02:00
a8e99aeb2e
Fix botocore-pinned and pypy3-* ( #7363 )
2026-03-26 08:21:58 +01:00
6fe27ba33e
Add more no-reactor tests ( #7259 )
...
* Generic changes and scrapy bench.
* scrapy check.
* scrapy crawl.
* scrapy fetch.
* scrapy parse.
* scrapy runspider.
* scrapy shell.
* Skip httpx tests on default-reactor.
* Review requires_reactor marks.
* Make test functions that require an event loop async def.
* Improve test_pending_asyncio_tasks().
* Add Mac OS DNS error.
* Refactor most of test_scheduler.py.
* Finish refactoring DownloaderAwareSchedulerTestMixin.
* Refactor test_engine_loop.py.
* Add the no-reactor-extra-deps tox env, run no-reactor on macos.
* Skip unhandled CancelledError when shutting down the engine.
* Fix typing and pre-commit checks.
* Fix typing problems in master.
---------
Co-authored-by: Adrian <adrian@zyte.com>
2026-03-24 15:29:22 +05:00
6e0a0e476a
Fix running tests with -n auto, enable it on CI ( #7257 )
...
* Make test_start_deprecated_super() more robust.
* Work around the FTPFilesStore.FTP_* initialization.
* Enable xdist on CI.
* Add PYTEST_ADDOPTS to tox passenv.
2026-02-13 22:12:57 +05:00
3186ccf5d5
Reactorless tests 1: the test env ( #6952 )
...
* Reactorless tests.
* Updates after merging master.
* Update a new import.
* Updates after merging master.
* Update testenv:no-reactor-pinned.
* Foundations for the reactorless mode.
* Fixes after merging master.
* Updates after merging reactorless-base.
* Add simple subprocess tests for reactorless AsyncCrawler*.
* More reactorless tests.
* Refactor AsyncCrawlerProcess.start().
* More checks.
* Fix test_reactorless_import_hook.
* More tests.
* Call install_reactor() before asyncio.run().
* Cleanup.
* Rephrase.
* Fix a test.
* Fixes.
* Rephrasing.
* Set TELNETCONSOLE_ENABLED=False in the reactorless mode.
* Fix a new import.
* Clarify --reactor marks.
* Cleanup.
* More docs/comments.
* Update test_fallback_workflow().
* Update TestDeferredFFromCoroF.
* Typing improvements.
2026-02-02 19:25:30 +05:00
49930dfec5
chore: Update outdated GitHub Actions versions ( #7223 )
2026-01-23 12:26:58 +01:00
e30ba7d4ca
( #7180 ) Update codecov test results action to v5 on all CI workflows. ( #7215 )
2026-01-12 08:31:53 +01:00
14737e91ed
Mitigate brotli and deflate decompression bombs DoS ( #7134 )
...
Co-authored-by: Eugenio Lacuesta <eugenio.lacuesta@gmail.com>
Co-authored-by: Andrey Rakhmatullin <wrar@wrar.name>
2025-11-17 14:21:50 +05:00
804ae167df
Update tool versions ( #7127 )
2025-10-27 14:11:31 +01:00
d414d393d4
Remove Python 3.9 support ( #7121 )
2025-10-27 12:37:49 +01:00
393d715205
Drop PyPy 3.10 support, restore coverage for subprocesses ( #7050 )
2025-09-15 11:24:09 +02:00
4899d416e7
Add PyPy 3.11 to CI. ( #6697 )
2025-05-06 12:31:28 +02:00
e50914e0f5
Codecov: Add test analytics ( #6741 )
2025-03-21 12:28:47 +01:00
d0dabbc097
Enable AsyncioSelectorReactor by default. ( #6713 )
...
* Enable AsyncioSelectorReactor by default.
* Improve get_crawler(), switch more tests to it.
* Fix the remaining default-reactor test failures.
* Address documentation feedback.
* Make pinned envs more consistent.
2025-03-12 01:18:30 +05:00
26ecc93228
Run CI only on the main branch, on release branches and on PRs ( #6720 )
2025-03-11 14:12:11 +01:00
bee74fb753
Remove trailing whitespace
2025-03-11 11:56:44 +01:00
d4b152bbf6
Drop PyPy 3.9, add a pypy3-extra-deps CI job. ( #6613 )
2025-01-23 09:22:18 +01:00
5d3aa80ad1
Switch CI to codecov/codecov-action and enable it on Windows. ( #6609 )
2025-01-07 10:52:26 +01:00
4869315d10
Install libjpeg-dev on pinned envs to be able to install Pillow. ( #6607 )
2025-01-07 10:46:12 +01:00
4a0c05749c
Bump tool versions.
2024-12-29 14:29:27 +05:00
dc4d6d16ea
Verified PyPI releases (a.k.a. PEP740)
2024-11-15 00:09:00 -03:00
845b1ffd44
Merge remote-tracking branch 'origin/master' into py313
2024-10-16 14:50:12 +05:00
5391663072
Drop Python 3.8 Support ( #6472 )
2024-10-16 10:03:16 +02:00
5ef5474172
update gh-action-pypi-publish
2024-10-09 20:38:50 +02:00
29bb869284
Remove the beta block.
2024-10-08 15:43:17 +05:00
df6c51af0f
Use the 3.13 release.
2024-10-08 15:37:49 +05:00
1e68d3c0bf
Merge branch 'master' into py313
2024-08-11 13:46:51 +05:00
435686830c
Bump the Python version for RTD.
2024-07-11 12:25:13 +05:00
129dbfa0bf
Bump tool versions.
2024-07-11 12:23:43 +05:00
5755e224d5
Help with building lxml on 3.13beta1 for checks too.
2024-05-28 14:50:09 +05:00
986d1ee1dd
Move CI from the decommissioned macos-11 to macos-latest. ( #6372 )
2024-05-28 10:37:19 +02:00
aliowka
deltatest.dev
Adrian
Andrey Rakhmatullin
Pádraic Slattery
Santiago Beltrán Ruiz
Rui Xi
Suejung Shin
Adrián Chaves
Daniel Graña
Vsevolod Breus
Klaus Rettinghaus