2.2 KiB

Raw Blame History

Autoresearch: CI total execution time

Objective

Reduce GitHub Actions CI wall-clock completion time for pull requests without weakening coverage or hiding failures.

Metrics

Primary: ci_total_s (s, lower is better) — modeled PR workflow critical path from current .github/workflows/ci.yml plus recent successful CI job timings.
Secondary: build_assets_s, tests_s, browser_matrix_s, linter_s, static_analysis_s, performance_tests_s, job_count — tradeoff and bottleneck monitors.

How to Run

./autoresearch.sh — validates workflow structure, samples recent successful CI pull_request runs through gh, and outputs METRIC name=value lines.

Files in Scope

.github/workflows/ci.yml — CI graph, job dependencies, sharding, commands.
.github/actions/setup-php-deps/action.yml — PHP/composer setup cache behavior.
.github/actions/setup-bun-deps/action.yml — Bun/node setup cache behavior.
phpunit.xml, tests/Pest.php — test suite partitioning only when coverage remains equivalent.
package.json, composer.json — CI scripts only, no dependency changes without approval.

Off Limits

No deleting or skipping real checks to win time.
No weakening assertions, lowering static-analysis level, or excluding tests unless moved to an equivalent job.
No production secrets or .env reads.
No dependency changes without explicit approval.

Constraints

Small experiments.
Keep improvements only when primary metric improves.
Preserve CI correctness and failure visibility.
Prefer workflow graph/cache improvements before test-suite rewrites.

What's Been Tried

Baseline: modeled PR CI critical path 406.50s. Browser path dominated: build-assets 65.5s + browser matrix 339s + aggregate.
Kept: manual Browser class filters over 5 shards. Modeled 355.76s. Same Browser classes covered exactly once.
Kept: skip separate build-assets job on PR and build assets inside Browser shards. Modeled 326.84s. Removes build-assets gate from PR critical path.
Kept: rebalance Browser filters over 6 shards. Modeled 293.24s.
Kept: run Browser filter shards with Pest --parallel --processes=3. Modeled 234.27s.
Discarded: 4 Browser processes. No modeled improvement over 3; individual slow tests dominate.

2.2 KiB Raw Blame History