Skip to content

Feat: add results benchmark suite#72

Draft
rian-be wants to merge 1 commit into
mainfrom
develop
Draft

Feat: add results benchmark suite#72
rian-be wants to merge 1 commit into
mainfrom
develop

Conversation

@rian-be

@rian-be rian-be commented Jul 3, 2026

Copy link
Copy Markdown
Contributor

Summary

This PR expands benchmark coverage for ModularityKit.Mutator by adding the results materialization benchmark suite, then hardens the docs publishing workflow with a retry for GitHub Pages deployment.

Highlights

Results benchmarks

  • Add dedicated results benchmarks under Benchmarks/Results.
  • Measure MutationResult creation with no side effects, single side effect, and multiple side effects.
  • Measure history and audit output materialization from executed mutation results.
  • Keep result benchmark helpers local to the benchmark project.

Docs publishing workflow

  • Allow the current Node runtime behavior for Pages actions.
  • Retry actions/deploy-pages@v4 once when the first deployment status check fails.
  • Keep the docs build step unchanged while making deployment less brittle.

Why

Issue #60 asks for benchmark visibility into result-building costs, side effect materialization, and history or audit output materialization.

The docs workflow update addresses a transient GitHub Pages deployment failure where the docs build succeeded but the deployment status check failed.

Checks

  • dotnet build Benchmarks/ModularityKit.Mutator.Benchmarks.csproj -c Release
  • Local BenchmarkDotNet runs for MutationResultCreationBenchmarks and MutationOutputMaterializationBenchmarks
  • Verified the docs build job in GitHub Actions completed successfully and isolated the failure to the deployment step

Closes

@github-actions github-actions Bot added performance Performance improvements or regressions ci CI/CD and repository automation changes benchmark Benchmark coverage and performance measurement changes labels Jul 3, 2026
@rian-be rian-be changed the title [codex] benchmarks: add results suite and docs deploy retry benchmarks: add results suite and docs deploy retry Jul 3, 2026
@rian-be rian-be changed the title benchmarks: add results suite and docs deploy retry Feat: add results benchmark suite Jul 3, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

benchmark Benchmark coverage and performance measurement changes ci CI/CD and repository automation changes performance Performance improvements or regressions

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Benchmark]: Measure side effect and result materialization [Task]: Expand core benchmark coverage

1 participant