Versioningpgaibench(1) / versioning | Version | pgaibench-core 0.1.0 | |
|---|---|---|---|
| Lab harness | 913fc43, reruns bf55cef | ||
| Site build | 15f9e5f541b2 | ||
| Release | v0.1.0 (2026-11-11) | ||
| Updated | 2026-11-12T00:04:11Z UTC | ||
| Lab cells | 263 of 264 finished | ||
Scenario set: pgaibench-core MAJOR.MINOR.PATCH
- PATCH: text or check fixes that do not change any gated outcome.
- MINOR: scenarios added or retired.
- MAJOR: outcome definitions or scoring change.
Every result row names the set version. We never put rows from different MINOR versions in one table.
Harness
The harness uses semver git tags, and every result row names the harness commit. A MAJOR harness change starts a new table: rows from different harness majors are never put in one table.
Held-out set
The held-out set has its own version line. It is never published. Each release publishes a hash of the held-out set, so that later changes to it are visible.
Releases
Each release has one git tag that pins the scenario set, the harness and this site together. The current state is pgaibench-core 0.1.0, before the first release.