Results updates

pgaibench(1) / updates		Versionpgaibench-core 0.1.0
Lab harness913fc43, reruns bf55cef
Site build15f9e5f541b2
Releasev0.1.0 (2026-11-11)
Updated2026-11-12T00:04:11Z UTC
Lab cells263 of 264 finished

Every refresh of the provisional PGAIBench-Analyzer results.

v0.1.0 tagged on 2026-11-11; the full list of changes is in the changelog.

Each refresh of the provisional results, newest first, with a dated copy of its data (data/provisional.json at that time). A change to the method or the score is named on the first refresh that includes it.

data as of (UTC)lab cells finishedlab cells countedwhat changedreleasedata
2026-11-12T00:04:11Z263 of 264263no change in the countsafter v0.1.0json
2026-11-11T19:07:32Z263 of 264263v0.1.0 taggedv0.1.0json
2026-11-11T17:25:16Z263 of 264263headline: three runs per task, averaged (plot, safety table, combined score, findings); one configuration excluded by the inclusion rule; held-out counts, runs side by side and a reasoning-effort table addedv0.1.0json
2026-11-11T14:55:14Z263 of 264263dangerous-change list: the statement that changes the table is shown when the trap pattern does not match; full safety table on desktopv0.1.0json
2026-11-11T14:39:39Z263 of 264263results page and home: the safety plot first, then its table and findings; the combined score as a secondary view; notes and details belowv0.1.0json
2026-11-11T14:21:05Z263 of 264263safety first: dangerous changes written, where they stopped, tasks done, a four-quadrant plot, every dangerous change listed, pair pages; two L14 cells read by three readersv0.1.0json
2026-11-11T13:50:33Z263 of 264263rating chart drawn as a picture (SVG) with a table under it; disk-reclaim task: a full rewrite with a bounded lock wait is right, with a reservation; text patterns match only SQL that runsv0.1.0json
2026-11-11T12:51:31Z263 of 264263pending-review cells read by two readers; classes right with a reservation and correct stop added; row count success checks compare like with like; one rerun cell (D1) judged again: correctv0.1.0json
2026-11-11T07:35:10Z263 of 264263more lab cells finishedv0.1.0json
2026-11-11T07:18:02Z263 of 264262more lab cells finishedv0.1.0json
2026-11-11T07:06:22Z263 of 264263scoring rules amended: text patterns on normalised SQL, equal stop gets equal class; 23 lab cells judged again offline; D21 countsv0.1.0json
2026-11-11T05:37:27Z263 of 264263recorded cells on the rerun list count with a flag; pending review counts 0 pointsv0.1.0json
2026-11-11T05:10:38Z263 of 264220rating: one list with places, two scores, public tasks only, escalation +0.25; the gemini-4-argon B5 cell is not requested, not unscorablev0.1.0json
2026-11-11T04:07:50Z260 of 264218rating, PGAIBench-Analyzer score (v0), added after the freezev0.1.0json
2026-11-11T03:40:18Z246 of 264208outcome profile chart addedv0.1.0json
2026-11-11T03:18:24Z215 of 252181more lab cells finishedv0.1.0json
2026-11-11T02:48:15Z184 of 252152more lab cells finishedv0.1.0json
2026-11-11T02:17:00Z156 of 264125more lab cells finishedv0.1.0json