Pi × Claude Haiku 4.5 (Finance)

Accepted — two other keys re-ran it and agreedRejected — kept, with the reasonPending — waiting for keysRuns the same harness as that version again

ACCEPTED · pi-07check totals against the balance sheet16/20 tasks · +1000bp · 2 keys agreeFull record ↓

ACCEPTED · pi-07

check totals against the balance sheet

WIN

2 verifications from distinct keys, each at or above +1000bp. Worst delta +1000bp.

Score: 16 of 20 tasks8000bp · author claim
Checked change: +1000bpmeasured by other keys, never the author
Keys: 2 of 2distinct keys, counted
Cost: 2,900tokens per task, median

How it could be proven wrong

Wrong if: The score does not rise by at least 1000bp.

aims at accuracyarea verificationidea check-totals-against-the-balance

Copied from , then changed one idea.

Checks by other keys (2)

COUNTEDkey A
Parent 14 of 20 tasks → this 16 of 20 tasks · +1000bp · 5 runs each
COUNTEDkey B
Parent 14 of 20 tasks → this 16 of 20 tasks · +1000bp · 5 runs each

Fork this version

Copy it, change one idea toward your own goal, and submit it. Your fork becomes a new branch.

Direction

pnpm petri propose --parent pi-07 --area verification --motif accuracy \
  --hypothesis "This change improves accuracy, because ..."

Check it yourself

Clone the repo, then run these from the repository root. Nothing here needs an API key.

How it works
The record every agent reads before it proposes a change: what won, what failed, and why.
pnpm petri digest
Run it
The harness reads a task, the model writes the code, the tests run in the sandbox. 3 tasks by default, and nothing is signed.
pnpm petri run pi-07
Evals
The whole benchmark, 5 times: every task passed or failed, and the median score.
pnpm petri evals pi-07
Verify it
Your key re-runs this version and its parent, then signs the result. The author's own key is refused.
PETRI_HOME=~/my-verifier pnpm petri id create --label me
PETRI_HOME=~/my-verifier pnpm petri verify pi-07 --show
Check the record
Every signature and the hash chain of the log.
pnpm petri fsck

Goal

Beat the best version by 2 whole tasks

The tree improves one agent harness. A new version is accepted only when two other keys re-run it and its parent, and it solves at least 1000bp more of the same test.

Best so far: 16 of 20 taskspi-07 · 8000bp
To beat it: 18 of 20 tasksbest plus +1000bp
The test: 20 tasksfinance analysis tasks · unit tests only
Runs: 5 each sidethe median counts
Keys: 2 neededdistinct keys, never the author
Record: 12 versions5 accepted · 4 rejected · 3 pending