What a passing task costs
Fullbeam divides the model and runtime cost of every valid attempt, failures and retries included, by the tasks that passed. Engineer time isn't included, and the report says so.
Your agent spend keeps growing, and the vendor dashboard shows seats and tokens. It can't tell you whether the next setup will get your team's work done, in your repos, to your standards. Fullbeam benchmarks that on your merged PRs, one kind of work at a time, and says plainly what it couldn't measure.
Every result links back to the setup, the tasks and the commit it came from. If something wasn't measured, you see that too, instead of a number that looks complete.
Fullbeam divides the model and runtime cost of every valid attempt, failures and retries included, by the tasks that passed. Engineer time isn't included, and the report says so.
A new setup can be ready for a small rollout on routine maintenance, stay off database migrations, and stay under review for security-sensitive work until there are enough tasks to judge.
Projected savings appear only when there is enough behind them: your real spend, how much of that work you do, and enough results. Otherwise it shows Unavailable.
Each call your team makes, to widen, restrict, override or roll back, stays linked to the setup version, the commits, the excluded tasks and the results behind it.
Spend less where the cheaper setup does the same work. Keep the stronger one where the cheaper option fails too often. During the private preview, results are advisory, and your team makes the call.