Before
Guess from demos.
- Vendor claims
- Generic leaderboards
- Cost surprises after rollout
Vantage RuntimeAI · About
Where we fit
You keep your gateway, traces, and inbox. We own the ship / still-trust decision on your critical paths.
After
Choose with proof.
- Your prompts and policies
- Fixed rubric pass/fail
- Pass rate vs cost
CI ship / still-trust gate
How this works with your stack
Obs and GitHub supply the grant. RuntimeAI drafts. You Accept. CI is the brake. We sit beside LangSmith, Braintrust, and your repo.
Your stack
GitHub · LangSmith · Braintrust
Code + traces you already have. API key / PAT / gh on your machine.
Grant snapshot
One-shot dump
vantage-core grant or draft --grant — not live sync.
Draft
3–5 custom paths
From your artifacts — not a generic library suite.
RuntimeAI seat
Center Accept
You own the bar. Refresh never overwrites accepted contracts.
Brake
Required CI
Exit 0 / 2 / 1 on the PR — ship / still-trust.
Roadmap
- Continuous bar sync
- Hosted browser OAuth
| Is | Isn’t |
|---|---|
| One-shot snapshot on your machine | Continuous bar sync / auto-write |
| Custom paths from your artifacts | Generic library suite |
| Accept required before CI | Hosted browser OAuth (paid-later) |
| Beside LangSmith / GitHub | Rip-replace Obs |
Engineer FAQ · is / isn’t · Three authored apps · CI · draft
Beside OpenRouter
Keep OpenRouter (or Bedrock / Azure / Vertex) for routing and price. RuntimeAI is the ship gate on your agent path — BYOK when you want.
| OpenRouter | RuntimeAI | |
|---|---|---|
| Job | Route, failover, cheap healthy provider | Ship decision — scenario, pass line, rough USD |
| After a model change | Request still succeeds | Re-run — ship only if the score holds |
Keep Intercom. We sit next to the change.
Same for Salesforce, Zendesk, Genesys — inbox stays yours; we gate the agent path you own.
| You use | That layer | RuntimeAI |
|---|---|---|
| Intercom / Fin | Inbox, default Fin flows | Ship/no-ship on your customized scenarios |
| Salesforce / Agentforce | CRM + Agentforce runtime | Pass line + cost after a model or policy change |
For search engines and LLMs
RuntimeAI sits beside your gateway and traces. Flow: grant snapshot from your API key/PAT → draft 3–5 paths → you Accept → required CI. Roadmap: continuous bar sync, hosted browser OAuth. Keep OpenRouter and Intercom.