vantage-core releases

Try the CLI with no RuntimeAI account and no API key. You get a saved decision file and an HTML scorecard you can open in a browser.

Try this

python3 -m pip install --no-cache-dir -U vantage-core
vantage-core --version   # 0.1.9
vantage-core demo --save decisions/
vantage-core report "$(vantage-core decisions latest)" --html decisions/suite.html

Open decisions/suite.html. That is the memo.

What changed

• Saving the demo now writes files. In 0.1.8, demo --save printed a walkthrough and left the folder empty, so the next command had nothing to open.
• A correct short answer can pass. Live demo --live (needs an OpenRouter key) no longer fails just because the model’s reply is brief. Empty replies still fail.

What this is not

Not a Cloud dashboard. The HTML file stays on your machine — or in your GitHub Actions / GitLab artifacts if you wire CI. Hosted history remains paid.

What's new

Human scorecard from CI

CI is not only a green check. From a saved runtimeai.decision/v1 JSON, emit a self-contained HTML (and optional PDF) memo — same axes / pass-review-block / bind / compare-to-baseline as the Simulator scorecard. No RuntimeAI account. Lives in their GitHub Actions / GitLab artifact store.

vantage-core report decisions/suite.json --html decisions/suite.html
vantage-core report decisions/suite.json --pdf decisions/suite.pdf

GitHub / GitLab stubs (ci stub github|gitlab) generate the memo after the gate and upload JSON + HTML + PDF as runtimeai-decision. Report failure does not change the suite exit code.

Not in this path: a free Cloud dashboard, SaaS upload of suite history, or a RuntimeAI API key.

Still in

Still-trust CI (0.1.7) · richer ingest (0.1.6) · suite rerun --baseline · --reps / --pass-k · pass / review / block · dated decisions/ ledger · demo · SHA/PR bind · --ci-comment

Claim discipline

Free CI = gate + decision JSON + PR comment + optional human HTML/PDF artifact in their CI. Same rubrics as the UI. Hosted history remains paid.

Not in this release

Hosted multi-tenant history, Cloud dashboard, LangSmith OAuth, GitHub App, gateway, prompt playground.

What's new

Still-trust CI

PRs re-decide against the last ship decision. Default branch records a new artifact. Exit is the current gate (0 / 2 / 1), not “same as last time.”

vantage-core ci stub github    # required-check workflow
vantage-core ci stub gitlab
# or: vantage-core init --ci

--baseline latest

vantage-core suite run suites/starter.suite.yaml --json --save decisions/
vantage-core suite rerun suites/starter.suite.yaml --baseline latest --json --save decisions/
vantage-core decisions latest

--baseline also accepts a directory of decision JSON.

60-second demo (no API key)

vantage-core demo              # talk track: last ship → after change → PR comment
vantage-core demo --live       # live Acme sample suite (needs OPENROUTER_API_KEY)

PR / MR comment

--ci-comment posts bind headline + compare_to_baseline (updated in place). Uses GITHUB_TOKEN or GitLab CI_JOB_TOKEN. No GitHub App.

vantage-core suite rerun suites/starter.suite.yaml \
  --baseline latest --json --save decisions/ --ci-comment

Still in

• Richer ingest (0.1.6) · suite rerun --baseline · --reps / --pass-k · pass / review / block
• Dated decisions/ ledger · demo · init · SHA/PR bind

Claim discipline

Ship / still-trust decision — not observability. CI comment is evidence on the PR, not a review product.

Not in this release

Hosted multi-tenant history, LangSmith OAuth, GitHub App, gateway, prompt playground.

What's new

Richer complement ingest

vantage-core ingest export.json
vantage-core ingest export.json --write-drafts ./contracts_drafts

Pipeline: extract evidence → match Vantage risk priors (detectors on user/assistant/error/tags) → rank by severity × failure shape → optional contract drafts with openings from *their* turns.

Not a trace UI. Not OAuth. Partner still owns the suite.

--suggest-paths from 0.1.5 still works.

Still in

• suite rerun --baseline · --reps / --pass-k · pass / review / block (exit 0/2/1)
• Dated decisions/ ledger · demo · init · SHA/PR bind

Claim discipline

Ship / still-trust decision — not observability. Fragments (LangSmith-shaped exports) feed the gate.

Not in this release

Hosted multi-tenant history, LangSmith OAuth, gateway, prompt playground.

Packages: B · G′ · E · F (free gate)

What's new

Still-trust re-run (B)

vantage-core suite run suites/starter.suite.yaml --json --save decisions/
vantage-core suite rerun suites/starter.suite.yaml \
  --baseline decisions/<prior>.json --json --save decisions/
echo $?   # current gate only

New decision each time; optional compare_to_baseline (score/cost deltas, path regressions, gate_transition).

Complement ingest (G′)

vantage-core ingest examples/ingest/langsmith_export_sample.json --suggest-paths

LangSmith-shaped file export → suggested critical paths. Not a trace UI. Not OAuth.

N-run (E)

vantage-core suite run suites/starter.suite.yaml --reps 3 --pass-k 2 --json

Default remains single-run. BYOK cost ~×N.

Three-state route (F)

pass_gate.route: pass (exit 0) · review (exit 2) · block (exit 1).

CI: fail on nonzero, or special-case review=2.

Claim discipline

Ship/still-trust decision — not observability. Fragments (LangSmith exports) feed the gate.

Not in this release

Hosted multi-tenant history, LangSmith OAuth, gateway, prompt playground, Diagnostics clone.