2 Commits
  • Record the dashboard, and make the page capturable
    node scripts/record-dashboard.mjs drives the gateway with real requests and
    screenshots the real dashboard between them with headless Chrome. Screen
    recording was the obvious route and the wrong one: it would photograph whatever
    else happened to be on screen and needs a permission grant. Headless captures
    only the page, needs no permission, and writes frames straight to disk.
    
    The dashboard never finished loading under a headless browser, because it holds
    an SSE connection open and polls on an interval — so ?nolive=1 now renders once
    and goes quiet. That also makes the page screenshot-testable in general.
    
    Chrome does not reliably exit after --screenshot, so the recorder waits for the
    PNG to appear and stop growing rather than guessing a sleep, and treats profile
    cleanup as best-effort since Chrome keeps flushing after SIGKILL.
    
    Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
  • Freeway: self-hosted OpenAI-compatible gateway for free-tier providers
    One endpoint in front of every free LLM tier, with automatic failover and no
    provider key ever leaving the box.
    
    Providers are data, not code: adding one is a JSON file plus an env var, never
    a TypeScript change. Ships 12 providers pre-written; `verify-provider --apply`
    derives the live model list from your own key.
    
    - core: registry, bucketed quota meter (rolling + UTC-calendar windows),
      key-pool store, 6-step model router with diagnostic rejection reasons
    - gateway: node:http, failover that commits to a stream only after 200 headers,
      SSE passthrough with usage sniffing, virtual keys with admin/inference roles
    - context engine: sqlite sessions and a 5-rung refit ladder, so a 128k thread
      keeps working when it fails over to an 8k model
    - cache: exact (sha256, safe-by-default) + opt-in semantic (flat Float32Array)
    - guard: inbound limits, quota forecasting, limit calibration from upstream
      headers, key health, secret/PII/injection scanning
    - dashboard: one self-contained HTML file, live SSE request log, token usage
    - sdk: zero-dep typed client, drop-in for the OpenAI SDK
    
    Zero runtime dependencies. 326 tests, 27-check smoke suite against a scripted
    mock upstream so routing is testable without spending quota.
    
    Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>