Skip to main content
The Davenporter
Essays Builds Now About
Theme
Palette
Jason Davenport

I write about agents doing real engineering work: source control, memory, telemetry, and the human side of AI.

Subscribe

Elsewhere

  • About me
  • Workbench notes
  • Substack
  • Medium
  • LinkedIn
  • GitHub
  • X
  • RSS
Workbench

Notes

I keep short workbench notes here between full essays: benchmark scorecards, before and after diffs, and two-branch routing diagrams from real agent builds, each paired with a plain takeaway you can test on your own traffic.

Full essays Workbench notes
All Scorecard Before / After Mental model
  1. Nov 10, 2026
    Before / After Model Routing · Cloud Cost
    #

    Stop paying a generative model to print JSON just to pick another model

    Takeaway

    Swapping a rubric-and-JSON classifier prompt for a single forward-pass decision call cut routing latency 3.5x (752 ms to 212 ms) with zero output tokens.

    Before and after comparison showing generative JSON routing at 752 ms and 165 output tokens versus single-pass Gemini Decisions at 212 ms and 0 output tokens.
    Before and after comparison showing generative JSON routing at 752 ms and 165 output tokens versus single-pass Gemini Decisions at 212 ms and 0 output tokens.
    Read context and raw numbers

    In Smart Router, asking a small generative model to emit JSON before the real model ran added decode latency and output token tax on every request.

    Before: Generative JSON rubric - Wrap every user request in a classification rubric and JSON responseSchema - 752 ms median latency waiting on autoregressive token decode - 165 output tokens billed per turn with an uncalibrated string label (17 / 20 on trap suite)

    After: Single-pass Gemini Decisions - Score complexity and task kind in one forward pass (gemini-decision-1) - 212 ms median latency (3.5x faster) and 0 output tokens - Calibrated probabilities (19 / 20) with a real MinConfidence escalation floor

    Full essay: Stop generating JSON just to pick a model: semantic routing with Gemini Decisions → Build: SmartRouter →
From workbench note to full essay

Scroll →

How daily workbench notes graduate into canonical essays Real benchmark tables, prompt diffs, and routing splits start as short workbench notes, get shared on LinkedIn and X, and the questions that spark discussion become full essays. 1. Capture • Benchmark scorecards • Before / after diffs • Routing mental models 2. Share nugget Timeline + native cards • Published at /notes • Native PNG on X & LI 3. Graduate Full canonical essay /notes.md · /api/notes /writings/{slug}
Short workbench artifacts land here first (and as Markdown at /notes.md or JSON at /api/notes); the notes that spark real engineering questions graduate into full essays.
Workbench notes index, newest first
Date Format Note Takeaway
Nov 18, 2026 Scorecard Gemini followed my UI skills and Opus skipped them: deleting 95% of my agent rules Guardrails written for older models poison newer ones that actually follow them: cutting 95% of my agent config (222.3 KB to 11.4 KB) fixed my UI builds.
Nov 17, 2026 Mental model Two coding agents, two worktrees: Floor Trials goes from 6 to 18 challenges, plus ghost runs Split parallel agent work by file ownership, tell each agent what the other one owns, and make every branch prove itself (bit-for-bit replays, a bot that clears each level) before merge.
Nov 10, 2026 Before / After Stop paying a generative model to print JSON just to pick another model Swapping a rubric-and-JSON classifier prompt for a single forward-pass decision call cut routing latency 3.5x (752 ms to 212 ms) with zero output tokens.
Nov 08, 2026 Mental model When to give a coding agent an AST graph vs. plain ripgrep Use a local AST graph for symbols, field writes, blast radius, and covering tests; keep ripgrep for UI copy, log strings, and dynamic URLs.
Nov 06, 2026 Scorecard One schema change on a 161-file TypeScript monorepo: grep vs. ast-graph Query an AST symbol graph before opening files so source maps and 3,000-line modules never land in your agent's context window.
About · Notes · Subscribe on Substack · RSS · Privacy ·
Ask

Social card and structured data

The share image, feeds and Schema.org JSON-LD that search engines and AI tools read for this page.

Social card

Title card for Notes
Card URL: /og/notes.svg

Machine feeds

/llms.txt /llms-full.txt /sitemap.xml /api/agent/spec

Structured data

{
  "@context": "https://schema.org",
  "@graph": [
    {
      "@type": "Person",
      "@id": "https://davenporter.com/#jason-davenport",
      "name": "Jason Davenport",
      "alternateName": "@davenportjw",
      "jobTitle": "AI & Distributed Systems Architect",
      "description": "Exploring agent-first source control (cosm), trajectory-to-lineage observability, Spanner-backed agent memory consolidation (Electric Sheep), hybrid local/cloud LLM routing, and real-time multiplayer browser simulations on Google Cloud Run.",
      "url": "https://davenporter.com",
      "sameAs": [
        "https://davenporter.substack.com",
        "https://www.linkedin.com/in/davenportjw",
        "https://github.com/davenportjw",
        "https://x.com/davenportjw",
        "https://medium.com/@davenportjw"
      ]
    },
    {
      "@type": "WebSite",
      "@id": "https://davenporter.com/#website",
      "url": "https://davenporter.com",
      "name": "The Davenporter",
      "description": "Learnings about software, technology, agentic systems, and occasionally home renovation.",
      "publisher": {
        "@id": "https://davenporter.com/#jason-davenport"
      },
      "inLanguage": "en-US"
    },
    {
      "@type": "ImageObject",
      "@id": "https://davenporter.com/notes#primaryimage",
      "url": "https://davenporter.com/og/notes.png",
      "contentUrl": "https://davenporter.com/og/notes.png",
      "width": 1200,
      "height": 630,
      "caption": "Title card for Notes",
      "representativeOfPage": true,
      "creator": {
        "@id": "https://davenporter.com/#jason-davenport"
      },
      "license": "https://creativecommons.org/licenses/by/4.0/",
      "acquireLicensePage": "https://davenporter.com/writings"
    },
    {
      "@type": "CollectionPage",
      "@id": "https://davenporter.com/notes#webpage",
      "url": "https://davenporter.com/notes",
      "name": "Notes | The Davenporter",
      "description": "I keep short workbench notes here between full essays: benchmark scorecards, before and after diffs, and two-branch routing diagrams from real agent builds, each paired with a plain takeaway you can test on your own traffic.",
      "isPartOf": {
        "@id": "https://davenporter.com/#website"
      },
      "about": {
        "@id": "https://davenporter.com/#jason-davenport"
      },
      "primaryImageOfPage": {
        "@id": "https://davenporter.com/notes#primaryimage"
      },
      "inLanguage": "en-US"
    },
    {
      "@type": "FAQPage",
      "@id": "https://davenporter.com/notes#faq",
      "mainEntity": [
        {
          "@type": "Question",
          "name": "What short workbench notes and benchmarks has Jason Davenport shared recently?",
          "acceptedAnswer": {
            "@type": "Answer",
            "text": "I keep short workbench notes here between full essays: benchmark scorecards, before and after diffs, and two-branch routing diagrams from real agent builds, each paired with a plain takeaway you can test on your own traffic."
          }
        }
      ]
    },
    {
      "@type": "BreadcrumbList",
      "@id": "https://davenporter.com/notes#breadcrumb",
      "itemListElement": [
        {
          "@type": "ListItem",
          "position": 1,
          "name": "Home",
          "item": "https://davenporter.com/"
        },
        {
          "@type": "ListItem",
          "position": 2,
          "name": "Notes",
          "item": "https://davenporter.com/notes"
        }
      ]
    }
  ]
}

Ask The Davenporter

Ask anything about the essays and builds on this site.