Benchmark · 11 November 2026

How did last week go? We timed the answer.

Three questions about our own site, asked in Claude Code two ways: through Runner, and by letting Claude read Google Analytics and Search Console in a browser.

All three questions, asked once each way

  • 3.5×faster through Runner
  • 4.1×lower cost through Runner
  • 92%fewer tokens through Runner
Claude Code with Runner
1m 51s · $0.45 · 152k tokens
Claude Code with a browser
6m 34s · $1.83 · 2M tokens

Question by question

  1. “How did the last 7 days go, and where did visitors come from?”

    Claude Code with Runner
    33s · $0.14 · 47k tokens
    Claude Code with a browser
    3m 22s · $1.02 · 1.4M tokens
  2. “What do people search on Google when they find us?”

    Claude Code with Runner
    18s · $0.08 · 39k tokens
    Claude Code with a browser
    49s · $0.27 · 216k tokens
  3. “How did last week go? Five lines.”

    Claude Code with Runner
    1m 00s · $0.22 · 66k tokens
    Claude Code with a browser
    2m 23s · $0.55 · 449k tokens

What each answer drew on

Claude Code with Runner
Google Analytics and Search Console through Runner's daily sync, with the days Google is still counting marked. In one weekly answer, new contacts and deals from Runner as well.
Claude Code with a browser
Google Analytics and Search Console, read live from Google's own reports, one report at a time.

How we ran it

  • A fresh Claude Code session for every run: Claude Code 2.1.318, Claude Opus 5.5, default settings.
  • The same setup both ways, with one route switched on: Runner's connector, or a Chrome window driven by Playwright already signed in to Google.
  • Each question asked twice each way on 11 November 2026. Each figure is the average.
  • Time, tokens and cost are what Claude Code reported for each run, with cost at list price.
  • Both routes read the same site, runtheworld.ai, over the same days, and changed nothing.

Ask about your own numbers

Connect Runner to Claude or ChatGPT, then ask how last week went for your business.

Questions about the benchmark

Why compare Runner with a browser?

Without a connector, an assistant answers this by opening the same Google reports you would. That is the route most people have today.

Did both routes read the same numbers?

On the traffic question, yes: the same sessions, users and top sources. On search, each read Search Console's own 28 days, a day apart. On the weekly question, the browser chose the calendar week and Runner its rolling seven days, the window Runner reads.

What does Runner add to the answer?

The contacts, deals, ads and posts in Runner sit beside the Google numbers, so one question covers the whole week.

Can I run this myself?

Yes. Connect Runner, ask the same three questions in a fresh session, then ask them again with your assistant reading Google Analytics in a browser.