Benchmark · 11 November 2026
How did last week go? We timed the answer.
Three questions about our own site, asked in Claude Code two ways: through Runner, and by letting Claude read Google Analytics and Search Console in a browser.
All three questions, asked once each way
- 3.5×faster through Runner
- 4.1×lower cost through Runner
- 92%fewer tokens through Runner
- Claude Code with Runner
- 1m 51s · $0.45 · 152k tokens
- Claude Code with a browser
- 6m 34s · $1.83 · 2M tokens
Question by question
“How did the last 7 days go, and where did visitors come from?”
- Claude Code with Runner
- 33s · $0.14 · 47k tokens
- Claude Code with a browser
- 3m 22s · $1.02 · 1.4M tokens
“What do people search on Google when they find us?”
- Claude Code with Runner
- 18s · $0.08 · 39k tokens
- Claude Code with a browser
- 49s · $0.27 · 216k tokens
“How did last week go? Five lines.”
- Claude Code with Runner
- 1m 00s · $0.22 · 66k tokens
- Claude Code with a browser
- 2m 23s · $0.55 · 449k tokens
What each answer drew on
- Claude Code with Runner
- Google Analytics and Search Console through Runner's daily sync, with the days Google is still counting marked. In one weekly answer, new contacts and deals from Runner as well.
- Claude Code with a browser
- Google Analytics and Search Console, read live from Google's own reports, one report at a time.
How we ran it
- A fresh Claude Code session for every run: Claude Code 2.1.318, Claude Opus 5.5, default settings.
- The same setup both ways, with one route switched on: Runner's connector, or a Chrome window driven by Playwright already signed in to Google.
- Each question asked twice each way on 11 November 2026. Each figure is the average.
- Time, tokens and cost are what Claude Code reported for each run, with cost at list price.
- Both routes read the same site, runtheworld.ai, over the same days, and changed nothing.
Ask about your own numbers
Connect Runner to Claude or ChatGPT, then ask how last week went for your business.
Questions about the benchmark
Why compare Runner with a browser?
Without a connector, an assistant answers this by opening the same Google reports you would. That is the route most people have today.
Did both routes read the same numbers?
On the traffic question, yes: the same sessions, users and top sources. On search, each read Search Console's own 28 days, a day apart. On the weekly question, the browser chose the calendar week and Runner its rolling seven days, the window Runner reads.
What does Runner add to the answer?
The contacts, deals, ads and posts in Runner sit beside the Google numbers, so one question covers the whole week.
Can I run this myself?
Yes. Connect Runner, ask the same three questions in a fresh session, then ask them again with your assistant reading Google Analytics in a browser.