Crescendo LabCAAC Go

CAAC Go Agent Benchmark

Which AI model makes the best customer-service agent?

A monthly benchmark from Crescendo Lab. Each edition runs the same 150 customer conversations through the production agent of CAAC Go, changes only the model, and has two AI judges from different vendors grade every reply. We publish the misses alongside the wins.

2 editions · 7 models tested · 150 cases in 7 languages per edition · latest run 7 November 2026

Latest edition · November 2026

Gemini 4 Argon catches GPT-6.1. Claude Opus 5.5 leaves them both behind.

Seven models. Gemini 4 Argon is level with GPT-6.1 Sol and ahead of GPT-5.6 Terra, which it trailed in October, and saves far more leads than any GPT model. Claude Opus 5.5 is the only model clearly ahead of the field.

  1. 1Claude Opus 5.589%
  2. 2Claude Sonnet 5.581%
  3. 3Gemini 4 Argon76%
  4. 4GPT-6.1 Sol76%
  5. 5Gemini 3.8 Flash75%
  6. 6GPT-5.574%
  7. 7GPT-5.6 Terra73%

Share of 150 cases fully correct: the right action, every claim supported by the business’s own information, in the visitor’s language. Gaps under about 7 points are within noise.

Read the November 2026 report →

All editions

Analyses

Every model, every edition

The cases and the agent stay the same from one edition to the next, so a model’s score can be compared over time. A single run moves by a few points on its own; each report tests whether a change is larger than that.

ModelNovember 2026October 2026
Claude Opus 5.589%not tested
Claude Sonnet 5.581%not tested
Gemini 4 Argon76%69%
GPT-6.1 Sol76%not tested
Gemini 3.8 Flash75%not tested
GPT-5.574%not tested
GPT-5.6 Terra73%73%

How every edition is run

  • The same 150 cases. Six fictional businesses (a clinic, a SaaS product, an online store, a tutoring centre, a cleaning company and a café), 25 cases each, across nine task types and seven visitor languages. The mix follows anonymised patterns from real CAAC Go conversations; no customer data is used.
  • The same agent. Every reply comes from CAAC Go’s production agent code, with the same prompt, tools and language rule for every model. Each business’s full knowledge base is in context, so the test measures the model, not search.
  • Two judges, both must agree. GPT-5.5 and Gemini 3.1 Pro grade every reply. Whether the agent saved a lead or handed off is checked from what it did, not judged.
  • Honest error bars. Each report gives confidence intervals and a case-by-case significance test, plus the limits of that run.
  • Any model, one gateway. Models we cannot reach directly, such as Claude and GPT-6.1, run through Agent Lab AI Gateway, also built by Crescendo Lab.

The agent in every test

CAAC Go: an AI agent for your website, live in minutes

It answers visitors from your own website content, saves leads and booking requests, and hands the conversation to your team when it should. Paste your site’s link to try it on your own content. Free, no signup.

caacgo.cresclab.com