---
title: "Agent assist in 2026: what the record shows when AI helps the human"
description: "Agent assist is sold on handle time. The public record shows where AI that helps the human gains, who gains most, and why it exits cleaner than full automation."
url: "https://theinternetninja.com/blog/agent-assist-what-the-record-shows-when-ai-helps-the-human-2026/"
updated: "2026-10-08"
---

# Agent assist in 2026: what the record shows when AI helps the human

By Maneesh Behera, Head of AI Deployment. Published 2026-10-08. The Internet Ninja, analysis.

> Agent assist is sold on handle time. The public record on AI that helps a person, rather than replacing one, shows smaller gains than the pitch, landing on drafts and on newer staff, and a cleaner exit than full automation.

## Case files this argument rests on

- [Octopus Energy's 'Magic Ink': AI that drafts support emails, with no job cuts](https://theinternetninja.com/stories/octopus-energy-kraken-ai-support/)
- [GitHub Copilot in the field: three company RCTs, 4,867 developers, 26% more completed tasks](https://theinternetninja.com/stories/generative-ai-copilot-three-field-experiments-software-developers-26pct-tasks-2024/)
- [AI chatbots and earnings: Denmark study of 25,000 workers finds about 3% time savings and no earnings effect](https://theinternetninja.com/stories/denmark-llm-chatbots-adopted-across-11-exposed-occupations-measured-time-savings/)
- [Klarna's AI customer-service assistant: the 2024 numbers and the 2025 walk-back](https://theinternetninja.com/stories/klarna-ai-assistant-customer-service/)

Every contact-center vendor now sells a copilot for the agent. The pitch is always the same number: lower average handle time. The problem for a buyer is that the vendor runs the pilot, picks the queue and reports the figure.

So the useful question is not whether agent assist works. It is what the public record says it does when the AI helps a person instead of replacing one, and how that compares with the replace path.

## What agent assist is

Agent assist is AI that works beside a human support agent, drafting replies, summarising calls and suggesting next steps, while the human decides what the customer actually receives.

The difference from an autonomous agent is who sends. In agent assist the human is the last step on every interaction. In full automation the AI is.

## How does agent assist work in practice

Agent assist works by putting a draft in front of a person who edits it or sends it. The best documented case is Octopus Energy's Magic Ink, which summarises interactions and drafts replies "as if written by the user", with a human reviewing and sending each one ([source](https://www.techuk.org/resource/case-study-kraken-tech-s-generative-ai-tool-for-customer-service.html)).

The volume is real. Kraken's own case study reports it had summarised <span class="kpi">6,239,087 calls</span> and generated <span class="kpi">9,415,901 messages</span>, with no as-of date stated ([source](https://www.techuk.org/resource/case-study-kraken-tech-s-generative-ai-tool-for-customer-service.html)).

The more telling line is quieter. Kraken says "around a third of messages generated by Magic Ink require zero to minimal changes before they are sent" ([source](https://www.techuk.org/resource/case-study-kraken-tech-s-generative-ai-tool-for-customer-service.html)). Read the other way, most drafts get edited. That is the human doing the job agent assist exists to keep them doing.

## What does the record show agent assist achieves

The record shows gains that are real, uneven and smaller than a handle-time slide implies. The strongest controlled evidence is not from a contact center at all: it is three field experiments on AI coding assistance, an assist tool by design.

Pooled across <span class="kpi">4,867</span> developers, the authors found "a <span class="kpi">26.08%</span> increase (SE: 10.3%) in completed tasks" ([source](https://economics.mit.edu/sites/default/files/inline-files/draft_copilot_experiments.pdf)). The gain was concentrated: recent hires and junior staff "increased their output by 27% to 39%", while "more senior developers saw productivity gains of 8% to 13%" ([source](https://mitsloan.mit.edu/ideas-made-to-matter/how-generative-ai-affects-highly-skilled-workers)).

The widest lens is smaller still. A Danish study surveyed <span class="kpi">25,000</span> workers in 11 exposed occupations, customer support specialists among them ([source](https://www.nber.org/system/files/working_papers/w33777/w33777.pdf)). Adopters "report savings of about 3% of their work hours", a self-report rather than a register measure ([source](https://www.nber.org/system/files/working_papers/w33777/w33777.pdf)).

The registers did not move. The authors estimate "precise null effects on earnings and recorded hours", ruling out effects larger than 2% two years after ChatGPT ([source](https://www.nber.org/papers/w33777)). And "most chatbot users (85%) report reallocating time savings" to other tasks ([source](https://www.nber.org/system/files/working_papers/w33777/w33777.pdf)).

## Agent assist vs replacing the agent

The obvious reading is that agent assist is the timid version of automation, and that the bold operators skip it. The record argues the opposite: assist is the version that survived contact with its own numbers.

Klarna took the replace path. Its assistant handled two-thirds of chats in its first month, which Forbes relayed as "the workload equivalent to 700 full-time staff members, according to a recent statement by the company" ([source](https://www.forbes.com/sites/jackkelly/2024/03/04/klarnas-ai-assistant-is-doing-the-job-of-700-workers-company-says/)). By 2025 its CEO said the cost-first push meant "what you end up having is lower quality", and Klarna began recruiting humans again ([source](https://www.customerexperiencedive.com/news/klarna-reinvests-human-talent-ai-customer-service-buy-now-pay-later/747586/)).

Octopus took the assist path and said the tool was "unlikely to lead to job cuts" ([source](https://www.cityam.com/ai-doing-the-work-of-over-200-people-at-octopus-chief-executive-says/)). Its figures are company-originated too, and its satisfaction number moves between statements, from 80% against 65% in one to "around 70%" in its own case study ([source](https://www.cityam.com/ai-doing-the-work-of-over-200-people-at-octopus-chief-executive-says/), [source](https://www.techuk.org/resource/case-study-kraken-tech-s-generative-ai-tool-for-customer-service.html)). Neither company is a clean measurement. The difference is which one had to walk its model back.

## What TIN checked

The four records behind this post are TIN case files, each checked against the public record before it went live. Each page states its own limits, and they matter here.

- [Octopus Energy's Magic Ink](https://theinternetninja.com/stories/octopus-energy-kraken-ai-support/): CEO and company figures, relayed by independent press, with no third-party audit.
- [Three Copilot field experiments](https://theinternetninja.com/stories/generative-ai-copilot-three-field-experiments-software-developers-26pct-tasks-2024/): randomized and peer-reviewed, but two of six authors work for the vendor, and the workers are developers, not support agents.
- [The Denmark chatbot study](https://theinternetninja.com/stories/denmark-llm-chatbots-adopted-across-11-exposed-occupations-measured-time-savings/): an NBER working paper, not peer-reviewed; time savings are self-reported.
- [Klarna's assistant and walk-back](https://theinternetninja.com/stories/klarna-ai-assistant-customer-service/): every 2024 efficiency figure originates with Klarna.

None of the four measures average handle time for an agent assist deployment. That gap is the finding a buyer should carry into a vendor meeting. For the replace side of the same market, see [what the record shows on AI voice agents](https://theinternetninja.com/blog/ai-voice-agents-what-the-verified-record-shows-2026/).

## How the records compare

| Record | Model | Headline figure | Who measured it |
|---|---|---|---|
| Octopus Magic Ink | Assist | 34% of queries | CEO statement |
| Copilot field experiments | Assist | 26.08% more tasks | Randomized trial |
| Denmark chatbot study | Mixed use | About 3% of hours | Worker self-report |
| Klarna assistant | Replace | 700-agent equivalence | Company statement |

The Octopus share comes from its CEO's May 2023 statement, relayed by City AM as "the work of 250 people" ([source](https://www.cityam.com/ai-doing-the-work-of-over-200-people-at-octopus-chief-executive-says/)), with 34% of queries carried in the [Octopus case file](https://theinternetninja.com/stories/octopus-energy-kraken-ai-support/).

## How to read an agent assist pilot

A real time agent assist pilot is worth reading only if it says who was in the treated group. The controlled record shows the gain depends on tenure, so a pilot run on new hires reports the junior band of that range, not the senior one ([source](https://mitsloan.mit.edu/ideas-made-to-matter/how-generative-ai-affects-highly-skilled-workers)).

Ask for the edit rate as well as the handle time. If most drafts need more than minimal changes, as Kraken's own figure implies for its tool, the human is still doing the judgment and the saving sits mostly in typing ([source](https://www.techuk.org/resource/case-study-kraken-tech-s-generative-ai-tool-for-customer-service.html)).

## Bottom line

Agent assist is usually bought as a stepping stone to automation. The record says to buy it as the destination: the replace path is the one that produced the public walk-back, while the assist path produced modest gains concentrated where training is thinnest. Expect a seasoned floor to look like the Denmark self-reports, and new hires to look like the junior developers. The principle travels: when a tool's benefit depends on who uses it, the pilot's headcount mix is the result, and the headline number is just its shadow.

## Sources

1. techUK, "Case study: Kraken Tech's generative AI tool for customer service", 2023, https://www.techuk.org/resource/case-study-kraken-tech-s-generative-ai-tool-for-customer-service.html
2. City AM, "AI doing the work of over 200 people at Octopus, chief executive says", 2023-05-08, https://www.cityam.com/ai-doing-the-work-of-over-200-people-at-octopus-chief-executive-says/
3. MIT Economics, "The Effects of Generative AI on High-Skilled Work: Evidence from Three Field Experiments with Software Developers" (working paper), 2024, https://economics.mit.edu/sites/default/files/inline-files/draft_copilot_experiments.pdf
4. MIT Sloan, "How generative AI affects highly skilled workers", 2024, https://mitsloan.mit.edu/ideas-made-to-matter/how-generative-ai-affects-highly-skilled-workers
5. NBER, "Still Waters, Rapid Currents: Early Labor Market Transformation under Generative AI" (Working Paper 33777, full text), March 2026, https://www.nber.org/system/files/working_papers/w33777/w33777.pdf
6. NBER, Working Paper 33777 landing page and abstract, March 2026, https://www.nber.org/papers/w33777
7. Forbes, "Klarna's AI Assistant Is Doing The Job Of 700 Workers, Company Says", 2024-03-04, https://www.forbes.com/sites/jackkelly/2024/03/04/klarnas-ai-assistant-is-doing-the-job-of-700-workers-company-says/
8. CX Dive, "Klarna changes its AI tune and again recruits humans for customer service", May 2025, https://www.customerexperiencedive.com/news/klarna-reinvests-human-talent-ai-customer-service-buy-now-pay-later/747586/

## Questions

**What is agent assist?**

Agent assist is AI that works beside a human support agent, drafting replies, summarising calls and suggesting next steps, while the human decides what the customer receives. Octopus Energy's Magic Ink is the clearest public example: a person reviews and sends every draft.

**Does ai agent assist reduce average handle time?**

Agent assist can save time, but none of the four records this post rests on measured handle time for an assist deployment. The closest controlled evidence measures completed tasks, and the largest worker study found about 3% of hours saved by adopters' own report.

**Who benefits most from agent assist?**

Newer staff benefit most from agent assist in the controlled record. In three field experiments with 4,867 developers, recent hires and junior staff gained 27% to 39% in output, against 8% to 13% for senior staff.

This post is analysis, not proof. The evidence lives in the case files: https://theinternetninja.com/stories/
