K Koda Intelligence
DEEP DIVE DEEP DIVE № 205 · 24 September 2026DOCKODA-20260924-2798043371C7sha-256 of date + article + 24 claims
FILED 24 SEPTEMBER 202624 CLAIMS CHECKED · 9 VERIFIED

The model is not the hard part.
The handoff is.

Reuters reported on September 22, 202610 that Meta was testing trained human contractors to complete some phone calls placed through Muse, its personal AI assistant. Some internal tests suggested human callers reached 95%16 to 98% success, above the AI-only rate, which the report did not specify. Employees raised privacy concerns, and Meta acknowledged inadequate disclosures before rolling the test back. The engineering lesson is not about voice quality. It is about transferring a task without losing the user's limits.

7 MIN READ · BY THE KODA EDITORIAL TEAM · TOOLS · AGENT DESIGN
HUMAN CALL SUCCESS95% TO 98%VERIFIED CLAIM 16REUTERS TESTS
AI-ONLY RATELOWERNOT MEASUREDRATE NOT GIVEN
REPORT DATESEP 22NOT MEASUREDREUTERS 2026
HUMAN CALL SUCCESS95% TO 98%REUTERS TESTS AI-ONLY RATELOWERRATE NOT GIVEN REPORT DATESEP 22REUTERS 2026 HANDOFF FIELDS4TRIGGER BRIEF PERMISSION RECEIPT CONCIERGE TESTROLLED BACKDISCLOSURE MISS OUTLOOK WINDOW2031FIVE YEARS OUT CACHING UPDATEGPT-6SOL AND LUNA PRODUCTMUSEMETA ASSISTANT

95%16 to 98% success. That was the range some Meta tests suggested human callers could reach, according to Reuters on September 22, 202610. AI-only calls scored lower. The report did not give their exact rate.

Those people were handling requests placed through Muse, Meta’s personal AI assistant. According to Reuters, Meta was testing the use of trained contractors to handle some phone calls placed via Muse. Employees raised privacy concerns. Meta acknowledged inadequate disclosures in Muse’s human concierge test and rolled it back.

The human help itself deserves a fair hearing. A user who wants a haircut booked may welcome a person who can finish the job. But permission to use an assistant should not quietly become permission to share personal details with a contractor.

I think Muse exposes the next hard problem in agent engineering: transferring responsibility without losing the user’s intent. A better model may reduce the need for help. Builders still need a clear contract for when help arrives, what it can do, and how completion gets checked.

The Handoff Contract

Call that contract the Handoff Contract. It defines how a task changes hands while keeping the user’s limits intact.

AGENT HANDOFF LEDGER · SEPTEMBER 2026Reuters · Meta · KODA ANALYSISBASE: 24 CHECKED CLAIMS, 4 SHOWN

What the Muse concierge test actually put on the table.

Human caller success range Reuters · some Meta tests VERIFIED CLAIM 16
95% to 98%
Handoff Contract fields Koda proposal · trigger, brief, permission, receipt NOT MEASURED
4
Reported test date Reuters report on Muse contractors NOT MEASURED
SEP 22, 2026
Delegation outlook horizon Koda analysis · five year view NOT MEASURED
2031

For a Muse-style calling service, I would make four fields mandatory:

  • Trigger: The specific condition that stops the automated path. A request for identity verification could require the user to step in.
  • Brief: The task objective and the minimum context needed to act. A haircut booking should not expose unrelated conversation history.
  • Permission: The actions the next operator may take. Asking about availability and accepting a cancellation fee require different authority.
  • Receipt: The evidence returned after execution. A booking record should include the confirmed time and any unresolved conditions.

Define these fields before choosing an operator. Both a contractor and a user taking back control need them.

Reuters reported that Meta was testing human contractors to handle some Muse phone-call requests. That does not establish that Meta transferred live calls midway through conversations. Builders should keep that distinction clear because each workflow needs different coordination.

A request transfer needs a complete brief. A live transfer also needs a reliable account of what has already happened. Otherwise, the next caller risks repeating an action or contradicting a commitment.

The Handoff Contract also allows a clean stop. If nobody has authority to proceed, the system should return the decision to the user.

The Call Needs An Owner

A salon booking makes the engineering problem concrete. Imagine a user requests an appointment within a stated window and refuses any cancellation charge. This is a proposed test case, not a reported Muse interaction.

Muse exposes the next hard problem in agent engineering: transferring responsibility without losing the user's intent.· KODA EDITORIAL · SEPTEMBER 2026

The assistant reaches a point where it cannot proceed. Perhaps the business offers a different time or asks for details the user never approved sharing.

The tempting implementation is simple: send the conversation to a worker and ask them to finish. That leaves the hardest questions unanswered.

Who owns the task now? Can the automated caller keep retrying? What happens if the user cancels while a contractor is waiting on hold?

I would use explicit task states: recorded labels that show where a request stands.

A request could move from automated work to awaiting assistance. Once a worker accepts it, the system should block another operator from acting on the same request. Cancellation should invalidate outstanding permission to make a booking.

That is the boring plumbing worth building first. A slick voice cannot repair two callers making incompatible commitments.

Keep the worker’s brief compact and structured, with named fields rather than a loose paragraph.

For the salon example, include the approved appointment window and the rule against cancellation charges. Show only the contact details needed for the booking. Keep unrelated chats out of the worker’s view.

Disclosure belongs before sensitive context changes hands. Ask the user whether human help is acceptable. Tell the business who is calling and whose instructions govern the request.

The reported failure explains why this matters. Reuters said a Meta executive called testing contractor-placed calls without proper disclosures “a miss.” The operating design needed better disclosure.

Human help also needs a conduct policy. Reuters reported that an employee said a transcript showed a contractor making a racist reference. Having a person involved is not a complete safety argument.

Give the return path equal attention. Require the worker to record the outcome against the original constraints. Let the assistant produce its user-facing summary from that record.

If the appointment falls outside the approved window, the task remains unresolved. A pleasant conversation should never erase an unmet requirement.

The reported success range needs this same discipline. It is unclear whether “success” meant completing the task correctly while honoring every user constraint.

My proposed scorecard would separate autonomous completion from human-assisted completion. Failed transfers would get their own count. Unauthorized actions would remain failures even when a business confirmed the appointment.

Then put a dollar figure on the workflow:

Cost per verified completion = (model costs + phone costs + human labor + oversight) / verified completed tasks.

This is a proposed accounting rule, not a Muse cost estimate.

A contractor queue belongs in that calculation too. Set an operating budget and an expiry rule for waiting requests. If nobody accepts a task, tell the user it remains unfinished.

The useful question for a builder is what a correctly completed booking costs. Cheap model output alone cannot answer it.

Where a booking changes hands and breaks

DISCLOSURE MISS
SEP 22

Permission to use an assistant is not permission to brief a contractor.

Reuters reported that a Meta executive called testing contractor-placed calls without proper disclosures a miss, and the internal human concierge test was pulled back. Employees had already raised privacy concerns. Disclosure has to land before sensitive context moves.

UNDEFINED SUCCESS
95%16 TO 98%

Nobody has said what success counted.

Some Meta tests suggested human callers reached 95% to 98%, with the AI-only rate lower and unstated. It is unclear whether success meant completing the task while honoring every user constraint. A scorecard should split autonomous completion, assisted completion, failed transfers and unauthorized actions.

COST STRUCTURE
4

Human escalation creates a second budget line.

The reported GPT-6 prompt-caching update for Sol and Luna would cut repeated-prompt cost, but labor and oversight sit outside that saving. Cost per verified completion divides model, phone, labor and oversight spend by verified completed tasks. The four Handoff Contract fields are what make a completion verifiable at all.

2031: The Service Behind Glasses

Over the next five years, I expect dependable delegation to give some companies an advantage over others. Companies that preserve permission through every transfer could earn the right to handle more consequential tasks.

Meta’s reported rollback offers a case study. Reuters reported that Meta temporarily pulled back Muse's internal human-concierge calling test after disclosure concerns. Capability gains did not settle the launch decision.

If Muse reaches that form factor, I expect unresolved tasks to become harder to overlook. A spoken assurance follows the user into the next activity. A missing appointment can surface long after the conversation ends.

That makes clear status updates more valuable. The brief also describes an OpenAI prompt-caching update for the GPT-6 family, specifically GPT-6 Sol and Luna, aimed at reducing latency and cost for repeated prompts. Prompt caching generally means reusing prior computation for repeated prompt prefixes.

Treat it as a reported infrastructure direction rather than measured evidence about Muse.

The economic connection is still useful. Reusing computation would address one part of a task’s cost. Human escalation would introduce a separate labor budget that needs its own controls.

The strategic goal should be to learn from that budget. Record why help was required, then test whether a narrower workflow can safely remove the dependency.

The gains could compound. Each reviewed failure can improve the next version of the service.

None of this proves every agent needs a contractor pool. Some products should offer fewer actions or return hard decisions to the user. Scope is an engineering choice too.

Prototype A Booking Handoff Desk

This week, build a small handoff desk for appointment requests. Use fictional details and willing testers before contacting real businesses. You can prototype the control flow with a form and a spreadsheet without a computer science degree.

First, create the Handoff Contract as a task form. Include the requested service and acceptable appointment window. Add separate fields for forbidden commitments and permission to involve a person.

The form should reject requests missing an authority boundary. “Handle it for me” leaves too much open.

Next, make a queue that one tester can operate. Give each request a unique identifier and an owner field. Only the owner should be allowed to record a booking.

Keep the assistant’s role small during this test. It can draft the brief, but a tester should verify that the draft preserves every user constraint.

Then write the disclosure messages before connecting any real calling service. The user message should explain what information a person would receive. The business message should identify the caller’s role.

A short message can be clear without pretending to settle every legal requirement. Get appropriate review before using the workflow with real customer information.

Finally, build the receipt form and test failure paths. Offer an appointment outside the permitted window. Cancel a request after a worker accepts it.

Also test duplicate acceptance and a queue with nobody available. The prototype should preserve an honest status in every case.

Track the time spent repairing each failed transfer. Record why a tester had to reconstruct the brief. Those observations will tell you where the next engineering hour belongs.

For tools, inspect the adam.new demo before committing. Today’s digest does not establish its capabilities or pricing. Keep the prototype tool-independent until you know whether it fits.

The digest also lists AI for News v1 without a substantive feature description or verified product link. Check the actual product before assigning it research work. Neither listing establishes suitability for sensitive customer data.

Expect the first version to break. Fix the transfer that lost a constraint before polishing the assistant’s voice.

Muse’s reported test offers a useful starting point: human help can be a legitimate product feature. Build it so everyone knows when it happens. The user should never have to guess who acted or what they agreed to.

DOJO · BUILD THIS WEEKEND

Prototype a booking handoff desk with a form and a spreadsheet.

  1. Write the Handoff Contract as a task form. Give it four mandatory fields: trigger, brief, permission, receipt. Include the requested service, the acceptable appointment window, forbidden commitments such as cancellation charges, and explicit permission to involve a person. Reject any request that leaves the authority boundary blank.
  2. Run a single-owner queue. Give every request a unique identifier and an owner field, and let only the owner record a booking. Then test the ugly paths: duplicate acceptance, a cancellation after a worker accepts, and a request nobody picks up before its expiry.
  3. Draft the two disclosure messages first. Tell the user exactly what information a person would receive, and tell the business who is calling and whose instructions govern the request. Use fictional details and willing testers, and get appropriate review before any real customer data enters the workflow.
Practice: Design an AI-Assisted Workflow
THE BOTTOM LINE

Ship the plumbing before the voice.

Meta's reported Muse test showed that a human fallback can raise completion rates and still fail the user, because the failure was disclosure and coordination rather than capability. A task that changes hands needs a trigger, a compact brief, a stated permission and a receipt checked against the original constraints. Explicit task states stop two callers from making incompatible commitments, and a cancellation should void outstanding authority to book. Measure cost per verified completion so that model savings, including reported prompt-caching gains for the GPT-6 family, do not hide a growing labor budget. Better models will shrink how often help is needed, but they will never decide who owns the call.

LISTEN · AUDIO BRIEFINGThe conversation · ~17 min
WATCH · VISUAL NARRATIVEAnimated breakdown · ~5 min
PLAY · YOUTUBE
EDITORIAL RECEIPTKODA-20260924-2798043371C7
As of24 September 2026MethodClaim extraction, dated-evidence review, and temporal consistency gate.CorrectionsContact the Koda desk
EVIDENCE24 CLAIMS CHECKED · 9 VERIFIED · 12 REPORTED · 3 FAILED
9 verified12 reported3 failed
  1. 01According to Reuters, AI-only calls in Meta's Muse tests achieved lower success rates than human callers.VERIFIEDTRUEBENCHMARKreuters.com
  2. 02Muse is Meta's personal AI assistant.REPORTEDMOSTLY TRUEMODELabout.fb.com
  3. 03The supplied topic brief describes a prompt-caching update for OpenAI GPT-6.REPORTEDMOSTLY TRUEMODELCORRECTED IN COPYopenai.com
  4. 04According to Reuters, Meta's Muse handed user requests to human contractors.REPORTEDMIXEDFEATURECORRECTED IN COPYreuters.com
  5. 05According to Reuters, trained contractors could place calls to carry out tasks submitted through Meta's Muse assistant.REPORTEDMOSTLY TRUEFEATURECORRECTED IN COPYwhbl.com
  6. 06Meta rolled back Muse's human-contractor calling feature after disclosure concerns.REPORTEDMOSTLY TRUEFEATURECORRECTED IN COPYreuters.com
  7. 07According to the supplied topic brief, the described OpenAI GPT-6 prompt-caching update is intended to reduce latency for repeated prompts.VERIFIEDTRUEFEATUREopenai.com
  8. 08According to the supplied topic brief, the described OpenAI GPT-6 prompt-caching update is intended to reduce costs for repeated prompts.VERIFIEDTRUEFEATUREopenai.com
  9. 09Prompt caching reuses prior computation for repeated prompt content.REPORTEDMOSTLY TRUEFEATURECORRECTED IN COPYatlan.com
  10. 10Reuters's September 22, 2026 report did not provide the exact success rate for AI-only calls in Meta's Muse tests.VERIFIEDTRUEATTRIBUTIONfinance.yahoo.com
  11. 11Meta employees raised privacy concerns about human contractors handling requests submitted through Muse.REPORTEDMOSTLY TRUEATTRIBUTIONreuters.com
  12. 12Meta acknowledged inadequate disclosures about Muse's human-contractor calling feature.REPORTEDMOSTLY TRUEATTRIBUTIONCORRECTED IN COPYnytimes.com
  13. 13Reuters's reporting about Muse handing requests to contractors does not establish that Meta transferred live calls midway through conversations.VERIFIEDTRUEATTRIBUTIONreuters.com
  14. 14According to Reuters, a Meta executive called testing Muse's contractor-placed calls without proper disclosures “a miss.”REPORTEDMOSTLY TRUEATTRIBUTIONreuters.com
  15. 15Reuters reported that an employee said a transcript showed a contractor making a racist reference while handling a Muse request.VERIFIEDTRUEATTRIBUTIONreuters.com
  16. 16The supplied Reuters reporting does not establish whether Muse's reported 95% to 98% human-caller success rate required completing tasks under every user constraint.VERIFIEDTRUEATTRIBUTIONreuters.com
  17. 17Claim removed during the check; its text is not republished.REPORTEDMIXEDATTRIBUTIONCUT FROM COPYreuters.com
  18. 18The supplied Reuters reporting does not provide a precise quantitative comparison between human-caller and AI-only success rates in Meta's Muse tests.VERIFIEDTRUEATTRIBUTIONfinance.yahoo.com
  19. 19Claim removed during the check; its text is not republished.REPORTEDMIXEDATTRIBUTIONCUT FROM COPYreuters.com
  20. 20Claim removed during the check; its text is not republished.REPORTEDMIXEDATTRIBUTIONCUT FROM COPYabout.fb.com
  21. 21Claim removed during the check; its text is not republished.FAILEDFALSEATTRIBUTIONCUT FROM COPYmixed-news.com
  22. 22Claim removed during the check; its text is not republished.FAILEDFALSEATTRIBUTIONCUT FROM COPYopenai.com
  23. 23Claim removed during the check; its text is not republished.FAILEDFALSEATTRIBUTIONCUT FROM COPYopenai.com
  24. 24The article links to https://adam.new for the adam.new demo.VERIFIEDTRUEATTRIBUTIONadam.new

Every claim listed here was extracted from this article and checked against live sources before publication. The verdict is the checker's, not the writer's. Claims the check removed are counted but not republished.

Audit receipt KODA-20260924-2798043371C7
Filed underToolsDeep Dive24 September 2026
Browse the Deep Dive archive

Get the morning Signal

181 editions so far, one a day. Unsubscribe anytime.