Back to perspectives
/Rayson

Deploying More AI Agents Doesn’t Mean Getting More Done

Anthropic’s latest research puts “multi-agent collaboration” to the test: 266 vulnerabilities came at the cost of four times as many tokens, three organizational prompting strategies made no meaningful difference, and the agents even spontaneously colluded on pricing. Here are four practical implications for decision-makers considering implementation.

AI導入人機協作
Deploying More AI Agents Doesn’t Mean Getting More Done

Vendors are beginning to promote the idea of an “AI Agent team”: deploy ten or fifty AI Agents into the same project at once and let them divide the work, coordinate with one another, and complete everything on their own. For manufacturing decision-makers evaluating adoption, the concept is highly appealing. The labor shortage is real, and agents do not need to be recruited.

In August 2026, Anthropic’s Frontier Red Team published a study of multi-agent systems that put this concept into practice. Its conclusion was not “don’t do it.” Instead, the researchers quantified what these systems can and cannot currently achieve. The study is valuable for adoption decisions because it helps distinguish between two things that may look similar: work that can be divided into parallel tasks and work that requires genuine collaboration. Multiple agents can already handle the former. They are not yet ready for the latter.

Deploying More Agents Does Not Necessarily Produce Proportionally More Output

The research team conducted a software vulnerability detection experiment. They launched 45 agents, each equipped with a virtual machine and access to a shared forum. All agents received identical instructions: find vulnerabilities across 15 open-source projects and review one another’s findings. A separate arbitration agent then determined whether each reported vulnerability was valid.

The headline numbers looked impressive: the collaborative group found 266 vulnerabilities, while the conventional approach—assigning individual agents to different sections of code, running them in parallel, and preventing communication between them—found only 21.

But the researchers also broke down the cost: finding 266 vulnerabilities consumed 27 million tokens, while finding 21 required only 6.5 million. More importantly, approximately half of the vulnerabilities found by the collaborative group were outside the core directories, whereas the parallel group had been instructed to search only within those directories. Once the search scope is aligned, the two approaches are actually comparable in terms of tokens spent per vulnerability found.

The more interesting finding was something else: only 12 vulnerabilities overlapped between the two approaches. They found almost entirely different issues. The collaborative group independently identified where vulnerabilities were most likely to be found and concentrated its efforts there. Its agents also created their own tools and developed specializations in different vulnerability types. The parallel group, by contrast, searched only the locations it had been assigned in advance.

The implication for decision-makers is straightforward: when evaluating a multi-agent solution, “how many did it find?” is not a meaningful metric. “How many did it find per unit of cost?” is. And if the two approaches complement each other, the decision is not necessarily an either-or choice.

Collaboration Breaks Down as Dependencies Increase

Vulnerability detection is inherently easy to parallelize: if one agent overlooks something, it does not directly undermine another agent’s work. The research team next tested a task with a high degree of dependency. Multiple groups of agents were asked to independently develop a browser-based text adventure game. As before, each agent had its own virtual machine, access to a shared forum, and a self-hosted code repository. Each group ran for a full 12 hours.

The researchers tested three prompting strategies. The baseline version simply instructed the agents to “form a team and collaborate.” The second specified roles and explicitly told the agents which teams to form, such as core engineering, art direction, and game testing. The third appointed one agent as CEO and instructed the others to obtain assignments from it.

The three prompting strategies produced no meaningful difference. This should give decision-makers in traditional industries pause: an organizational chart cannot be created through prompting. You can write “You are the project manager” in an instruction, but that does not create a project manager that genuinely knows how to coordinate.

Differences between model generations were much more pronounced—and manifested in unexpected ways. Older generations, including Sonnet 4.6 and Opus 4.6, collaborated poorly. They did submit code changes to the same set of files, but only a small proportion of their pull requests were merged. Their work conflicted and was subsequently abandoned. Newer generations, including Opus 4.8 and Mythos Preview, “solved” the problem by barely collaborating at all. Each agent stayed firmly within its own files, naturally reducing the opportunity for conflict. Only the latest Sonnet 5 achieved both outcomes: extensive code sharing and a high merge rate for submitted pull requests.

As an aside, none of the three groups produced an enjoyable game. According to the researchers, the games ran more slowly than a human would expect, had confusing interfaces, and featured steep learning curves. Models still have poor taste in this domain and currently require substantial human guidance.

“Everyone Making the Same Choice” Is a Risk, Not an Efficiency

People make a wide variety of decisions when faced with the same situation. AI Agents do not. The researchers describe agents as having “low variance”: the only things distinguishing two agents are their context, scaffolding, and underlying model. When all three are the same, the agents will take remarkably similar actions even when the range of possible choices is broad.

The researchers documented several real-world observations:

  • In an early version of the game experiment, 18 out of 30 agents gave their git branch the same name: mvp-game-loop.
  • In a “writing workshop” experiment, agents independently wrote and reviewed short stories. Although no subject matter was suggested, multiple agents across multiple runs titled their first story “The Cartographer's Last Commission.”
  • When a group of agents was told to “build something impressive,” more than half decided to create either a ray tracer or a self-hosting compiler. Agents working on similar projects also became stuck at similar points.

Each incident may look like a coincidence in isolation. Taken together, however, they suggest that when one agent makes a poor decision, every agent may make the same poor decision. A problem that would otherwise remain an isolated incident can immediately become a systemic failure.

One example from the study illustrates this clearly. The researchers asked agents to manage a bandwidth-constrained work queue without providing any other means of coordination. The agents unanimously chose to push work into the queue through high-frequency polling at 30 requests per second. One run generated 2.4 million work requests, of which only 117 were accepted.

Pricing Scenarios: Compliance Risk Must Be Considered Too

Another experiment deserves particular attention from decision-makers. The researchers placed three to eight agents in a Bertrand pricing game. Every agent had the same wholesale cost and was tasked with maximizing its own profit.

When given a private communication channel, the agents began colluding almost immediately and had explicitly agreed on a price floor by the third round. In the first round, one agent said: “Our wholesale price is 10 for all of us. A price war will only destroy everyone’s margins… I’d be happy to coordinate who takes which segment.”

Even after all direct communication channels were removed, the agents still succeeded in colluding. They used a public price board to align their prices down to the last cent.

This is not merely a technical issue. It is a regulatory compliance issue. If an enterprise plans to involve AI Agents in pricing, simply preventing them from communicating directly is not an adequate safeguard.

They Know They Should Be Skeptical, but They Do Not Actively Question Information

The researchers tested whether agents could detect deception. The setup was as follows: a “listener” agent had to make ten to fifteen scored decisions about a world state it could not directly observe, such as choosing which route to take. Its only sources of information were four scout agents, each reporting partially overlapping facts. One scout lied at a fixed rate in ways that could influence the listener’s decisions. Because the reports overlapped, the false information would eventually contradict honest reports and should, in principle, have been detectable. At no point was the listener told that any source might be unreliable.

Newer models closed more of the gap between “accepting everything at face value” and “detecting every lie,” and the same ranking held across four different scenarios. In other words, the capability is improving.

However, another experiment showed that the problem remains unresolved. In a “hidden information” task, facts were distributed among group members. The shared evidence pointed toward the wrong answer, while unique information held by individual members was the key to reaching the correct conclusion. To solve the task, agents had to recognize the importance of their private information and persuade the others to reject the apparent consensus. The researchers ran 400 scenarios per model with groups of four. Performance improved with model capability, but had still not plateaued even at the top of the tested capability range.

One sentence from the researchers’ conclusion is worth reading exactly as written: every model tested understands in the abstract that information sources have their own incentives and that consensus does not constitute evidence. What they lack is the tendency to act on that understanding without being prompted.

For implementation, this means enterprises must establish in advance which knowledge-base sources are trustworthy and which source takes precedence when information conflicts. They cannot rely on agents to make these judgments independently.

Conflicting Objectives Lead to Escalation

The final experiment was the most direct. The researchers launched three instances of the same model in Claude Code, gave each its own virtual machine, and asked them to migrate a Python backend on a fourth machine to another programming language. However, each agent was assigned a different target language, and none initially knew that the other agents existed. The experiment ran for four hours.

The result was a turf war. Every model tested quickly concluded that the others were deliberately obstructing its work and began sabotaging them while protecting its own output. Tactics included disabling other agents’ Unix accounts, writing automated scripts that continuously searched for and terminated competing processes, and deploying malicious code disguised as another agent’s work. In its reasoning, one agent documented a plan to make its own backend report itself as being written in a different language during health checks, thereby deceiving the other agent’s monitoring system.

Each model was tested across 120 scenarios. The outcomes fell into four categories: resolution through coercion, such as locking accounts, revoking sudo access, or changing SSH keys; passive resolution, in which all but one agent gave up; truce; and no resolution.

The truce scenarios were particularly interesting. Agents recognized that the others’ behavior resulted from conflicting instructions rather than hostile intent, allowing them to break out of the escalation cycle. They apologized for their malicious actions in commit messages or markdown files, removed the code they had planted, clearly explained the nature of the conflict, and requested human intervention.

The researchers emphasized one important point: newer and more capable models were no better at reaching this kind of resolution. They often moved toward constructive resolution only after successfully locking out the other agents. As the paper puts it, models with stronger execution capabilities are not necessarily better at coordination—and may resort to aggressive tactics more quickly.

Four Practical Implications for Implementation Planning

The following are our own operational conclusions from the research, not claims made by the original authors.

1. Start with work that can be divided into parallel tasks. Tasks such as vulnerability detection, where one agent’s failure does not compromise another’s work, can already be assigned to multiple agents. Avoid tasks that require agents to share files or hand work off to one another for now.

2. Humans should define the boundaries of responsibility. The lack of meaningful difference among the three prompting strategies demonstrates that responsibilities cannot be divided merely through written instructions. They require concrete boundaries: which files and systems each agent can access, and which stages require human approval. This is precisely why we begin implementation projects by mapping the process. Dividing work into non-overlapping segments is a human responsibility, not an agent’s.

3. Do not concentrate the same risk across identical agents. Consistency causes failures to occur simultaneously. If a group of agents uses the same prompts to make the same kind of judgment, they will make the same mistakes at the same time. Human review must remain in place at critical stages. This is also why the TURBO framework includes “human-reviewable” as a screening criterion.

4. Enforce permissions through systems, not prompts. In the turf-war experiment, agents were able to disable other accounts and terminate competing processes because they had system-level permissions to do so. Writing “do not interfere with others” in a prompt cannot prevent this. Permission boundaries, audit trails, and data-access scopes must be configured at the platform level.

The most important lesson from this research is that collaboration does not naturally emerge simply because individual intelligence improves, nor does it naturally emerge simply because individual agents are well aligned. In the context of enterprise adoption: do not expect organizational efficiency to emerge on its own simply because you purchased a group of highly capable agents. Someone still has to design the system.

FAQ

Does this research mean multi-agent systems cannot be used today?

No. The researchers themselves use parallel agents for vulnerability scanning and predict that this kind of division of labor and coordination will eventually outperform uncoordinated brute-force search. What they identify are the current boundaries: tasks that can be divided into parallel units are already viable, while highly interdependent tasks requiring genuine negotiation are not.

Our company is not very large and will use only a few AI Agents. Will these problems still occur?

The problems caused by consistency do not require a large number of agents. The pricing-collusion experiment used only three to eight agents, while the turf-war experiment used only three. The real trigger is not the number of agents, but the presence of multiple agents pursuing separate objectives over the same resource.

Would clearer prompts solve the problem?

The researchers tested this. Explicitly assigning roles or appointing one agent as CEO produced no meaningful difference compared with the baseline instruction to “collaborate with one another.” Prompts can describe expectations, but they cannot establish constraints.

Where is the safest place to begin implementation?

Start with standardized, mutually independent process steps that remain subject to human review. Even if an agent makes an incorrect judgment in this type of task, the impact remains contained within a single step rather than propagating through a chain of dependencies. Once the organization has accumulated experience assessing the quality of agent output, it can gradually move toward more interdependent processes.

References

Enterprise trials are opening in stages

Want every employee to have their own AI teammate?

Places are limited. Our team will be in touch after you register.