AI agents

Agent orchestration

In short

Agent orchestration is the flow of agents in an application: which agents run, in what order, and how the next step is decided, by a language model, by code, or by a mix of the two1.

Also called
AI agent orchestration, Multi-agent orchestration
Topic
AI agents
Level
Some background helps

The OpenAI Agents SDK describes two patterns, and says they can be mixed. In the first, an agent is given an open-ended task and the model plans how to tackle it, using tools to take actions and acquire data, and using handoffs to delegate tasks to sub-agents1. One form is a manager that keeps control of the conversation and calls specialist agents as tools. Another is a triage agent that routes the turn to a specialist, who then remains the active agent for the rest of the turn1.

In the second pattern, code chooses the route. The SDK says this is more deterministic and more predictable for speed, cost and performance1. Code can pass one agent’s output in as the next agent’s input, run an evaluator in a loop until the evaluator says the output passes, or run agents that do not depend on each other at the same time1. One chaining example decomposes a blog post into research, an outline, the post, a critique and an improvement1.

Anthropic draws a related line. A workflow orchestrates models and tools through predefined code paths. An agent is a system in which the model directs its own process and its own tool use2. Agentic systems often trade latency and cost for better task performance, and Anthropic says to add that complexity only when it demonstrably improves the outcome2. In its orchestrator-workers pattern, a central model splits a task, delegates the parts and combines the results. The examples it gives are coding work that changes several files, and search that draws on several sources2.

Example

OpenAI’s orchestration guide gives writing a blog post as a chaining example: research, an outline, the post, a critique, then an improvement. Each step’s output becomes the next step’s input1.

Why it matters

Orchestration is the decision about which agent runs next, and who makes that decision1. Letting the model choose suits an open-ended task. Fixing the path in code makes the speed, cost and performance more predictable1.

Questions people ask

Is agent orchestration the same as a multi-agent system?

Orchestration is the flow between agents: which ones run, in what order, and whether a language model, code, or a mix of the two decides the next step1. That flow can be several agents. Anthropic separately uses workflow for a path fixed in code, and agent for a model that directs its own tool use2.

How does agent orchestration work?

Either a language model plans the task, calls tools and hands work to other agents, or code selects the next step, for example by chaining outputs or running independent agents together. The OpenAI Agents SDK says the two patterns can be combined1.

Does more orchestration make an AI system better?

Not by itself. Anthropic says agentic systems often trade latency and cost for better task performance, and that extra complexity should be added only when it demonstrably improves the outcome2. The OpenAI SDK says a code-defined flow is more predictable for speed, cost and performance1.

Related terms

Tools that use it

Sources

  1. OpenAI Agents SDK, Agent orchestration
  2. Anthropic (2024), Building effective agents

Back to the glossary