AI Applied

Forward Deployed Engineer: the job of deploying AI

Three steps, four weeks to learn it, and why 95 % of AI projects return nothing.

Louis Graffeuil
Louis Graffeuil
Founder Tandem
August 29, 2026Published
7 minread
Two blocks, one pale and one dark, joined by a coral bridge, with a laptop resting on top

A Forward Deployed Engineer is an engineer who embeds with the client, understands how the work really gets done, and turns that understanding into working software. The role was born at Palantir. Artificial intelligence has just made it one of the most sought-after jobs in the industry.

The reason fits in one sentence. Intelligence has become a commodity, knowing where to put it inside a company has not. Tandem does this job every day, and this article describes what it covers, the three steps it breaks down into, and a four-week roadmap to learn it.

Why intelligence can no longer be a competitive advantage

Everyone has access to the same frontier models, on the same day, at the same price. A capability your competitor can buy this afternoon does not create a durable advantage. Raw intelligence has become a commodity, in the strict sense of the word.

So the advantage has moved elsewhere. It plays out in the where, the how and the why. Which precise process you inject that intelligence into, and with what guarantees. Two companies can run exactly the same models and get returns that bear no resemblance to each other. The difference is not the model.

The figure documenting that gap is well known. The report “The GenAI Divide: State of AI in Business 2025”, published in July 2025 by MIT's Project NANDA, measures that 95 % of enterprise generative AI projects produce no measurable return. The study rests on 150 executive interviews, 350 employee surveys and an analysis of 300 public deployments. Its diagnosis is organisational, not technological.

We covered that gap from the return-on-investment angle in our article on companies that see no ROI on AI. This article takes the other end of the problem, the job that moves a project from the wrong side of that statistic to the right one.

What is a Forward Deployed Engineer?

Someone has to decide where intelligence belongs inside an organisation. That is the Forward Deployed Engineer, often shortened to FDE. Palantir invented the post to describe engineers sent directly to the client, tasked with solving that client's problem rather than building a generic feature.

The role demands two judgements that rarely coexist in the same person. Business judgement covers workflows, exceptions, costs, risk and adoption. Technical judgement covers models, APIs, data, reliability and what holds up in production. An FDE turns business understanding into software that works.

The two judgements of the Forward Deployed Engineer, business and technical, crossing to produce a working system
The scarcity of the profile does not come from technical difficulty. It comes from the fact that those two judgements rarely sit in the same person.

The market has already decided, and it put 4 billion dollars in

In May 2026, OpenAI launched a joint venture dedicated to deployment, the OpenAI Deployment Company, and acquired the consultancy Tomoro alongside it. The deal brings roughly 150 Forward Deployed Engineers and deployment specialists from day one. Initial capital exceeds 4 billion dollars, provided by a consortium of 19 investment firms, consultancies and system integrators led by TPG.

The intent is clear. This is not about selling more models, it is about going and installing them at customer sites. When the leading model vendor builds an entire structure for deployment, it is acknowledging that value no longer sits in the model alone.

Step 1, understand how the work really gets done

The documented process is almost never the real process. An email arrives, it is copied into a spreadsheet, checked in an internal tool, approved on a team messaging app, then re-entered into the ERP. Half the cases are exceptions, and their logic lives in one person's head.

Comparison between the four-step documented process and the real process, jagged and full of exceptions
That gap cannot be captured over a video call. You see it by watching a typical day, sitting next to the team.

That is why our AI audit starts in the field before costing anything. On a recent assignment in a network of health centres, several of the most expensive friction points appeared in no document. Two of them were solved by switching on features already present in the group's tools, without a line of code.

Step 2, decide where AI belongs and where it does not

On a ten-step workflow, two or three steps require judgement. The rest is settled with conditions and API calls. Whenever determinism is possible, use it, and reserve the language model for the judgement zones. That split is what separates a system that holds from a demo that impresses.

  1. Deterministic software when the rules are predictable. Cheaper, faster, testable, and it does not start improvising on a Monday morning.
  2. An agent when the goal is clear but the path varies. That is where the model adds something no written rule replaces.
  3. A human when the decision is irreversible. A refund, a cancellation or a coverage refusal is not delegated to a probabilistic system.
On a ten-step workflow, the steps handled by deterministic software, by an agent and by a human
Two steps handed to an agent, one kept by a human, seven in classic software. That is the most common split on our assignments.

This reasoning overlaps the four levels of automation we detail in our articles on levels of automation and on the difference between agents and workflows. The most frequent mistake is jumping straight to the autonomous agent, when a configured assistant or a simple automation is enough in most cases.

Step 3, prove the system holds rather than promising it

As soon as there is judgement, there is non-determinism. Evals turn that non-determinism into proof. The principle is simple. You build a set of cases, you measure the success rate, and you sort the failures into categories.

  • The normal case, the one the system will meet most often.
  • The edge case, still within scope, but only just.
  • Missing information, to check the system can say that it does not know.
  • The ambiguous request, to check it asks for clarification instead of inventing.
  • The risky action, to check it stops and hands over.
An evaluation case set split into five families, with successes and categorised failures
A piece of code written by a model is not finished until a set of evals verifies that it works. This is the step almost nobody does.

Colin Jarvis, head of forward deployed engineering at OpenAI, gives the sharpest illustration of this in his interview with Altimeter. On a deployment run at a wealth management firm, the main technical hurdle was cleared in six to eight weeks. It then took four more months of pilots, eval collection and iteration before advisers genuinely trusted the system. In the end, almost all of them adopted the tool.

OpenAI's head of forward deployed engineering on the deployments his team runs, and what makes them fail.

The full loop, from audit to improvement

The three steps chain into a loop that never stops. Audit, build, evals, deployment, observation, improvement. Then the loop starts again, because a format changes, a product evolves and a model gets updated.

The AI deployment loop, from audit to improvement through evals and observation
Deployment is built on top of the existing stack. You connect the CRM and ERP already in place rather than reinventing the wheel.

That is the logic Tandem applies on its assignments, and it is described step by step in our AI audit method. Diagnosing the real process always comes before a single line of code.

How to become a Forward Deployed Engineer in four weeks

The role is learnt by building, not by reading. Here is the roadmap I give to people who want to move into this job. It assumes you can code a little, and that you have a real process to automate, however small.

WeekGoalWhat must exist at the end
1A loop that runsAn agent completing a real end-to-end workflow, two tools, guardrails, an audit log
2A system that holdsStructured JSON outputs, schema validation, identified failure modes, restart from the last checkpoint
3A measured costRetry with backoff, failure taxonomy, hand-annotated reference dataset, cost per request
4A defensible systemThe architecture, what v1 got wrong, the evals and the economics, explained to an engineer and to an executive alike
Four weeks to build a use case you can defend on both sides of the table

Week four is the one that separates people. You must be able to explain the same system to an engineer and to a non-technical executive. The pain point, why AI belongs here, the architecture, what the first version got wrong, the evals, and what it costs. A candidate who can only defend the technical half is not yet an FDE.

Should you hire an in-house FDE or work with a partner?

Both work, and they serve different moments. An external partner brings the perspective of dozens of deployments and moves fast on the first use cases. An in-house FDE knows the company's own exceptions and holds the improvement loop over time.

The sequence that works is almost always the same. A partner scopes and ships the first two or three cases, training the person who will take the subject over along the way. Then the company brings it in-house. On an assignment at a digital health software vendor, the closing session was run by the internal team, and the support role was already internalised when Tandem left.

The counter-example to avoid is hiring a single FDE with no written process and no document foundation. They will spend their first six months doing archaeology rather than deployment. A clean document corpus conditions half the projects that follow.

Where to start if you want to deploy AI seriously?

Start with the real process, not with the model. Sit for a day next to the team doing the work, and write down what you see. That is the starting point of the carousel I published on the job of deploying AI, and it is also the starting point of every one of our assignments.

Then draw the line between what belongs to determinism and what belongs to judgement. Then build the evals before promising anything. Those three moves are enough to escape the 95 % of projects with no measurable return, and none of the three depends on the model you picked.

One last thing. If your system cannot say that it is unsure, it is not ready to touch a production process.

Frequently asked questions

What is a Forward Deployed Engineer?

An engineer who embeds with the client to turn business understanding into working software. Unlike a classic software engineer building one capability for many clients, an FDE builds many capabilities for a single client. Unlike a consultant, they ship the system, measure it and maintain it. The role was created at Palantir, and generative AI made it central.

What is the difference between an FDE and an AI engineer?

The AI engineer optimises the system, the FDE decides where to put it. The former works on models, data pipelines and performance. The latter spends a large share of their time at the client site, mapping the real work and deciding what requires judgement and what can stay deterministic. An FDE carries two judgements, business and technical, and that combination is what makes the profile rare.

What are evals and why are they mandatory?

Evals are a set of test cases that measure the success rate of a non-deterministic system and sort its failures into categories. They cover the normal case, the edge case, missing information, the ambiguous request and the risky action. Without them you cannot prove a system works, you can only claim it. A piece of code written by a model is not finished until a set of evals verifies it.

How long does it take to deploy an AI use case in a company?

Budget about three times the technical part. On a deployment run by OpenAI's team at a wealth management firm, the technical hurdle was cleared in six to eight weeks, then it took four more months of pilots and evals before users trusted the system. A plan that stops at go-live covers roughly a third of the real work.

Why do 95 % of AI projects return nothing?

Because the problem is organisational, not technological. The MIT Project NANDA report, published in July 2025 on the basis of 150 executive interviews and 300 analysed deployments, calls it a learning gap. A generic tool does not adapt to a company's workflows without context, governance and integration. That is precisely the work a Forward Deployed Engineer does.

Read next

All articles
AI AppliedIllustration of Claude Code training, a laptop wearing a graduation cap

Claude Code training: the path for people who do not code

By Louis Graffeuil
AI AppliedIllustration of Claude Skills, a cabinet with three drawers pulled out to different depths, one coral drawer holding a folder

Claude Skills and Projects, why the prompt is no longer the right unit of work

By Louis Graffeuil
AI AppliedIllustration of a tabbed ring binder, a metaphor for the Claude training context folder

Claude training for teams: what actually moves the needle

By Louis Graffeuil