Most enterprise AI work stalls in the space between a promising demo and a system that people rely on every day. The forward-deployed engineering (FDE) model was built for exactly that space: a senior engineer works inside the customer's environment, on the customer's data and workflow, until the system is in production and proven. This playbook sets out how to scope, run and land an FDE mission, from the first working session to a clean handover.
Why the forward-deployed model exists
The term comes from Palantir, which split its engineering organization into two roles. Product engineers focus on "one capability, many customers," building the core platform. Forward Deployed Software Engineers, known internally as Deltas, focus on "one customer, many capabilities," deploying and customizing the software at the customer site to solve a specific business problem, and building missing features when that is what stands between the customer and a successful outcome1.
The model has since moved to the center of generative AI delivery. OpenAI's own FDE job description asks engineers to "embed closely with customer teams," to "own technical delivery across multiple deployments from first prototype to stable production," and to measure success "through production adoption, measurable workflow impact, and eval-driven feedback"2. Those three phrases are a compact definition of the job: embedded, accountable for production, and measured on outcomes.
The reason this matters is the scale of the gap between pilots and production. MIT NANDA's The GenAI Divide: State of AI in Business 2025 reports that despite $30–40 billion in enterprise investment, 95% of organizations are getting zero return from generative AI, and only 5% of custom enterprise AI tools reach production3. The same research found that external partnerships with learning-capable, customized tools reached deployment about 67% of the time, compared with about 33% for internally built tools34. RAND's interviews with 65 experienced data scientists and engineers identified the leading root cause of failure as a misunderstanding or miscommunication of the problem that AI is meant to solve5. An engineer who sits with the people doing the work closes that gap directly.
An FDE mission is measured by one thing: whether a real workflow runs differently, in production, with numbers that the business accepts.
The shape of the team
An FDE mission works best with a small, senior team and a short line of accountability. At Quantabase this unit is the Mission Pod: a senior forward-deployed engineer paired with a delivery lead, drawing on specialists from a vetted expert network when the work calls for them.
| Role | Primary responsibility | Typical time on mission |
|---|---|---|
| Senior forward-deployed engineer | Builds the system in the customer environment: data access, retrieval, prompts and tools, evaluation harness, deployment, observability | Full time |
| Delivery lead | Owns scope, milestones, stakeholder cadence, risk log and evidence packs for each gate | Full time or near full time |
| Domain specialist (as needed) | Defines what "correct" means for the workflow, labels the gold set, reviews edge cases | Part time, front-loaded |
| Customer business owner | Owns the outcome after launch; approves the accuracy bar and go/no-go decisions | Two to four hours per week |
| Customer platform and security contacts | Grant access, review architecture, approve production change | As scheduled at each gate |
The defining feature is that the engineer who builds the system is the same person who sits with its users. Feedback does not travel through a requirements document; it travels across a desk.
The week-by-week plan
A typical mission runs six to twelve weeks, with the first production release inside two weeks. The early release is deliberately narrow: a real slice of the workflow, live on real data, used by a small group, with monitoring in place. Everything after that widens coverage and raises confidence.
Week 0: the working session
Before any contract is finalized, the pod and the customer spend a half day working through the target workflow together. The goal is a shared, written view of the problem rather than a sales presentation.
- Walk the workflow. Observe or replay ten to twenty real cases end to end, noting every system touched, every judgment call and every handoff.
- Size the economics. Record volume per month, minutes per case, cost per case and the current error or rework rate.
- Locate the data. Identify where inputs live, who owns them and what access will require.
- Agree the business owner. One person who will own the outcome after launch.
- Draft the definition of done. A first version of the accuracy bar, coverage target and adoption target.
Week 1: scope and foundations
- Finalize the mission charter: in-scope case types, excluded case types, success metrics and milestone gates.
- Secure data and system access through the customer's normal security process.
- Build the gold evaluation set: 100–300 real, labeled cases that represent the workload, including known hard cases.
- Stand up the evaluation harness so every change is scored against the gold set before it ships. OpenAI's FDE team and its customers have used this eval-first approach in production; Morgan Stanley, for example, ran summarization evals graded by advisors and daily regression tests before scaling its assistant, which is now used by over 98% of advisor teams6.
- Agree the exception path: what happens when the system is unsure, and who receives those cases.
Week 2: first production release
The first release goes live for a limited group of users on a limited slice of cases. It runs in the customer's environment, behind the customer's authentication, with logging, cost tracking and an exception queue in place. In many missions the first release runs in shadow or assisted mode, where the system drafts and a person decides, so value and accuracy can be measured without operational risk.
Weeks 3–8: widen, harden and prove
| Weeks | Focus | Typical outputs |
|---|---|---|
| 3–4 | Coverage and accuracy | Additional case types, error analysis on misses, prompt and retrieval improvements, accuracy trend against the gold set |
| 5–6 | Integration and hardening | Write-back to systems of record, role-based access, adversarial testing, load and cost testing |
| 7–8 | Adoption and handover | Wider user rollout, runbooks, dashboards, training, transfer of ownership to the customer team or an operating partner |
Longer missions of up to twelve weeks usually add a second workflow or a deeper integration, following the same rhythm.
Definition of done
"Done" is written down in week one and approved by the business owner. A useful definition has five parts:
- Accuracy: the system meets or exceeds the agreed bar on the gold set and on a sample of live production cases.
- Coverage: a stated share of incoming cases is handled by the system, with the rest routed to people through the exception path.
- Adoption: a stated share of target users rely on the system in their daily work.
- Unit economics: cost per task is measured and within the agreed range.
- Operability: monitoring, alerting, runbooks and an accountable owner are in place.
If a criterion cannot be measured, it does not belong in the definition of done. Every item should map to a number, a dashboard or a document that someone outside the delivery team can inspect.
Evidence gates per milestone
Each milestone closes only when its evidence clears, and at Quantabase milestone payments follow the same rule. This keeps both sides focused on results rather than activity. The table below shows representative gates; the specific thresholds are set with the customer for each workflow.
| Milestone | Evidence required | Who reviews |
|---|---|---|
| M1: Scope agreed | Mission charter, baseline metrics for the current process, labeled gold set, data access confirmed | Business owner, delivery lead |
| M2: First production release | System live in customer environment for the agreed pilot users; logs, cost tracking and exception queue active; first accuracy reading on gold set | Business owner, platform owner |
| M3: Accuracy bar met | Gold-set score at or above the agreed bar; live-sample audit by domain reviewers; error analysis of remaining misses | Business owner, domain reviewers |
| M4: Security and resilience | Adversarial test report with findings triaged; access controls reviewed; load and cost test results | Security lead, platform owner |
| M5: Handover complete | Runbooks, dashboards, training records, on-call ownership confirmed; adoption and cost per task reported against targets | Business owner, operating team |
Roles and RACI
Clear accountability prevents the most common slowdowns: waiting for access, waiting for labels and waiting for decisions. R = Responsible, A = Accountable, C = Consulted, I = Informed.
| Activity | FDE | Delivery lead | Business owner | Domain specialist | Security / platform |
|---|---|---|---|---|---|
| Mission charter and scope | C | R | A | C | I |
| Data access and environment | R | C | I | I | A |
| Gold set and accuracy bar | R | C | A | R | I |
| Build and evaluation harness | A/R | I | I | C | C |
| Production change approval | R | C | C | I | A |
| Milestone evidence packs | R | A | C | C | C |
| Go/no-go for wider rollout | C | R | A | C | C |
| Post-launch ownership | C | R | A | I | C |
Risks and how to handle them
Independent research points to a consistent set of failure modes. Gartner predicted that at least 30% of generative AI projects would be abandoned after proof of concept by the end of 2025, citing poor data quality, inadequate risk controls, escalating costs and unclear business value7. S&P Global Market Intelligence found that the average organization scrapped 46% of AI proofs of concept before they reached production8. Each of these causes has a practical countermeasure inside a mission.
| Risk | Early signal | Response |
|---|---|---|
| Unclear business value | No baseline metrics by end of week 1 | Hold M1 until baseline volume, time and cost per case are recorded |
| Data access delays | Access requests open after day five | Escalate through the business owner; start with a sanctioned extract while full access is approved |
| Data quality gaps | Gold-set labels disagree between reviewers | Run a labeling calibration session; narrow scope to case types with consistent ground truth |
| Scope expansion | New case types requested mid-mission | Log them in a backlog for a follow-on mission; protect the current definition of done |
| Rising cost per task | Token or tool spend above forecast | Profile calls, cache retrieval, route simpler cases to smaller models |
| Low adoption | Pilot users revert to the old process | Sit with users, fix friction in the interface, adjust where the system appears in the workflow |
| Security or compliance concerns | Late questions from security review | Invite security to the week 1 architecture review; schedule adversarial testing before wider rollout |
Handover and knowledge transfer
A mission is landed when the customer can run the system without the pod. MIT NANDA's research notes that successful organizations treat AI vendors more like business service partners than software providers and empower frontline managers rather than centralized labs3. Handover puts that principle into practice.
- Pair from week five. A customer engineer pairs with the FDE on every change, so the code and its reasoning are familiar before the final week.
- Document the operating model. Runbooks cover deployment, rollback, prompt and model updates, evaluation reruns and exception handling.
- Transfer the evaluation harness. The gold set and scoring scripts are the most valuable artifacts; the customer team should be able to rerun them on demand.
- Hand over dashboards. Accuracy on sampled live cases, coverage, exception volume, latency and cost per task, each with an owner and an alert threshold.
- Confirm ownership. The business owner and operating team accept the system in writing, or an operating partner takes on monitoring. At Quantabase, Operate provides this ongoing coverage for accuracy drift, cost per task and exceptions.
Metrics that matter
McKinsey's 2026 State of AI survey found that only about 6% of respondents qualify as AI high performers, and that nearly three-quarters of those high performers have fundamentally redesigned workflows because of AI9. High performers are also twice as likely to report defined processes to measure the impact of their AI initiatives9. Measurement is part of the work, not an afterthought.
| Metric | Definition | Why it matters |
|---|---|---|
| Time to first production release | Days from kickoff to live use by pilot users | Indicates whether the mission is building in the real environment |
| Task accuracy | Share of cases meeting the agreed correctness standard, on gold set and live samples | The primary quality measure for the business owner |
| Coverage | Share of incoming cases handled without human rework | Determines the size of the economic return |
| Exception rate and resolution time | Share of cases routed to people and how quickly they are closed | Shows whether the human path is working |
| Cost per task | Model, tool and infrastructure cost divided by completed tasks | Keeps unit economics visible as volume grows |
| Adoption | Active users as a share of target users | Confirms the system has become part of the workflow |
| Cycle time | End-to-end time per case before and after | Translates system performance into business value |
These metrics map naturally onto the NIST AI Risk Management Framework's Measure and Manage functions, which provide a voluntary, widely recognized structure for tracking trustworthiness across the AI lifecycle10.
An FDE mission succeeds when four things are true at the end: the system is live, the numbers are agreed, the exception path works, and someone inside the customer organization owns the outcome.
A short checklist for mission leads
- Is there a single business owner with authority to approve the accuracy bar?
- Are baseline volume, time and cost per case recorded?
- Is there a labeled gold set that reflects real cases, including hard ones?
- Does every change run through the evaluation harness before release?
- Is the first release in production, with real users, within two weeks?
- Does each milestone have a written evidence pack reviewed by someone outside the build team?
- Has the system been adversarially tested before wider rollout?
- Are runbooks, dashboards and ownership confirmed before the pod steps back?
The forward-deployed model works because it removes distance: between the engineer and the user, between the build and production, and between activity and evidence. Run with discipline, it turns a promising pilot into a system the business depends on.
Sources
- Dev versus Delta: Demystifying engineering roles at Palantir — Palantir, 2019
- Forward Deployed Engineer (FDE), San Francisco — OpenAI Careers, accessed 2026
- The GenAI Divide: State of AI in Business 2025 — MIT NANDA (Challapally, Pease, Raskar, Chari), 2025
- MIT report: 95% of generative AI pilots at companies are failing — Fortune, 2025
- The Root Causes of Failure for Artificial Intelligence Projects and How They Can Succeed — RAND Corporation, 2024
- Morgan Stanley uses AI evals to shape the future of financial services — OpenAI, accessed 2026
- Gartner Predicts 30% of Generative AI Projects Will Be Abandoned After Proof of Concept By End of 2025 — Gartner, 2024
- AI project failure rates are on the rise: report (S&P Global Market Intelligence data) — CIO Dive, 2025
- The state of AI in 2026: On the road to ROI — McKinsey & Company, 2026
- AI Risk Management Framework — National Institute of Standards and Technology, 2023
Run this playbook with us
Book a thirty-minute working session. You will leave with a written scope, a price range and a clear first milestone.
Book a working session →