AI engineering field guide · 01

Build the system
around the model.

A model can reason. A harness makes that reasoning useful: it supplies instructions, tools, memory, an execution environment, a control loop, recovery, evaluation, and visibility into what happened.

The short version

The model is an engine.
The harness is the vehicle.

The harness turns a model call into a dependable workflow. It decides what context the model sees, which actions it may take, where state lives, when to retry or stop, and how a person can inspect the result.

Watch in order

Six lessons.
One system view.

Start with the vocabulary, look at the code, then move into architecture and long-running work. Finish by comparing the principles with a compact implementation.

01 Understand

Vizuara21:04

The LLM Interview Series #9: What Is Harness Engineering?

Begin with the definition. Build a clean mental model of the layer that coordinates an agent before you get lost in frameworks.

What to notice

  • Where the model’s responsibility ends
  • What makes a harness different from one prompt
  • Why reliability comes from the surrounding system
02 Inspect

Sean‘s AI Stories20:49

You Can Learn AI Agent Harness In Real Code In 20 Min | Loop Engineering, Memory, Eval, Open Source

Move from diagram to code. Trace how the loop, memory, and evaluation layer cooperate instead of treating them as separate features.

What to notice

  • The plan → act → observe control loop
  • What should persist between model turns
  • Where evaluation enters the workflow
03 Operate

AI Engineer46:20

Harness Engineering: How to Build Software When Humans Steer, Agents Execute — Ryan Lopopolo, OpenAI

Zoom out from code to operating model. Learn how engineers shape the environment, express intent, and create feedback when agents do the execution.

What to notice

  • The repository as part of the agent environment
  • How constraints become executable feedback
  • Where human judgment stays essential
04 Architect

AI Engineer20:26

Harnesses in AI: A Deep Dive — Tejas Kumar, IBM

Pressure-test the architecture. Identify the harness’s responsibilities and draw useful boundaries around models, tools, state, and runtime.

What to notice

  • Which concerns belong inside the harness
  • How tool contracts limit ambiguity
  • What can be swapped without redesigning the system
05 Harden

AI Engineer75:40

Anthropic Workshop: Build Agents That Run for Hours — Ash Prabaker & Andrew Wilson

Take the long view. Explore what changes when an agent must survive context limits, recover from errors, and make progress over hours.

What to notice

  • Durable progress artifacts and clean handoffs
  • Context resets without losing the task
  • Independent checks before work is declared complete
06 Compare

AWS Developers5:02

What is an Agent Harness? (And How We Built One)

Finish with a concise case study. Compare the implementation choices with the principles you collected from the first five lessons.

What to notice

  • Which capabilities the implementation packages together
  • Where managed infrastructure removes work
  • What you would keep custom for your own use case

Your capstone

Build a tiny harness.
Make every part visible.

Keep the first version deliberately small. The goal is not autonomy; it is to understand the control surface well enough to explain every decision.

Suggested task

Give an agent a folder of notes and ask it to produce a sourced, one-page research brief.

  1. 01

    Define done

    Write the task, allowed sources, output format, and five acceptance criteria before the first model call.

  2. 02

    Limit the tools

    Start with one or two clearly described tools. Validate their inputs and return useful errors.

  3. 03

    Persist state

    Save a small progress file containing completed work, remaining work, decisions, and evidence.

  4. 04

    Run the loop

    Make plan → act → observe explicit. Log each step so you can explain why the next action happened.

  5. 05

    Design failure

    Add a time limit, step budget, retry rule, and a useful stop condition before something goes wrong.

  6. 06

    Write five evals

    Test success, missing data, conflicting evidence, a broken tool, and an instruction the agent must refuse.

  7. 07

    Keep a human gate

    Require approval before publishing, messaging, spending, deleting, or changing an external system.

Official reading

Go to the source.
Then build.

Use these three engineering articles to deepen the operating model, long-running architecture, and evaluation practice behind the videos.

The field note

A stronger model helps.
A stronger system compounds.

Watch one lesson, add one part to your harness, and keep the behavior observable. That is how a clever demo becomes engineering.