Evaluation harnesses for AI agents
Prepare a short outline of how you would define correctness for a multi-step agent and design a regression test suite. Practice explaining how you would turn production failures into test cases.
The role's first ownership area is designing the eval harness, defining correctness for multi-step agent trajectories, and building regression gates.
Source posting