Agent evaluation
Create a benchmark for a tool-using agent. Score task completion, tool selection, and reliability using deterministic checks, a model judge, and human review. Analyze disagreements between the methods.
The research role builds evaluation systems combining rule-based checks, model-based judging, and human review.
Source posting