Evaluations help you check whether an agent behaves correctly across repeated test cases. Use evaluations when you need evidence that an agent change improved or preserved behavior.

​
Evaluation routes

Frontend route:
Backend routes:

​
Evaluation workflow

1

Create an evaluation set

Group related test cases under one evaluation set.
2

Add cases

Add prompts and expected criteria for the target agent behavior.
3

Run the evaluation

Execute the evaluation set against an agent.
4

Review the run

Inspect run output and compare results over time.

​
When to evaluate

  • Before publishing an agent.
  • After changing tools or model configuration.
  • After changing the agent instruction.
  • After backend execution changes.
Keep evaluation cases small and tied to real user questions. Broad prompts are harder to diagnose when they fail.