Topic Hub

Filed under Agent Evaluation

5 entries filed under this tag.

2026-09-1811 min read

AI Agent Latency Measurement: Find the Real Delay

AI agent latency measurement means tracing the whole user-visible path, not just timing the model call that feels easiest to optimize.

Rod Rivera

Harness Engineering10 min read

Agent Evaluation Environment: Freeze the Task Contract

An agent evaluation environment must freeze inputs, tools and an independent oracle, or the same message silently grades against two different answers.

Harness Engineering11 min read

AI Workflow Baseline: What Time Saved Actually Means

Build an AI workflow baseline that counts setup, review and repair, separates elapsed time from human effort, and keeps the task mix comparable.

Harness Engineering11 min read

LLM Model Routing Evaluation From Accepted Work Cases

Evaluate model routes on ordinary tasks, missing data and policy conflicts, then set acceptance thresholds before comparing cost savings.

Harness Engineering12 min read

Agent Regression Dataset: Save the Failure, Not the Fix

Learn to turn one failed agent run into an agent regression dataset that tests recovery without pretending to know the original cause.