Skip to content

resource

Agent Evaluation: Solutions Guide

Study agent evaluation in Chapter 16. Find the matching worked notebooks and compare their reasoning with the attempt you saved first.

Available draft · two ninety-minute units · construction edition

Retain your own attempt before reading these worked solutions. Explain the reasoning, then solve a changed case without looking.

SessionNotebookMatching textPurpose
A · 90 minutesA: agent evaluationMarkdownConstruct, connect and explain
B · 90 minutesB: evaluation statisticsMarkdownDerive, check coverage and transfer

Each notebook includes its own setup, first-principles introductions and supplied teaching runtime. Open either notebook in Google Colab with its badge (Colab runs Python 3.12), or use a local Python 3.12+ Jupyter kernel; Unit A also needs Pydantic 2, and Unit B only the standard library. No repository checkout, previous notebook kernel or live account is needed. Unit B can use an explicitly selected successful Unit A handoff; an invalid selected file refuses rather than substituting an answer.

Ninety minutes is the planned work allowance per unit, excluding installation. Actual completion time and understanding require classroom observation.

Setup · Back to this asset

Keep building with Prof Rod

Found this material through a colleague, classroom or shared download? Get the complete book at profrod.ai/book and join the Prof Rod learner community. Bring one result, one question or one failure you learned from. Share this resource with another learner and keep its source links with it so they can find the full course and future updates.