The class logbook
The Latest
Everything published on the site, day by day, newest first: guides, analysis, essays and quick thoughts in one running log. The shelves for browsing are elsewhere; this is where you see what is new.
The log
Entries 1–20 of 39
1 entry
1 entry
AI Tool Error Handling: Don't Fake an Empty Result
AI tool error handling must distinguish an empty catalog from unavailable data. Use separate result types and a mutation test that catches a swallowed timeout.11 min readAI tool error handlingerror handling
1 entry
AI Agent Tool Design: One Job Per Tool Boundary
AI agent tool design should expose effects and permission boundaries. Compare an overloaded inventory function with explicit read and draft tools.13 min readAI agent tool designtool boundaries
1 entry
AI Agent Latency Measurement: Find the Real Delay
AI agent latency measurement means tracing the whole user-visible path, not just timing the model call that feels easiest to optimize.11 min readAI agent latency measurementobservability
1 entry
Agent Evaluation Variance: Did A Really Beat B?
Agent evaluation variance can make one prompt look better by chance. Design paired repeated trials, report critical failures and inspect discordant outcomes.11 min readagent evaluation varianceAI evaluation
1 entry
Bounded LLM Repair Loop: Three Independent Limits
A bounded LLM repair loop needs separate attempt, deadline and work limits. Test late responses, exhausted repairs and forbidden writes with a fake clock.13 min readbounded LLM repair loopagent reliability
1 entry
AI Cache Authorization: When Answers Outlive Access
AI cache authorization needs current permissions, revision-aware keys and a defined release point. Test revoked access before and during an answer request.12 min readAI cache authorizationaccess control
1 entry
Agent Prompt Injection Boundary: A Worked Case
A retrieved note claims approval for a purchase. See why the agent prompt injection boundary must still deny the write.13 min readagent-securityprompt-injection
1 entry
LLM Validation Error Feedback That Won't Grant Policy Control
Design LLM validation error feedback that identifies malformed fields, limits repair attempts and keeps budget decisions under application control.12 min readLLM validation error feedbackstructured outputs
1 entry
AI Agent Trusted Configuration: Who Owns the Budget?
AI agent trusted configuration keeps budgets and prices outside generated proposals. Test top-level and nested overrides against a closed Python schema.12 min readAI agent trusted configurationPydantic validation
1 entry
Notebook to AI Application: Build a Callable Contract
Turn a working notebook cell into a callable contract with declared inputs, rejected cases and stable outputs before another service depends on it.12 min readnotebook to AI applicationPydantic validation
9 entries
Agent Evaluation Environment: Freeze the Task Contract
An agent evaluation environment must freeze inputs, tools and an independent oracle, or the same message silently grades against two different answers.10 min readagent evaluationAI evaluation environment
Agent Memory Invalidation: Retire Stale Facts Correctly
A changed source revision should retire a stored fact without deleting its history. Here is how to tell which memories must go.11 min readagent memorycontext engineering
Agent Regression Dataset: Save the Failure, Not the Fix
Learn to turn one failed agent run into an agent regression dataset that tests recovery without pretending to know the original cause.12 min readagent evaluationregression testing
Agent Tool Idempotency: Reconcile an Uncertain Write
A timed-out tool call leaves you unsure a write happened. Choose an idempotency key, and reconcile the result before retrying anything.12 min readagent tool idempotencyreliability
AI Agent Approval Boundary: Draft Accepted Isn't Purchase Made
An AI agent approval boundary means accepteddraft carries no supplier receipt. Learn to separate validation from execution.13 min readAI agent approval boundaryagent validation
AI Agent Per User Credentials: Who Owns the Key?
AI agent per user credentials means separating who invokes an agent from which account its tools use, so one caller never inherits another's access.11 min readagent-securityidentity-and-access
AI Agent Preview Deployment: Test Without Real Side Effects
A new hostname doesn't mean new authority. Learn why AI agent preview deployment needs credential isolation, not just a branch deploy.11 min readAI agentsdeployment testing
AI Agent Retry Policy: When to Retry, Repair, or Stop
An AI agent retry policy must treat timeouts, auth errors, schema faults, and policy refusals as different problems, not one loop.12 min readAI agent retry policyerror handling
AI Judge Calibration: Read the Confusion Matrix First
AI judge calibration means checking a trace evaluator against blind human labels before routing any case on its verdict alone.12 min readAI judge calibrationevaluation engineering
Continued on the next page.
To browse rather than follow: topics, all articles and all thoughts. To learn in order: courses and the book.
