Latest

Wed, Aug 5, 2026Wednesday, August 5, 20262 entries

EssayBuild systems around models· Food for Thought

A Dark Factory Beyond Software, and the Review Arithmetic That Caps It

A dark software factory turns requests into tested software with no person on each change. The same pattern runs any work you can write as code. What caps it is review, not compute: the arithmetic, the control layers, and where it breaks.9 min readdark-software-factoriesverification

NoteBuild systems around models

Test the Two-Correction Rule Instead of Taking It on Faith

The Claude Code best-practices guide gives a specific threshold: "If you've corrected Claude more than twice on the same issue in one session, the context is…Quick thoughtclaude-codecontext

Tue, Aug 4, 2026Tuesday, August 4, 20261 entry

NoteBuild systems around models

Prune Your CLAUDE.md, Then Test Whether Adherence Moves

Three hundred lines of instructions, and Claude still ignores the rule about where results files go. So you add the rule again in capitals.Quick thoughtclaude-codecontext

Mon, Aug 3, 2026Monday, August 3, 20261 entry

NoteBuild systems around models

Delegate Codebase Discovery, Then Spot-Check the Handoff

Finding where an unfamiliar research repo computes pass@k, or where it filters the eval set before scoring, can take dozens of file reads before you reach the…Quick thoughtclaude-codecontext

Fri, Jul 31, 2026Friday, July 31, 20261 entry

NoteBuild systems around models

Put the Check Your Numbers Depend On in a Hook

A line in CLAUDE.md such as "rerun the scorer tests after editing metrics.py" is followed at some rate.Quick thoughtclaude-codeverification

Thu, Jul 30, 2026Thursday, July 30, 20261 entry

NoteBuild systems around models

A Stop Hook Gates the Turn, Up to a Cap

The session reports that the experiment code is done. The smoke test is red. A Stop hook turns that gap into something the session cannot talk past, within a…Quick thoughtclaude-codeverification

Mon, Jul 27, 2026Monday, July 27, 20261 entry

NoteBuild systems around models

The 7x Agent-Team Figure Applies to Plan Mode: Measure Your Own Ratio

The slug of this note says agent teams cost seven times more. The documented claim is narrower, and the difference matters when you plan compute or explain a…Quick thoughtclaude-codeeconomics

Sun, Jul 26, 2026Sunday, July 26, 20261 entry

NoteBuild systems around models

Fan Out a Research-Repo Migration One Bounded Run at a Time

You need to migrate 200 experiment configs to a new schema, or move 200 eval tasks onto a new harness API.Quick thoughtclaude-codepractice

Sat, Jul 25, 2026Saturday, July 25, 20261 entry

NoteBuild systems around models

Give Your Ablation Recipe Arguments, Then Check Each Run

You keep typing the same experiment recipe: train with this config and seed, evaluate on the fixed 200-case subset, write the results with the commit hash.Quick thoughtclaude-codepractice

Fri, Jul 24, 2026Friday, July 24, 20261 entry

NoteBuild systems around models

Pick a Subagent's Model by Measuring It on Your Own Tasks

The slug says run cheap subagents and reserve Opus for the hard part. That is a reasonable hypothesis, not a rule.Quick thoughtclaude-codeeconomics

Thu, Jul 23, 2026Thursday, July 23, 20261 entry

NoteBuild systems around models

Measure What Survives Compaction, Then Write the Rest Down

Three hours into chasing a loss spike, you hold ten facts that matter: the seed that reproduces it, the step where it starts, the config hash, the…Quick thoughtclaude-codecontext

Wed, Jul 22, 2026Wednesday, July 22, 20261 entry

NoteBuild systems around models

Worktrees Separate Files, Not Experiments

You want two agents at once: one refactoring the data loader, one adding an ablation flag. Separate git worktrees give each its own directory and branch, so…Quick thoughtclaude-codepractice

Tue, Jul 21, 2026Tuesday, July 21, 20261 entry

NoteBuild systems around models

Measure What a Second Model Catches Before Adding It to Review

Measuring one reviewer means its recall on planted bugs and its precision on real findings. This note asks a different question: does a second reviewer catch…Quick thoughtclaude-codeverification

Mon, Jul 20, 2026Monday, July 20, 20261 entry

NoteBuild systems around models

Look at the Rendered Figure, Not Just the Exit Code

Claude Code edits the script that draws your results figure. It exits 0. The figure can still be wrong: error bars missing, a legend covering the curve you're…Quick thoughtclaude-codeverification

Sun, Jul 19, 2026Sunday, July 19, 20261 entry

NoteBuild systems around models

Point the Agent at the Exact File, Revision and Failing Case

Your eval reports 0.71 on a benchmark and the paper reports 0.78. You already suspect the answer normalization in eval/metrics.py, and you have one case where…Quick thoughtclaude-codecontext

Sat, Jul 18, 2026Saturday, July 18, 20261 entry

NoteBuild systems around models

Auto Mode Decides; the Sandbox Enforces. Test Which One Stops What

An agent running your eval harness reads untrusted text all day: benchmark prompts, scraped pages, other models' outputs.Quick thoughtclaude-codesecurity

Fri, Jul 17, 2026Friday, July 17, 20261 entry

NoteBuild systems around models

Run /init, Then Test Every Command It Wrote Down

/init drafts a starter CLAUDE.md from the repository; the memory guide says that if one already exists, it suggests improvements instead of overwriting it.Quick thoughtclaude-codesetup

Thu, Jul 16, 2026Thursday, July 16, 20261 entry

NoteBuild systems around models

Plan When a Change Can Move Your Eval Numbers

A one-line change to the dedup key between your train and test splits can move every number in the results table.Quick thoughtclaude-codepractice

Wed, Jul 15, 2026Wednesday, July 15, 20261 entry

NoteBuild systems around models

Side Questions Stay Out of the History, Not Off the Bill

In a long agent session, every turn you add stays in the context the agent reasons from for the rest of the run.Quick thoughtclaude-codecontext

Mon, Jul 13, 2026Monday, July 13, 20261 entry

NoteBuild systems around models

Resume and Rewind Restore the Session, Not Your Experiment

Claude Code has two ways back into earlier work, and neither returns the repo to the state your results came from. Resume brings back the conversation.Quick thoughtclaude-codepractice

Continued on the next page.

To browse rather than follow: topics, all articles and all notes. To learn in order: courses and the book.