Skip to content

Remove Irrelevant Context Before Buying More

2026-09-10openai, prompting

A longer context window does not make every document relevant. Extra material can make it harder to see which source supports a decision.

For a policy-answering exercise, supply the policy section that applies, its revision date and the user's question. Add a deliberately outdated paragraph as a separate test case and check whether the answer confuses the two versions.

Record which inputs the workflow actually needed to answer correctly. If retrieval supplies unrelated pages, improve that selection step before assuming the model needs more capacity. Keep a route for questions the supplied material cannot answer. The useful result is a supported answer or an explicit gap, not a confident synthesis of everything that happened to fit in the request.

OpenAI documentation.