Signal-to-Noise Ratio (SNR)
The fraction of your token flow that is signal versus noise. High SNR means your context is compounding, not evaporating.
The formula
SNR = signal_tokens / total_tokens
Where signal_tokens = cache_read + output (tokens that compound — reused context plus generated output), and total_tokens = input + cache_read + cache_write + output (all tokens processed in the cascade). The ratio ranges from 0 to 1. An SNR of 0.8 means 80% of your token flow is signal; an SNR of 0.2 means 80% is noise.
The intuition is simple: signal accumulates (cached context carries forward, output builds on prior output), while noise evaporates (fresh input is processed once and, if not cached, never compounds). SNR measures the balance between the two.
What signal vs noise means in AI coding
Signal tokens
- cache_read — cached context reused from prior turns. This is signal you already paid for, now compounding for free.
- output — tokens the model generates. Productive work that becomes the basis for future turns.
Noise tokens
- fresh input — tokens you send that don’t get cached or don’t build on prior context. Re-explained context, redundant instructions, pasted code that’s already in the window.
- cache_write — tokens written to cache that are never read back. An investment that didn’t pay off because the session ended or the context was abandoned.
The distinction is not about content quality — it’s about whether tokens compound. A brilliantly written prompt that gets sent once and never cached is noise. A mediocre cached prefix that gets reused 50 times is signal. SNR measures the architecture of accumulation, not the brilliance of any individual turn.
Why high SNR matters
High SNR means your token budget is being spent productively. Most of what you process is either reused context (free signal) or generated output (new signal). Little is wasted on re-establishing baseline context. This is the signature of an operator who maintains a stable, structured context across turns — the cascade is a flywheel, not a restart loop.
Low SNR means most of your token flow is noise. You’re spending the bulk of your budget on fresh input that doesn’t compound — re-pasting files, re-explaining project structure, re-establishing conventions. Every turn starts from near-zero. The model processes your input, gives a response, and the context evaporates.
SNR is also a cost and latency indicator. High-SNR sessions process more tokens from cache (which is cheaper and faster) and fewer from fresh input (which is expensive and slow). Low-SNR sessions are the opposite — you pay full price on every turn.
How to increase signal density
- 1. Maintain conversation continuity. The single highest-leverage move. Every turn that reuses cached context adds signal without adding noise. Don’t restart sessions unnecessarily — the cached prefix from turn 5 is free signal on turn 50.
- 2. Use stable, structured prefixes. Put project conventions, file layout, and coding standards at the top of your context — in a consistent order. Stable prefixes get cached; chaotic, re-ordered context breaks the cache and forces fresh processing.
- 3. Reference instead of re-pasting. If the model already has a file in context, reference it by name rather than pasting its contents again. “Add tests to the auth module we discussed” is signal; re-pasting auth.ts is noise.
- 4. Request substantive output. More output tokens means more signal in the numerator. Ask for complete deliverables — functions, modules, test suites — rather than one-line answers. Output compounds: today’s generated code becomes tomorrow’s cached context.
- 5. Avoid context-switching mid-session. Jumping between unrelated tasks in one session dilutes the cache. Each topic switch forces fresh input to establish new context. Group related work into focused sessions where the cache stays relevant.
Relationship to the Conservation Law of Commitment
The Conservation Law of Commitment states that C(T(S)) ≈ C(S) with enforcement — commitment content survives transformation only when an enforcement gate is present in the pipeline. Without the gate, commitment decays: C(T(S)) < C(S).
In token-cascade terms, the “commitment content” of your context is the signal — the accumulated understanding, conventions, and code that should survive across turns. The “enforcement gate” is your context discipline: stable prefixes, conversation continuity, structured prompts. With discipline, signal survives transformation (each new turn) and compounds. Without it, signal decays into noise — you re-explain, re-paste, and re-establish context every turn.
High SNR is the empirical signature of the conservation law holding: the enforcement gate (your context discipline) is present, and signal survives. Low SNR is the signature of the law failing: no gate, signal decays, noise dominates. The law is published under CC-BY-4.0 (DOI: 10.5281/zenodo.20029607).
FAQ
- What is signal-to-noise ratio in AI coding?
- SNR = signal_tokens / total_tokens, where signal is cached context reused plus output generated, and total is all tokens processed. High SNR means most of your token budget is productive signal; low SNR means most is noise — fresh input that does not compound.
- What counts as signal vs noise in AI coding?
- Signal tokens are cache_read (reused context) and output (generated work). Noise tokens are fresh input that doesn’t compound and cache_write that’s never read back. Signal accumulates; noise evaporates. The distinction is about compounding, not content quality.
- How does SNR relate to the Conservation Law of Commitment?
- The Conservation Law states commitment content survives transformation only with an enforcement gate. In token-cascade terms, signal survives across turns only when you maintain stable, structured context — the gate is your context discipline. Without it, signal decays into noise. High SNR is the empirical signature of the law holding.
- How do I increase my signal-to-noise ratio?
- Increase signal by maximizing cache reuse and requesting substantive output. Decrease noise by trimming fresh input and avoiding re-pasted context. The highest-leverage move is conversation continuity — every turn that reuses cache adds signal without adding noise.
Related: Cache Hit Rate · Yield (Υ) · Conservation Law of Commitment · Methodology