You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
docs: restore SEPA as entropy pooling, note surprisal is current proxy
SEPA is conceptually about entropy pooling — the name and theory are
entropy-based. Surprisal (-logprob) is used today because backends only
provide logprobs, not full token distributions. Updated docs and manual
to keep "Selective Entropy Pooling of Attention" while noting that the
implementation currently operates on surprisal values.
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Copy file name to clipboardExpand all lines: docs/sepa.md
+4-2Lines changed: 4 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -4,14 +4,16 @@ Selective Entropy Pooling of Attention (SEPA) is an adaptive scheduling strategy
4
4
5
5
## What SEPA does
6
6
7
-
In the [advantage pipeline](advantages.md), GTPO weights token advantages by token surprisal (`-logprob`) -- high-surprisal tokens get more credit. SEPA modifies execution-token surprisals*before* GTPO weighting by pulling them toward their mean:
7
+
In the [advantage pipeline](advantages.md), GTPO weights token advantages by per-token uncertainty -- high-uncertainty tokens get more credit. SEPA modifies execution-token uncertainty values*before* GTPO weighting by pulling them toward their mean:
When `lambda = 0`, SEPA is off and GTPO sees raw surprisals. When `lambda = 1`, all execution tokens have the same surprisal (the mean), so GTPO's differentiation is concentrated entirely on planning tokens.
14
+
When `lambda = 0`, SEPA is off and GTPO sees raw values. When `lambda = 1`, all execution tokens have the same uncertainty (the mean), so GTPO's differentiation is concentrated entirely on planning tokens.
15
+
16
+
Today `uncertainty_kind = "surprisal"` (sampled-token `-logprob`) is the only available signal. When backends provide full token distributions, `shannon_entropy` becomes usable and SEPA will pool true entropy values.
0 commit comments