Repository navigation
Commit c752d15
committed
fix(core): stop duplicating the boundary message in compaction head
select() partitions the conversation into head (summarized) and recent
(kept) at a token budget. When the boundary lands mid-message, that message
is split into splitPrefix (head) and splitSuffix (recent). The split branch
set split = index + 1 and reused it for both head's slice end and recent's
slice start, so head = slice(0, index + 1) included the full boundary
message AND splitPrefix (a truncated copy) — duplicating it.
head is the exact text fed to the summarizer, so on every overflow-triggered
compaction where the boundary lands mid-message the boundary message was
sent twice (full + truncated), wasting tokens and risking pushing the
summary prompt past the context limit so compaction silently fails.
Track two boundaries: headEnd (end of head's full-message slice) and
recentStart (start of recent's slice). They differ only in the split case
(headEnd = index, recentStart = index + 1); all other paths keep them
equal, preserving existing behavior. Export select and add a regression
test for the duplication plus a fully-fitting sanity case.
Closes anomalyco#333291 parent 90f0576 commit c752d15
2 files changed
Lines changed: 60 additions & 6 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
130 | 130 | | |
131 | 131 | | |
132 | 132 | | |
133 | | - | |
| 133 | + | |
134 | 134 | | |
135 | 135 | | |
136 | 136 | | |
| |||
140 | 140 | | |
141 | 141 | | |
142 | 142 | | |
143 | | - | |
| 143 | + | |
| 144 | + | |
| 145 | + | |
| 146 | + | |
| 147 | + | |
| 148 | + | |
144 | 149 | | |
145 | 150 | | |
146 | 151 | | |
| |||
150 | 155 | | |
151 | 156 | | |
152 | 157 | | |
153 | | - | |
| 158 | + | |
| 159 | + | |
| 160 | + | |
| 161 | + | |
| 162 | + | |
| 163 | + | |
154 | 164 | | |
155 | 165 | | |
156 | 166 | | |
157 | 167 | | |
158 | | - | |
| 168 | + | |
| 169 | + | |
159 | 170 | | |
160 | 171 | | |
161 | | - | |
162 | | - | |
| 172 | + | |
| 173 | + | |
163 | 174 | | |
164 | 175 | | |
165 | 176 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
| 2 | + | |
2 | 3 | | |
| 4 | + | |
3 | 5 | | |
4 | 6 | | |
5 | 7 | | |
| |||
16 | 18 | | |
17 | 19 | | |
18 | 20 | | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
| 60 | + | |
| 61 | + | |
0 commit comments