Repository navigation
Commit a00a723
fix(responses): stop rewriting an unchanged snapshot every two seconds (lidge-jun#2476)
* fix(responses): stop rewriting an unchanged snapshot every two seconds
`responses-state.json` is bounded at 24 MiB and rewritten whole on a fixed
2 s debounce, so under sustained traffic every cycle paid a complete
re-serialization plus an atomic replacement of a file nothing reads until
the next start.
Two narrow measures, both scoped to the write path:
- A flush that would reproduce the existing file byte-for-byte is
skipped. A mutation does not always change what gets persisted —
entries past the per-entry or total bound are dropped from the
selection, and spill demotion moves bytes out of it. The comparison is
a length plus a Bun.hash digest rather than the retained payload, which
at the 24 MiB bound would double the snapshot's memory cost. The skip
is conditional on the file still existing, so a snapshot deleted
underneath the process is restored.
- The debounce scales with the size of the last snapshot written: base
2 s below 1 MiB, linear above it, clamped at 30 s. The write rate is
then roughly flat as the cache grows instead of growing with it.
Durability is unchanged for a graceful shutdown, which flushes; a longer
debounce only widens the window in which a hard kill loses the most
recent continuation entries, which are cache.
Journal / incremental store deliberately not attempted here.
Refs lidge-jun#2460
* docs(troubleshooting): say the debounce follows the last snapshot written
The section read as though the cadence tracked the pending snapshot. It
tracks the size of the last snapshot actually written, so a cache that
has only just grown still takes the short wait once. Review feedback on
lidge-jun#2476.
* fix(responses): verify the snapshot on disk before skipping a write
Skipping a byte-identical rewrite is the right fix for the amplification,
but the cached digest describes what this process last wrote, which is
not the same claim as what is on disk now. A second proxy sharing the
home, or anything that rewrites the file in place, leaves the digest
describing bytes that are gone.
That matters more than it sounds. Before the skip existed, every flush
rewrote the file and so repaired external damage silently. Skipping on
the digest alone turns a self-healing snapshot into a permanently corrupt
one, and nothing notices until the next restart fails to load the
continuation state. Replacing the file with different bytes of the same
length reproduces it: the digest still matches, the file still exists,
and the flush declines to repair.
The skip now verifies identity against the file itself. The cached digest
is keyed to the resolved write target, so a config-dir change or a
retargeted symlink is a miss rather than a false match, and the contents
are compared byte-for-byte before declining to write. Size is checked
first so the common mismatch costs a stat, any read failure answers "no"
and the caller rewrites, and the read only happens when the digest
already agreed. The amplification being fixed is the repeated 24 MiB
atomic replace, not the read that avoids it.
This also removes the need to trust Bun.hash for correctness. It stays a
cheap first filter, but a collision can no longer produce a false skip.
Tests: same-length external replacement must be rewritten, proven by
reverting only the disk check. The docs line claiming graceful shutdown
"always flushes" is corrected too — the flush is a disk write and can
fail like any other, and writeBoundedSnapshot swallows that into a
"failed" outcome the lifecycle warning cannot see.
124 pass across write-amplification and responses-state. tsc clean.
---------
Co-authored-by: bitkyc08-arch <[email protected]>1 parent 77c081d commit a00a723
3 files changed
Lines changed: 320 additions & 4 deletions
File tree
- docs-site/src/content/docs/troubleshooting
- src/responses
- tests
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
50 | 50 | | |
51 | 51 | | |
52 | 52 | | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
| 60 | + | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
| 64 | + | |
| 65 | + | |
| 66 | + | |
| 67 | + | |
| 68 | + | |
| 69 | + | |
| 70 | + | |
| 71 | + | |
53 | 72 | | |
54 | 73 | | |
55 | 74 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
18 | 18 | | |
19 | 19 | | |
20 | 20 | | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
21 | 27 | | |
22 | 28 | | |
23 | 29 | | |
| |||
90 | 96 | | |
91 | 97 | | |
92 | 98 | | |
| 99 | + | |
| 100 | + | |
| 101 | + | |
| 102 | + | |
| 103 | + | |
| 104 | + | |
| 105 | + | |
| 106 | + | |
| 107 | + | |
| 108 | + | |
| 109 | + | |
| 110 | + | |
| 111 | + | |
| 112 | + | |
| 113 | + | |
| 114 | + | |
| 115 | + | |
| 116 | + | |
| 117 | + | |
| 118 | + | |
| 119 | + | |
| 120 | + | |
| 121 | + | |
| 122 | + | |
| 123 | + | |
| 124 | + | |
93 | 125 | | |
94 | 126 | | |
95 | 127 | | |
| |||
788 | 820 | | |
789 | 821 | | |
790 | 822 | | |
791 | | - | |
792 | | - | |
793 | | - | |
| 823 | + | |
| 824 | + | |
| 825 | + | |
| 826 | + | |
| 827 | + | |
| 828 | + | |
| 829 | + | |
| 830 | + | |
| 831 | + | |
| 832 | + | |
| 833 | + | |
| 834 | + | |
| 835 | + | |
| 836 | + | |
| 837 | + | |
| 838 | + | |
| 839 | + | |
| 840 | + | |
| 841 | + | |
| 842 | + | |
| 843 | + | |
| 844 | + | |
| 845 | + | |
| 846 | + | |
| 847 | + | |
| 848 | + | |
| 849 | + | |
| 850 | + | |
| 851 | + | |
| 852 | + | |
| 853 | + | |
| 854 | + | |
794 | 855 | | |
795 | 856 | | |
796 | 857 | | |
| |||
809 | 870 | | |
810 | 871 | | |
811 | 872 | | |
| 873 | + | |
| 874 | + | |
| 875 | + | |
| 876 | + | |
| 877 | + | |
| 878 | + | |
| 879 | + | |
| 880 | + | |
| 881 | + | |
| 882 | + | |
| 883 | + | |
| 884 | + | |
| 885 | + | |
| 886 | + | |
| 887 | + | |
812 | 888 | | |
813 | 889 | | |
814 | 890 | | |
815 | 891 | | |
816 | | - | |
| 892 | + | |
817 | 893 | | |
818 | 894 | | |
819 | 895 | | |
| |||
1418 | 1494 | | |
1419 | 1495 | | |
1420 | 1496 | | |
| 1497 | + | |
| 1498 | + | |
| 1499 | + | |
1421 | 1500 | | |
1422 | 1501 | | |
1423 | 1502 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
| 60 | + | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
| 64 | + | |
| 65 | + | |
| 66 | + | |
| 67 | + | |
| 68 | + | |
| 69 | + | |
| 70 | + | |
| 71 | + | |
| 72 | + | |
| 73 | + | |
| 74 | + | |
| 75 | + | |
| 76 | + | |
| 77 | + | |
| 78 | + | |
| 79 | + | |
| 80 | + | |
| 81 | + | |
| 82 | + | |
| 83 | + | |
| 84 | + | |
| 85 | + | |
| 86 | + | |
| 87 | + | |
| 88 | + | |
| 89 | + | |
| 90 | + | |
| 91 | + | |
| 92 | + | |
| 93 | + | |
| 94 | + | |
| 95 | + | |
| 96 | + | |
| 97 | + | |
| 98 | + | |
| 99 | + | |
| 100 | + | |
| 101 | + | |
| 102 | + | |
| 103 | + | |
| 104 | + | |
| 105 | + | |
| 106 | + | |
| 107 | + | |
| 108 | + | |
| 109 | + | |
| 110 | + | |
| 111 | + | |
| 112 | + | |
| 113 | + | |
| 114 | + | |
| 115 | + | |
| 116 | + | |
| 117 | + | |
| 118 | + | |
| 119 | + | |
| 120 | + | |
| 121 | + | |
| 122 | + | |
| 123 | + | |
| 124 | + | |
| 125 | + | |
| 126 | + | |
| 127 | + | |
| 128 | + | |
| 129 | + | |
| 130 | + | |
| 131 | + | |
| 132 | + | |
| 133 | + | |
| 134 | + | |
| 135 | + | |
| 136 | + | |
| 137 | + | |
| 138 | + | |
| 139 | + | |
| 140 | + | |
| 141 | + | |
| 142 | + | |
| 143 | + | |
| 144 | + | |
| 145 | + | |
| 146 | + | |
| 147 | + | |
| 148 | + | |
| 149 | + | |
| 150 | + | |
| 151 | + | |
| 152 | + | |
| 153 | + | |
| 154 | + | |
| 155 | + | |
| 156 | + | |
| 157 | + | |
| 158 | + | |
| 159 | + | |
| 160 | + | |
| 161 | + | |
| 162 | + | |
| 163 | + | |
| 164 | + | |
| 165 | + | |
| 166 | + | |
| 167 | + | |
| 168 | + | |
| 169 | + | |
| 170 | + | |
| 171 | + | |
| 172 | + | |
| 173 | + | |
| 174 | + | |
| 175 | + | |
| 176 | + | |
| 177 | + | |
| 178 | + | |
| 179 | + | |
| 180 | + | |
| 181 | + | |
| 182 | + | |
| 183 | + | |
| 184 | + | |
| 185 | + | |
| 186 | + | |
| 187 | + | |
| 188 | + | |
| 189 | + | |
| 190 | + | |
| 191 | + | |
| 192 | + | |
| 193 | + | |
| 194 | + | |
| 195 | + | |
| 196 | + | |
| 197 | + | |
| 198 | + | |
| 199 | + | |
| 200 | + | |
| 201 | + | |
| 202 | + | |
| 203 | + | |
| 204 | + | |
| 205 | + | |
| 206 | + | |
| 207 | + | |
| 208 | + | |
| 209 | + | |
| 210 | + | |
| 211 | + | |
| 212 | + | |
| 213 | + | |
| 214 | + | |
| 215 | + | |
| 216 | + | |
| 217 | + | |
| 218 | + | |
0 commit comments