Repository navigation
Commit baf5500
committed
fix(kubernetes): raise kubectl Job memory limits above the OOMKill floor
The talos-reconcile Job's kubectl container was capped at 256Mi and got
OOMKilled (exit 137) part-way through its script: it reached the
KamajiControlPlane certSANs patch and died before the TalosConfigTemplate
apply, so nothing downstream of that point ever ran. Under
restartPolicy: OnFailure with backoffLimit: 30 the pod respawned while
the Job-level status stayed active, which made the failure invisible
apart from a growing restart count.
kubectl apply loads full discovery plus the aggregated OpenAPI document
of the target apiserver before it can compute a patch, and on a
Cozystack management cluster that spans several hundred CRDs. 256Mi is
below the working set. Raise the floor to 512Mi and expose it as
talos.reconcileJobMemoryLimit for clusters with an even larger API
surface. The two sibling kubectl-apply containers in this chart
(bootstrap-token-tenant, oidc-bootstrap) get the same floor.
Fixes #3519
Signed-off-by: Mattia Eleuteri <[email protected]>1 parent f1f3836 commit baf5500
10 files changed
Lines changed: 98 additions & 17 deletions
File tree
- api/apps/v1alpha1/kubernetes
- packages
- apps/kubernetes
- templates
- talos
- tests
- system/kubernetes-rd/cozyrds
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
214 | 214 | | |
215 | 215 | | |
216 | 216 | | |
217 | | - | |
218 | | - | |
219 | | - | |
220 | | - | |
221 | | - | |
222 | | - | |
223 | | - | |
| 217 | + | |
| 218 | + | |
| 219 | + | |
| 220 | + | |
| 221 | + | |
| 222 | + | |
| 223 | + | |
| 224 | + | |
224 | 225 | | |
225 | 226 | | |
226 | 227 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
168 | 168 | | |
169 | 169 | | |
170 | 170 | | |
| 171 | + | |
| 172 | + | |
| 173 | + | |
| 174 | + | |
| 175 | + | |
| 176 | + | |
| 177 | + | |
171 | 178 | | |
172 | 179 | | |
173 | 180 | | |
174 | 181 | | |
175 | 182 | | |
176 | 183 | | |
177 | | - | |
| 184 | + | |
178 | 185 | | |
179 | 186 | | |
180 | 187 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
75 | 75 | | |
76 | 76 | | |
77 | 77 | | |
| 78 | + | |
| 79 | + | |
| 80 | + | |
| 81 | + | |
| 82 | + | |
| 83 | + | |
| 84 | + | |
| 85 | + | |
| 86 | + | |
78 | 87 | | |
79 | 88 | | |
80 | 89 | | |
81 | 90 | | |
82 | 91 | | |
83 | 92 | | |
84 | | - | |
| 93 | + | |
85 | 94 | | |
86 | 95 | | |
87 | 96 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
447 | 447 | | |
448 | 448 | | |
449 | 449 | | |
| 450 | + | |
| 451 | + | |
| 452 | + | |
| 453 | + | |
| 454 | + | |
| 455 | + | |
| 456 | + | |
| 457 | + | |
| 458 | + | |
| 459 | + | |
| 460 | + | |
| 461 | + | |
| 462 | + | |
| 463 | + | |
| 464 | + | |
| 465 | + | |
| 466 | + | |
| 467 | + | |
450 | 468 | | |
451 | 469 | | |
452 | 470 | | |
453 | 471 | | |
454 | 472 | | |
455 | 473 | | |
456 | | - | |
| 474 | + | |
457 | 475 | | |
458 | 476 | | |
459 | 477 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
118 | 118 | | |
119 | 119 | | |
120 | 120 | | |
| 121 | + | |
| 122 | + | |
| 123 | + | |
| 124 | + | |
| 125 | + | |
| 126 | + | |
| 127 | + | |
| 128 | + | |
| 129 | + | |
| 130 | + | |
| 131 | + | |
| 132 | + | |
| 133 | + | |
| 134 | + | |
| 135 | + | |
| 136 | + | |
| 137 | + | |
| 138 | + | |
| 139 | + | |
| 140 | + | |
| 141 | + | |
| 142 | + | |
| 143 | + | |
| 144 | + | |
| 145 | + | |
| 146 | + | |
121 | 147 | | |
122 | 148 | | |
123 | 149 | | |
| |||
156 | 182 | | |
157 | 183 | | |
158 | 184 | | |
159 | | - | |
| 185 | + | |
160 | 186 | | |
161 | 187 | | |
162 | 188 | | |
| |||
189 | 215 | | |
190 | 216 | | |
191 | 217 | | |
192 | | - | |
193 | | - | |
| 218 | + | |
| 219 | + | |
194 | 220 | | |
195 | 221 | | |
196 | 222 | | |
197 | | - | |
| 223 | + | |
198 | 224 | | |
199 | 225 | | |
200 | 226 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
954 | 954 | | |
955 | 955 | | |
956 | 956 | | |
| 957 | + | |
| 958 | + | |
| 959 | + | |
| 960 | + | |
| 961 | + | |
| 962 | + | |
| 963 | + | |
| 964 | + | |
| 965 | + | |
| 966 | + | |
| 967 | + | |
| 968 | + | |
| 969 | + | |
| 970 | + | |
957 | 971 | | |
958 | 972 | | |
959 | 973 | | |
| |||
0 commit comments