Skip to content

pkg/metrics/wal: remove deleted series from WAL sooner#5068

Merged
tpaschalis merged 2 commits into
grafana:mainfrom
rfratto:drop-deleted-series-from-wal-sooner
Sep 4, 2023
Merged

pkg/metrics/wal: remove deleted series from WAL sooner#5068
tpaschalis merged 2 commits into
grafana:mainfrom
rfratto:drop-deleted-series-from-wal-sooner

Conversation

@rfratto

@rfratto rfratto commented Sep 1, 2023

Copy link
Copy Markdown
Member

This change causes deleted series to be deleted earlier based on the last segment involved in the checkpoint rather than the first segment involved in the checkpoint.

This will then cause the next truncate to be more aggressive with dropped series, which should help free memory associated with deleted series in remote_write sooner.

Mirrors prometheus/prometheus#12297 from @bboreham.

This change causes deleted series to be deleted earlier based on the
last segment involved in the checkpoint rather than the first segment
involved in the checkpoint.

This will then cause the next truncate to be more aggressive with
dropped series, which should help free memory associated with deleted
series in remote_write sooner.

Mirrors prometheus/prometheus#12297 from @bboreham.
@rfratto
rfratto requested a review from a team as a code owner September 1, 2023 17:37
@rfratto rfratto changed the title pkg/metrics/wal: delete series from WAL sooner. pkg/metrics/wal: delete series from WAL sooner Sep 1, 2023
@rfratto rfratto changed the title pkg/metrics/wal: delete series from WAL sooner pkg/metrics/wal: remove deleted series from WAL sooner Sep 1, 2023

@tpaschalis tpaschalis left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@tpaschalis
tpaschalis enabled auto-merge (squash) September 4, 2023 07:51
@tpaschalis
tpaschalis merged commit 37315dc into grafana:main Sep 4, 2023
@rfratto
rfratto deleted the drop-deleted-series-from-wal-sooner branch September 5, 2023 14:05
@github-actions github-actions Bot added the frozen-due-to-age Locked due to a period of inactivity. Please open new issues or PRs if more discussion is needed. label Feb 22, 2024
@github-actions github-actions Bot locked as resolved and limited conversation to collaborators Feb 22, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

frozen-due-to-age Locked due to a period of inactivity. Please open new issues or PRs if more discussion is needed.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants