Skip to content

[9.0] (backport #17149) TBS: Fix incorrectly large pebble database lsm_size monitoring metric#17153

Merged
mergify[bot] merged 2 commits into9.0from
mergify/bp/9.0/pr-17149
Jun 9, 2025
Merged

[9.0] (backport #17149) TBS: Fix incorrectly large pebble database lsm_size monitoring metric#17153
mergify[bot] merged 2 commits into9.0from
mergify/bp/9.0/pr-17149

Conversation

@mergify
Copy link
Copy Markdown
Contributor

@mergify mergify bot commented Jun 9, 2025

Motivation/summary

Fix negative lsm size in monitoring metric by bumping pebble to include upstream bugfix. This should stop occasional database storage limit exceeded errors due to negative lsm_size overflowed to a large int.

Checklist

- [ ] Update CHANGELOG.asciidoc to be done on release

  • Documentation has been updated

For functional changes, consider:

  • Is it observable through the addition of either logging or metrics?
  • Is its use being published in telemetry to enable product improvement?
  • Have system tests been added to avoid regression?

How to test these changes

Run apmbench / apmsoak against a TBS-enabled apm-server and observe that the lsm_size is not unrealistically large.

On a side note, I've used the setup to reproduce the bug and confirmed it is fixed.

Related issues

Fixes #17043


This is an automatic backport of pull request #17149 done by [Mergify](https://mergify.com).

…#17149)

Fix negative lsm size in monitoring metric by bumping pebble to include upstream bugfix. This should stop occasional database storage limit exceeded errors due to negative lsm_size overflowed to a large int.

(cherry picked from commit b6d397d)

# Conflicts:
#	NOTICE-fips.txt
#	NOTICE.txt
#	go.mod
#	go.sum
@mergify mergify bot requested a review from a team as a code owner June 9, 2025 19:52
@mergify mergify bot added backport conflicts There is a conflict in the backported pull request labels Jun 9, 2025
@mergify
Copy link
Copy Markdown
Contributor Author

mergify bot commented Jun 9, 2025

Cherry-pick of b6d397d has failed:

On branch mergify/bp/9.0/pr-17149
Your branch is up to date with 'origin/9.0'.

You are currently cherry-picking commit b6d397da.
  (fix conflicts and run "git cherry-pick --continue")
  (use "git cherry-pick --skip" to skip this patch)
  (use "git cherry-pick --abort" to cancel the cherry-pick operation)

Unmerged paths:
  (use "git add <file>..." to mark resolution)
	both modified:   NOTICE-fips.txt
	both modified:   NOTICE.txt
	both modified:   go.mod
	both modified:   go.sum

no changes added to commit (use "git add" and/or "git commit -a")

To fix up this pull request, you can check it out locally. See documentation: https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/reviewing-changes-in-pull-requests/checking-out-pull-requests-locally

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Jun 9, 2025

🤖 GitHub comments

Expand to view the GitHub comments

Just comment with:

  • run docs-build : Re-trigger the docs validation. (use unformatted text in the comment!)

@mergify mergify bot merged commit 3ec5cf0 into 9.0 Jun 9, 2025
15 checks passed
@mergify mergify bot deleted the mergify/bp/9.0/pr-17149 branch June 9, 2025 20:29
@endorama endorama mentioned this pull request Jun 20, 2025
3 tasks
@isaacaflores2
Copy link
Copy Markdown
Contributor

Tested Manually

  1. Spin up TBS enabled apm-server
  2. Run apm-soak
  3. Observed lsm_size via the localhost:5066/stats endpoint. Size was about 3.6MB
"sampling": {
	"tail": {
		"storage": {
			"lsm_size": 3642570,
			"value_log_size": 0
		}
	}
}

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport conflicts There is a conflict in the backported pull request test-plan v9.0.3

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants