Skip to content

router: per-cluster histograms w/ timeout budget#9227

Merged
mattklein123 merged 42 commits intoenvoyproxy:masterfrom
gumpt:mbg/timeout-stat
Jan 11, 2020
Merged

router: per-cluster histograms w/ timeout budget#9227
mattklein123 merged 42 commits intoenvoyproxy:masterfrom
gumpt:mbg/timeout-stat

Conversation

@gumpt
Copy link
Copy Markdown
Member

@gumpt gumpt commented Dec 4, 2019

This change adds a pair of histograms to track timeout budget usage: one for the
per-request timeout and one for the global timeout. The histograms are scaled
such that 100% of the timeout budget used (a timeout) is a value of 100.

The histograms by default are off. They can be turned on by setting
track_timeout_budgets on a cluster to true.

Risk Level: Low (new stats only).
Testing: Unit tests added/modified.
Docs Changes: Added notes about histograms.
Release Notes: Added comment with link to docs.

Fixes #6122

Signed-off-by: Matthew Gumport [email protected]

This change adds a pair of histograms to track timeout budget usage: one for the
per-request timeout and one for the global timeout.  The histograms are scaled
such that 100% of the timeout budget is a value of 10000 so that four digits of
the percentage used can be recorded.

Risk Level: Low (new stats only).
Testing: Unit tests added/modified.
Docs Changes: Added notes about historgrams.
Release Notes: Added comment with link to docs.

Fixes envoyproxy#6122

Signed-off-by: Matthew Gumport <[email protected]>
Copy link
Copy Markdown
Member

@tonya11en tonya11en left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for getting the ball rolling on this! I mostly have a few questions/nits this pass.

Signed-off-by: Matthew Gumport <[email protected]>
gumpt added 9 commits December 4, 2019 13:48
Signed-off-by: Matthew Gumport <[email protected]>
gave up on that approach and should've gotten them before the review.

Signed-off-by: Matthew Gumport <[email protected]>
personally hurt that this is part of ci

Signed-off-by: Matthew Gumport <[email protected]>
Signed-off-by: Matthew Gumport <[email protected]>
Signed-off-by: Matthew Gumport <[email protected]>
Signed-off-by: Matthew Gumport <[email protected]>
I'm going to agree with ci.

Signed-off-by: Matthew Gumport <[email protected]>
Signed-off-by: Matthew Gumport <[email protected]>
Copy link
Copy Markdown
Member

@tonya11en tonya11en left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LG in general. Just one final set of comments and then we can rope in the maintainers.

Signed-off-by: Matthew Gumport <[email protected]>
@repokitteh-read-only
Copy link
Copy Markdown

CC @envoyproxy/api-shepherds: Your approval is needed for changes made to api/.

🐱

Caused by: #9227 was synchronize by gumpt.

see: more, trace.

tonya11en
tonya11en previously approved these changes Dec 10, 2019
Copy link
Copy Markdown
Member

@tonya11en tonya11en left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM modulo the nit, but that's your call. I think a maintainer should take a look now.

@tonya11en
Copy link
Copy Markdown
Member

Also, can you write a bit about the flag you added that toggles the histograms in the description.

@mattklein123 mattklein123 self-assigned this Dec 10, 2019
Copy link
Copy Markdown
Member

@mattklein123 mattklein123 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice! LGTM with some small comments. Thank you.

/wait

@gumpt gumpt requested a review from mattklein123 January 8, 2020 17:51
@gumpt
Copy link
Copy Markdown
Member Author

gumpt commented Jan 8, 2020

Going to re-merge master for the stats tests.

/wait

@gumpt
Copy link
Copy Markdown
Member Author

gumpt commented Jan 8, 2020

Still waiting for new values.

/wait

Signed-off-by: Matthew Gumport <[email protected]>
@gumpt
Copy link
Copy Markdown
Member Author

gumpt commented Jan 9, 2020

Going to merge master again.

@gumpt
Copy link
Copy Markdown
Member Author

gumpt commented Jan 9, 2020

/wait

Signed-off-by: Matthew Gumport <[email protected]>
@gumpt
Copy link
Copy Markdown
Member Author

gumpt commented Jan 9, 2020

Test integration foobar

/wait

Copy link
Copy Markdown
Member

@mattklein123 mattklein123 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM modulo merge issues. Nice work!

/wait

Signed-off-by: Matthew Gumport <[email protected]>
Copy link
Copy Markdown
Member

@mattklein123 mattklein123 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@mattklein123 mattklein123 merged commit ebab713 into envoyproxy:master Jan 11, 2020
@gumpt gumpt deleted the mbg/timeout-stat branch January 11, 2020 00:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

add per-cluster histograms with remaining timeout budget

4 participants