-
Notifications
You must be signed in to change notification settings - Fork 5.3k
add per-cluster histograms with remaining timeout budget #6122
Copy link
Copy link
Closed
Labels
enhancementFeature requests. Not bugs or questions.Feature requests. Not bugs or questions.help wantedNeeds help!Needs help!
Milestone
Description
Since timeouts are dynamic (e.g. controllable via header values), it is difficult to observe how close requests are to hitting the timeout in production.
A histogram of remaining timeout budget would allow the user to identify latencies that are trending towards the timeout cliff as well as identify poorly tuned timeouts.
Likely a percentage histogram would be the most useful stat, i.e. p95 of requests to upstream are within 80% of their timeout budget.
Also see #6121: add computed-timeout header.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
enhancementFeature requests. Not bugs or questions.Feature requests. Not bugs or questions.help wantedNeeds help!Needs help!