-
Notifications
You must be signed in to change notification settings - Fork 1.6k
Hydra versions 2.x showing memory leak behavior #3495
Description
Preflight checklist
- I could not find a solution in the existing issues, docs, nor discussions.
- I agree to follow this project's Code of Conduct.
- I have read and am following this repository's Contribution Guidelines.
- This issue affects my Ory Network project.
- I have joined the Ory Community Slack.
- I am signed up to the Ory Security Patch Newsletter.
Describe the bug
Hello,
We've been running Hydra since last August or so, starting with version(s) 1.x. Purely supporting the client credentials flow, we were seeing no issues or concerns the entire time.
Ever since updating to version 2.0.3, and recently 2.1.1, we have been seeing slow and steady memory leak behavior (increasing at a rate of about ~4% per day). The usage does not correlate with request count (during high usage times we'll see memory usage spike very briefly, then return to the previous rate of increase). We are seeing the same behavior with the memory even in test environments that are not receiving any requests but maintain similar memory usage patterns.
Is this a known issue on your end? I was perusing the commit history and noticed that ory/x recently had a commit for addressing memory leaks but even with version 2.1.1 (which contains the relevant commit) the behavior remains.
Reproducing the bug
- Run Hydra
- Watch memory consumption go up
Relevant log output
No response
Relevant configuration
No response
Version
2.0.3, 2.1.1
On which operating system are you observing this issue?
Linux
In which environment are you deploying?
Kubernetes with Helm
Additional Context
No response