You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We’ve observed that the Karpenter controller Pod’s memory usage gradually increases over time (correlating with Pod AGE) and then stabilizes around 85% of the memory limit.
This behavior is consistent across restarts and environments.
Questions
Is this expected behavior related to Go’s GC soft limit (GOMEMLIMIT = 90% of MEMORY_LIMIT)?
Is there any known issue or potential leak in Karpenter v1.2.x related to controller cache or informer memory growth?
Would upgrading to v1.3.x or later improve memory usage stability?
Additional Context
We confirmed that:
The controller performs normally and does not get OOMKilled.
Restarting the controller resets memory usage back to baseline.
No abnormal increase in CPU usage or logs.
It seems like Karpenter’s memory usage just reaches a steady state near its GC threshold, but I’d like to confirm whether this is by design or if there’s ongoing optimization in newer versions.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
-
Environment
Observation
We’ve observed that the Karpenter controller Pod’s memory usage gradually increases over time (correlating with Pod AGE) and then stabilizes around 85% of the memory limit.
This behavior is consistent across restarts and environments.
Questions
GOMEMLIMIT = 90% of MEMORY_LIMIT)?Additional Context
We confirmed that:
It seems like Karpenter’s memory usage just reaches a steady state near its GC threshold, but I’d like to confirm whether this is by design or if there’s ongoing optimization in newer versions.
Thanks in advance for clarifying!
Beta Was this translation helpful? Give feedback.
All reactions