Moving to Kubernetes opens the door to a world of possibilities, the amount of workloads that can be run and the flexibility it provides. However this comes at a cost on managing the resources used by many applications and teams. Java applications can be specially challenging when running in containers.
At Adobe Experience Manager we run our cloud service on more than 40 clusters. We make extensive use of standard Kubernetes capabilities to reduce resource usage and we have also built some solutions at several levels of the stack to improve it.
From autoscaling to workload hibernation, from automated resource requests to Kubernetes Jobs, HPA, VPA,... we have experimented with and implemented several features that decrease our resource usage and lower the cost of running many Kubernetes clusters at scale. Both at workload resource level and also at achieving higher density clusters that reduce the number of clusters we need and the operating costs.
We will cover the new additions to the Kubernetes ecosystem that make our life easier: in-place VPA, KEDA autoscaler, ARM availability, etc.
At Adobe Experience Manager we run our cloud service on more than 40 clusters. We make extensive use of standard Kubernetes capabilities to reduce resource usage and we have also built some solutions at several levels of the stack to improve it.
From autoscaling to workload hibernation, from automated resource requests to Kubernetes Jobs, HPA, VPA,... we have experimented with and implemented several features that decrease our resource usage and lower the cost of running many Kubernetes clusters at scale. Both at workload resource level and also at achieving higher density clusters that reduce the number of clusters we need and the operating costs.
We will cover the new additions to the Kubernetes ecosystem that make our life easier: in-place VPA, KEDA autoscaler, ARM availability, etc.
Carlos Sanchez
Adobe
Carlos Sanchez is a Principal Scientist at Adobe Experience Manager, specializing in software automation, from build tools to Continuous Delivery and Progressive Delivery. Involved in Open Source for over 20 years, he is the author of the Jenkins Kubernetes plugin, contributor to Kubernetes, and a member of the Apache Software Foundation amongst other open source groups.