Classical cloud and Kubernetes problems
In recent years, many people have moved to the cloud or to Kubernetes deployments, which have in many cases greatly simplified deployments and operations. However, every new technology comes with certain challenges and things one has to take into consideration.
CPU throttling – capacity control unleashed
In a cloud environment, what one essentially buys or deploys is a certain amount of CPU and I/O power. What does that mean? The host operating system therefore has to ensure that you don’t exceed what you have paid for. When the load is low, this is usually not a problem. However, when you are getting closer and closer to your limits, the system tends to use more and more capacity to keep you within your limits. Controlling deployments eventually becomes the overarching task on the host. The net effect is that your performance can seriously suffer as soon as you are approaching the limit of your deployment.
The problem...