Latency Optimized Load Balancing
Problem
Microservice platforms today, supports geographically dispersed deployments. This means that multiple instances of a Microservice can be hosted in different continents on heterogeneous environments. While abstracting the service hosting location has advantages, it also introduces challenges around offering consistent performance for consumer requests from different parts of the globe. Having a load balancer which uses a round robin or random routing algorithm cannot guarantee the most optimal response in most cases.
Latency optimized load balancing (Problem)