Implementing fault injection and chaos tests

Suites such as Gremlin aim to make the adoption of chaos engineering easier to move toward since the Chaos Monkey suite popularized by Netflix can have an aggressive learning curve. For Kubernetes-based applications, a popular framework for chaos testing is Chaos Mesh. While it has not been around as long as suites such as Chaos Monkey, Chaos Mesh is a solid choice for implementing chaos experiments in a uniform way against a modular orchestration engine. Chaos Mesh is also an incubating project with the Cloud Native Computing Foundation (CNCF), which exposes it to a larger open source community for use.

It’s interesting to note that Azure Chaos Studio, which we will be using to set up some baseline experiments, relies on Chaos Mesh behind the scenes to orchestrate and run experiments against Kubernetes-based targets. It also allows for agent-based installations on virtual machines, as well as virtual machine scale sets and other...