Tools for performance engineering
In this section, we will briefly discuss various performance engineering tools.
The following are the different categories of performance engineering tools available:
- Observability tools: These tools monitor and gather information about the application. These tools potentially help to identify bottlenecks, track throughput and latency, memory usage, and so on. In data engineering, each system is different, and the throughput and latency requirements are also different. Observability tools help identify if our application is lagging in terms of throughput or latency and by how much. They also help identify hidden issues that may only show up in the long run, in production. For example, a small memory leak in the application may not be noticeable within a few days of deployment. When such an application keeps on running, the tenured region of JVM heap space keeps slowly increasing until it overruns the heap space. The following are a few examples...
