Publishing performance benchmarks

In this section, we will learn about performance benchmarking and how to develop and publish them. We will start by defining what a performance benchmark is. A benchmark in software performance testing is defined as a point of reference against which the quality measures of a software solution can be assessed. It can be used to do a comparative study of different solutions to the same problem or compare software products.

Benchmarks are like stats or metrics to determine the quality of software. Just like in sports such as soccer, each player’s worth or quality is determined by various stats such as their overall number of goals scored, number of goals scored per match, number of goals scored tournament-wise, and so on. These stats help compare different players under different specifications. Similarly, benchmarks in the software world help determine the worth of a software product or solution under specific conditions.

Now, let’...