Using Comet for model evaluation

Comet provides the following features to deal with model evaluation:

• Log – used to store metrics, assets, and objects in Comet
• Dashboard – used to compare the results of the experiments
• Registry – used to track and store your models
• Report – used to show the results

The following figure shows how to combine the features provided by Comet to compare different models and then choose the best one for production:

Figure 3.11 – How to use Comet for model evaluation

Let’s suppose that you want to compare N models and then choose the best model for deployment. You build your experiments and then you track them in Comet. Through Comet Dashboard, you can compare models by building panels, charts, tables, and other similar objects. You can also store your models in the Comet registry. You can even export a report showing the results of comparison from the Comet platform...