Overview of DL project tracking
Training DL models is an iterative process that consumes a lot of time and resources. Therefore, keeping track of all experiments and consistently organizing them can prevent us from wasting our time on unnecessary operations such as training similar models repeatedly on the same set of data. In other words, having well-documented records of all model architectures and their hyperparameter sets, as well as the version of data used during experiments, can help us derive the right conclusion from the experiments, which naturally leads to the project being successful.
Components of DL project tracking
The essential components of DL project tracking are experiment tracking, model management, and dataset versioning. Let’s look at each component in detail.
Experiment tracking
The concept behind experiment tracking is simple: store the description and the motivations of each experiment so that we don’t run another set of experiments...