Pre-Trained Sets and Transfer Learning
Humans are trained to learn by experience. We tend to use the knowledge we gain in one situation in similar situations we face in the future. Suppose you want to learn how to drive an SUV. You have never driven an SUV; all you know is how to drive a small hatchback car.
The dimensions of the SUV are considerably larger than the hatchback, so navigating the SUV in traffic will surely be a challenge. Still, some basic systems, such as the clutch, accelerator, and brakes, remain similar to that of the hatchback. So, knowing how to drive a hatchback will surely be of great help to you when you starting to learn to drive the SUV. All the knowledge that you acquired while driving a hatchback can be used when you are learning to drive a big SUV.
This is precisely what transfer learning is. By definition, transfer learning is a concept in machine learning in which we store and use knowledge gained in one activity while learning another similar activity. The hatchback...