Advanced computer vision tasks

So far, we've discussed classification tasks ; a CNN can tell us what object is in the image and a confidence score, but nothing more. In this section, we'll discuss two more advanced and interesting tasks: object detection and semantic segmentation.

Object detection

Object detection is the process of finding object instances of a certain class, such as faces, cars, and trees, in images or videos. Unlike classification, object detection can detect multiple objects, as well as their location in the image.

An object detector would return a list of detected objects with the following information for each object:

• The class of the object (person, car, tree, and so on).
• Probability (or confidence...