What is pose estimation?
Before we proceed, we need to understand how to estimate the camera pose. This is a very critical step in an augmented reality system and we need to get it right if we want our experience to be seamless. In the world of augmented reality, we overlay graphics on top of an object in real time. In order to do that, we need to know the location and orientation of the camera, and we need to do it quickly. This is where pose estimation becomes very important. If you don't track the pose correctly, the overlaid graphics will look unnatural.
Consider the following image:
The arrow indiactes that the surface is normal. Let's say the object changes its orientation:
Now, even though the location is the same, the orientation has changed. We need to have this information so that the overlaid graphics look natural. We need to make sure that the graphic is aligned with this orientation and position.
