Stabilization with images
Video stabilization with images alone seems like the first logical step. Indeed, initial research on stabilizing video captured by cameras was based on using information readily available from the camera sensors to understand how they move image by image.
The idea is to find keypoints in an image sequence to understand how they move image by image. Keypoints are pixel locations on an image that match these criteria:
- Keypoints should be easily recognizable and distinguishable from each other. Corners of objects are good keypoints while a point on a blank wall is not.
- It should be possible to track keypoints across multiple images to calculate motion. You should be able to tell exactly where the keypoint has moved from one frame to another.
- For performance, identifying these keypoints should be fast and memory-efficient. This is usually a bottleneck on low memory and low power devices.
Research with these criteria led to several unique approaches like including some...
