Introduction

In this chapter, we will demonstrate how to visualize data interactively using built-in motion sensors called Inertial Measurement Units (IMUs) and the multi-touch interface on mobile devices. We will further explore the use of shader programs to accelerate computationally intensive operations to enable real-time visualization of 3D data with mobile graphics hardware. We will assume familiarity with the basic framework for building an Android-based OpenGL ES 3.0 application introduced in the previous chapter and add significantly more complexity in the implementation in this chapter to achieve interactive, real-time 3D visualization of a Gaussian function using both motion sensors and the multi-touch gesture interface. The final demo is designed to work on any Android-based mobile device with proper sensor hardware support.

Here, we will first introduce how to extract data directly from the IMUs and plot the real-time data stream acquired on an Android device. We will divide...