Pavel A. Savkin, Shunke Saito, Jarich Vansteenberge, Tsulasa Fukusato, Lochlainn Wilson, Shigeo Morishima

Outside-in Monocular IR Camera based HMD Pose Estimation via Geometric Optimization

No. 7, DOI: 10.1145/3139131.3139136

Proceedings of the 23rd ACM Symposium on Visual Reality Software and Technology (VRST '17)

Accurately tracking a Head Mounted Display (HMD) with a 6 degree of freedom is essential to achieve a confortable and a nausea free experience in Virtual Reality. Existing commercial HMD systems using synchronized Infrared (IR) camera and blinking IR-LEDs can achieve highly accurate tracking. However, most of the off-the-shelf cameras do not support frame synchronization. In this paper, we propose a novel method for real time HMD pose estimation without using any camera synchronization or LED blinking. We extended over the state of the art pose estimation algorithm by introducing geometrically constrained optimization. In addition, we propose a novel system to increase robustness to the blurred IR-LEDs patterns appearing at high-velocity movements. The quantitative evaluations showed significant improvements in pose stability and accuracy over wide rotational movements as well as a decrease in runtime.