Eye Gesture Recognition on Portable Devices

Vytautas Vaitukaitis, Andreas Bulling

Proc. International Workshop on Pervasive Eye Tracking and Mobile Gaze-Based Interaction (PETMEI), pp. 711-714, 2012.

---

---

Abstract

Eye tracking using special-purpose devices has a large number of applications, such as usability testing or marketing research. In contrast, portable devices, such as mobile phones and tablets, have received only little attention so far. This is mainly due to their - until recently - limited sensing capabilities and processing power. In this work-in-progress paper we present the first prototype eye gesture recognition system for portable devices that does not require any additional equipment. The system combines techniques from image processing, computer vision and pattern recognition to detect eye gestures in the video recorded using the built-in front-facing camera. In a five-participant pilot study we show that our prototype can recognise four different continuous eye gestures in near real-time with an average accuracy of 60% on an Android-based smartphone (17.6% false positives) and 67.3% on a laptop (5.9% false positives). This initial result is promising and underlines the potential of eye tracking and eye-based interaction on portable devices.

---

Links

---

BibTeX