Gaze driven activating of windows on a screen

One application of gaze tracking is to find out where the focus of attention of the user is. This information could be used to direct various inputs from the user to relevant applications.
For example while using a computer, voice commands or typed input could be directed to different applications, depending on what the user is looking at on the computer screen. In this simple demo application, the user can activate different windows on a screen by looking at them.

The left image shows the general setup. Notice the camera below the screen. Right image: One window is activated.

Controlling a panorama image viewer

We developed a multimodal interface to view panorama images, where we use the gaze tracker to scroll through the 360 degree panorama images and spoken commands to zoom in and out. With such an interface, the user can fully control the panorama image viewer without using hands.

page designed by: Céline Morel

 





Questions or Comments? Contact the Webmaster