Hyperlinking Reality via Camera Phones

A higher quality MPEG-4 version of the video can be found here. In case of problems with viewing the video also check the Youtube version.

Novel user interface concept for camera phones, demonstrated in this video, is based on state-of-the-art computer vision techniques developed at our lab. Instead of typing keywords on a small and inconvenient keypad, the user just snaps a photo of his surroundings and objects on the photo become hyperlinks to information. The photo of the user’s environment on the camera phone’s (multi-)touch screen thus becomes a natural interaction device allowing intuitive access to information with a simple tap of a finger.

A manuscript with detailed technical description and performance evaluation of the system that we have implemented in order to provide “Hyperlinking Reality” functionality for camera phones is available upon request from the author Dušan Omerčević.

In addition, you might be interested in the following articles that describe some of the underlying computer vision techniques and introduce our approach to image based localization:

U. Steinhoff, D. Omerčević, R. Perko, B. Schiele, and A. Leonardis, "How Computer Vision Can Help in Outdoor Positioning", Ambient Intelligence 2007, pages 124-141, Darmstadt, Germany, 2007.

D. Omerčević, O. Drbohlav, and A. Leonardis, "High-Dimensional Feature Matching: Employing the Concept of Meaningful Nearest Neighbors", ICCV 2007, Rio de Janeiro, Brazil, 2007.