Since 2005 we have been working on several Multi-Touch screens and tables using blob tracking. During testing of an early prototype that didn’t perform very well we gave the project the name Koala, since the user had to move very slowly for the system to keep track of the blobs.
We are currently working on our fifth prototype called Snö Box, a dual projector Multi-Touch table that measures 160 x 60 cm. At the moment we are developing a book search application that uses Amazon.com to gather product information and related items. We call it BookSearch :)
:: click here to enlarge
The system primarily uses Touchlib for blob tracking and so far we have been using ActionScript for our apps. We have done an endless number of experiments with different illumination methods, screen materials, and cameras. The latest versions of the Koala have been very responsive and stable. Recently we invited our Portuguese friend Miguel to help us build apps with higher performance. He will join our team on Friday and we’re really looking forward to that.
The Mixed Reality Group at Zenitum are developing Augmented Reality Technology, and as a little bonus we decided combine the technologies for an extra vivid user experience.
:: click here to enlarge
Here is an example of the Koala displaying markers for augmented reality during a demonstration in COEX. The elephant is displayed on the handset as if it was standing on top of the Koala. The model is re-rendered in real time so that it follows the movement of the camera. We think it’s pretty cool :)