About me

I received my PhD at the Computer Vision Laboratory of the ETH Zurich in the Virtual Reality in Medicine Group of Dr. Matthias Harders and Prof. Gábor Székely. My thesis focused on visuo-haptic augmented reality (AR) with the title "Exploring Visuo-Haptic Augmented Reality for Training". Before that I studied computational visualistics in Koblenz, Germany.

I am currently working at the the Center for Computation and Visualization at Brown University where I use my knowledge of Computer Graphics, Computer Vision and Human Computer Interaction to develop software for different departments of Brown University and to develop and maintain immersive applications using the YURT and the CAVE of CCV.

I am also the author of the XMA Lab, a software used by more than 20 universities for X-ray Reconstruction of Moving Morphology (XROMM). XROMM uses biplanar x-ray video in combination with 3D models of bone morphology to recover highly accurate 3D motion of bones during rapid movements, e.g. bird flight, frog jumping or human running.

My personal research interests include augmented and virtual reality, computer vision, computer graphics, haptics, (medical) image processing, human computer interfaces, computer art.

Visuo-Haptic Augmented Reality

Augmented Reality (AR) combines the real world with computer generated virtual reality (VR). By collocation of the two environments in real time, the illusion of an extended or augmented environment is created. In general the augmentation is only performed for visual feedback, which limits interactions with the virtual entities. Visuo-haptic AR therefore extends the concept by including haptic sensations from the virtual world. This allows a user to not only see an augmented environment, but also to touch it. This results in a higher fidelity of the interaction when compared to VR systems, where the haptic interaction is usually not collocated with the visual feedback, and to visual AR systems, where no haptic feedback of the virtual scene is given.

In order to provide a convincing visuo-haptic augmentation, the requirements are extremely high. Several data streams need to be recorded, processed, interpreted, augmented and fed back to the user. Errors occurring in a single step can already significantly reduce the overall fidelity of the system. My research therefore targeted all components of the system, while focusing on the following four aspects

© 2010 Benjamin Knoerlein