Massachusetts Institute of Technology

Media Lab

Matt Hirsch

8D Display

8D Display

Abstract

Imagine a display that behaves like a window. Glancing through it, viewers perceive a virtual 3D scene with correct parallax, without the need to wear glasses or track the user. Light that passes through the display correctly illuminates the virtual scene. While researchers have considered such displays, or prototyped subsets of these capabilities, we contribute a new, interactive, relightable, glasses-free 3D display. By simultaneously capturing a 4D light field, and displaying a 4D light field, we are able to realistically modulate the incident light on rendered content. We present our optical design, and GPU pipeline. Beyond mimicking the physical appearance of objects under natural lighting, an 8D display can create arbitrary directional illumination patterns and record their interaction with physical objects. Our hardware points the way towards novel 3D interfaces, in which users interact with digital content using light widgets, physical objects, and gesture.

Collaborators

Shahram Izadi

Henry Holtzman

Ramesh Raskar

CHI2013

Our paper on the 8D Display was accepted to CHI 2013!

8D Paper

ITS 2012 Demo Extended Abstract

We presented the 8D Display at the ITS 2012 Demos section. You can find the extended abstract here.

SIGGRAPH 2012 Poster

Video