DisplayObjects, by Eric Akaoka, is an organic user interface for creating computer displays on arbitrary surfaces, such as pieces of model cardboard or blocks of styrofoam. It allows easy prototyping of hardware gadgets through software/hardware fusion. The system tracks the location of the model, as well as the finger, via markers tracked through computer vision, and renders a 3D software model of the object back onto the hardware model through projection.
References
Akaoka, E., Ginn, T. and R. Vertegaal. DisplayObjects: Prototyping Functional Physical Interfaces on 3D Styrofoam, Paper or Cardboard Models. In Proceedings of TEI’10 Conference on Tangible, Embedded and Embodied Interaction. ACM Press, 2010, pp. 49-56. [PDF]
Akaoka, E. and Vertegaal, R. DisplayObjects: Functional Prototyping on Real Objects. In Extended Abstracts of CHI’09 Conference on Human Factors in Computing Systems. ACM Press, 2009, pp. 3507-3508. [PDF]
For high resolution images please click on an image in the thumbnail gallery below.