Depth-Aware Dynamic Projection Mapping using High-speed RGB and IR Projectors

  • Full Access Full Access
  • Onsite Student Access Onsite Student Access
  • Onsite Experience Onsite Experience
  • Virtual Full Access Virtual Full Access
  • Virtual Basic Access Virtual Basic Access

All 19 presentations are accessible on-demand in the virtual platform from 6 December 2021 to 11 March 2022.
Out of which, 13 Emerging Technologies will have physical exhibits onsite in Hall E, Tokyo International Forum from 15 - 17 December 2021.
Live demonstrations and Q&As for the respective presentations will be taking place at the specified Date/Time below.


Description: We report a new system combining a camera, an RGB projector, and a newly developed high-speed IR projector. Moreover, we realize a 0.4-ms markerless 3D tracking by leveraging a small inter-frame motion. Based on these technologies, we demonstrate flexible, depth-aware dynamic projection mapping on the entire scene with 8-ms latency.

Presenter(s):
Sora Hisaichi, Tokyo Institute of Technology, Japan
Kiwamu Sumino, Tokyo Electron Device, Japan
Kunihiro Ueda, Tokyo Electron Device, Japan
Hidenori Kasebe, Tokyo Electron Device, Japan
Tohru Yamashita, Tokyo Electron Device, Japan
Takeshi Yuasa, Tokyo Electron Device, Japan
Uwe Lippmann, Fraunhofer Institute for Applied Optics and Precision Engineering, Germany
Petra Aswendt, Vialux GmbH, Germany
Roland Höfling, Vialux GmbH, Germany
Yoshihiro Watanabe, Tokyo Institute of Technology, Japan

Sora Hisaichi is a Master student at Tokyo Institute of Technology. He received his Bachelor’s degree from the same university in 2020. He is interested in the research fields of augmented reality.

He works at Tokyo Electron Device.

He works at Tokyo Electron Device.

He works at Tokyo Electron Device.

He works at Tokyo Electron Device.

He works at Tokyo Electron Device.

He works at Fraunhofer Institute for Applied Optics and Precision Engineering.

She works at Vialux GmbH.

He works at Vialux GmbH.

Yoshihiro Watanabe is an Associate Professor at Tokyo Institute of Technology. He received his Ph.D. degree from University of Tokyo in 2007. He is the leader of the Latent Sense Lab, a research group exploring the possibilities to invoke a new sense of reality based on the advanced technology centering on visual sensing. His group invents a new type of augmented reality based on dynamic projection mapping by fusing the special high-speed vision and projection technologies.

Back