Recognition of Gestures over Textiles with Acoustic Signatures

  • Full Access Full Access
  • Onsite Student Access Onsite Student Access
  • Onsite Experience Onsite Experience
  • Virtual Full Access Virtual Full Access
  • Virtual Basic Access Virtual Basic Access

All 19 presentations are accessible on-demand in the virtual platform from 6 December 2021 to 11 March 2022.
Out of which, 13 Emerging Technologies will have physical exhibits onsite in Hall E, Tokyo International Forum from 15 - 17 December 2021.
Live demonstrations and Q&As for the respective presentations will be taking place at the specified Date/Time below.

Description: We demonstrate a method capable of turning a textured surface into an opportunistic input interface using a machine learning model pre-trained on the acoustic signal generated while scratching different types of fabric. A single and brief audio recording then suffices to characterize both the texture and the gesture that originates.

Presenter(s):
Pui Chung Wong, City University of Hong Kong, Hong Kong
Christian Sandor, City University of Hong Kong, Hong Kong
Alvaro Cassinelli, School of Creative Media, City University, Hong Kong

Pui Chung Wong is a researcher interested in Human-Computer Interaction (HCI) and novel input methods. He completed his PhD in Creative Media, advised by Hongbo Fu and Kening Zhu. After his studies, he became a postdoc in Alvaro Cassinelli’s Augmented Materiality Lab. His work focuses on different topics in HCI, designing, building, and evaluating novel input and interaction for wearables and mobile devices. He believes that by exploring the parameters of different interaction methods more natural interaction can be developed that will improve daily living.

Dr. Christian Sandor is an Associate Professor at the City University of Hong Kong's School of Creative Media, where he is directing the Augmented Reality Lab. In October 2020, he was appointed Augmented Reality Evangelist at the Guangzhou Greater Bay Area Virtual Reality Research Institute. Since 2000, his foremost research interest is Augmented Reality, a`s he believes it has a profound impact on the future of mankind. He serves as editorial board member for Computers & Graphics and Transactions on Visualization and Computer Graphics and as a steering committee member for ACM Symposium Spatial User Interaction and IEEE ISMAR.

Alvaro Cassinelli (UY, IT), obtained an Engineering Degree and a PhD in Physics in France. He lead the Meta-Perception group at the Ishikawa-Oku Laboratory, University of Tokyo, specialized on interfaces to enhance human expression, expanding the vocabulary of HCI and the New Media before becoming Associate Professor and director of the Augmented Materiality lab at the School of Creative Media (HK). Awards includes a Grand Prize (9th Japan Media Art Festival), the Excellence Prize (13th Japan Media Art Festival), an Honorary Mention (Ars Electronica), the NISSAN Innovative Award (2010), Jury Grand Prize at Laval Virtual (2011) among others.

Back

VRST
SICAF