Recognition of Gestures over Textiles with Acoustic Signatures
- Full Access
- Onsite Student Access
- Onsite Experience
- Virtual Full Access
- Virtual Basic Access
All 19 presentations are accessible on-demand in the virtual platform from 6 December 2021 to 11 March 2022.
Out of which, 13 Emerging Technologies will have physical exhibits onsite in Hall E, Tokyo International Forum from 15 - 17 December 2021.
Live demonstrations and Q&As for the respective presentations will be taking place at the specified Date/Time below.
Description: We demonstrate a method capable of turning a textured surface into an opportunistic input interface using a machine learning model pre-trained on the acoustic signal generated while scratching different types of fabric. A single and brief audio recording then suffices to characterize both the texture and the gesture that originates.
Presenter(s):
Pui Chung Wong, City University of Hong Kong, Hong Kong
Christian Sandor, City University of Hong Kong, Hong Kong
Alvaro Cassinelli, School of Creative Media, City University, Hong Kong
Dr. Christian Sandor is an Associate Professor at the City University of Hong Kong's School of Creative Media, where he is directing the Augmented Reality Lab. In October 2020, he was appointed Augmented Reality Evangelist at the Guangzhou Greater Bay Area Virtual Reality Research Institute. Since 2000, his foremost research interest is Augmented Reality, a`s he believes it has a profound impact on the future of mankind. He serves as editorial board member for Computers & Graphics and Transactions on Visualization and Computer Graphics and as a steering committee member for ACM Symposium Spatial User Interaction and IEEE ISMAR.
Alvaro Cassinelli (UY, IT), obtained an Engineering Degree and a PhD in Physics in France. He lead the Meta-Perception group at the Ishikawa-Oku Laboratory, University of Tokyo, specialized on interfaces to enhance human expression, expanding the vocabulary of HCI and the New Media before becoming Associate Professor and director of the Augmented Materiality lab at the School of Creative Media (HK). Awards includes a Grand Prize (9th Japan Media Art Festival), the Excellence Prize (13th Japan Media Art Festival), an Honorary Mention (Ars Electronica), the NISSAN Innovative Award (2010), Jury Grand Prize at Laval Virtual (2011) among others.