Recognition of Gestures over Textiles with Acoustic Signatures

  • Full Access Full Access
  • Onsite Student Access Onsite Student Access
  • Onsite Experience Onsite Experience
  • Virtual Full Access Virtual Full Access
  • Virtual Basic Access Virtual Basic Access

1) 東京国際フォーラム(TIFF)のホールEでブース展示 13件
(2021年12月15日-16日 10:00-18:00/ 12月17日 10:00-16:00 JST):

2) バーチャルプラットフォーム上でプレゼンテーション映像のオンデマンド配信 19件

3) ライブデモンストレーションとQ&Aセッション 19件
- 海外からの6件のライブセッションの様子は、TIFF会場ホールE内のリモートブースに生配信されます。
- TIFF会場ホールEにブース展示されている13件については、それぞれのセッション時間(1時間)のみ該当ブースをクローズします。

Description: We demonstrate a method capable of turning a textured surface into an opportunistic input interface using a machine learning model pre-trained on the acoustic signal generated while scratching different types of fabric. A single and brief audio recording then suffices to characterize both the texture and the gesture that originates.

Pui Chung Wong, City University of Hong Kong, Hong Kong
Christian Sandor, City University of Hong Kong, Hong Kong
Alvaro Cassinelli, School of Creative Media, City University, Hong Kong

Pui Chung Wong is a researcher interested in Human-Computer Interaction (HCI) and novel input methods. He completed his PhD in Creative Media, advised by Hongbo Fu and Kening Zhu. After his studies, he became a postdoc in Alvaro Cassinelli’s Augmented Materiality Lab. His work focuses on different topics in HCI, designing, building, and evaluating novel input and interaction for wearables and mobile devices. He believes that by exploring the parameters of different interaction methods more natural interaction can be developed that will improve daily living.

Dr. Christian Sandor is an Associate Professor at the City University of Hong Kong's School of Creative Media, where he is directing the Augmented Reality Lab. In October 2020, he was appointed Augmented Reality Evangelist at the Guangzhou Greater Bay Area Virtual Reality Research Institute. Since 2000, his foremost research interest is Augmented Reality, a`s he believes it has a profound impact on the future of mankind. He serves as editorial board member for Computers & Graphics and Transactions on Visualization and Computer Graphics and as a steering committee member for ACM Symposium Spatial User Interaction and IEEE ISMAR.

Alvaro Cassinelli (UY, IT), obtained an Engineering Degree and a PhD in Physics in France. He lead the Meta-Perception group at the Ishikawa-Oku Laboratory, University of Tokyo, specialized on interfaces to enhance human expression, expanding the vocabulary of HCI and the New Media before becoming Associate Professor and director of the Augmented Materiality lab at the School of Creative Media (HK). Awards includes a Grand Prize (9th Japan Media Art Festival), the Excellence Prize (13th Japan Media Art Festival), an Honorary Mention (Ars Electronica), the NISSAN Innovative Award (2010), Jury Grand Prize at Laval Virtual (2011) among others.