Fencing Tracking and Visualization System

Description: We developed the “Fencing tracking and visualization system." It detects sword tips without any markers by utilizing a specialized object detector with convolutional neural network, and it utilizes real time AR synthesis to instantly visualize the trajectory.

Presenter(s):
Yuya Hanai, Abstract Engine Co., Ltd., Japan
Daito Manabe, Abstract Engine Co., Ltd., Japan
Kyle McDonald, IYOIYO, United States of America
Satoshi Horii, Abstract Engine Co., Ltd., Japan
Futa Kera, Abstract Engine Co., Ltd., Japan
Kisaku Tanaka, anno lab, Japan
Motoi Ishibashi, Abstract Engine Co., Ltd., Japan

Software Engineer.Received B.S in 2008, then M.S degree in 2010 from Keio University. After working as an engineer, was engaged with AR technology development, in the R&D department of Sony Corporation, he began his career at Rhizomatiks in 2014. Mainly developed novel visual systems such as ‘Seamless MR’, ’Dynamic VR’ and ‘interactive Laser’ in many projects for various international artists including Björk. Won the ‘Award of Distinction’ in Ars Electronica for the music video work, ‘Nosaj Thing / Cold Stares ft. Chance The Rapper + The O'My's’, was mainly engaged with camera system development. In 2018, achieved the distinct honor of winning two simultaneous awards in separate divisions of the 22nd Japan Media Arts Festival: the Art Excellence Award for the development of an AR/projection system featured in the dance installation “discrete figures,” and the Entertainment Excellence Award for the development of a visual system showcased in “Perfume Reframe”.

Manabe’s collaborations on dance performances with MIKIKO and ELEVENPLAY have showcased a wide array of technology including drones, robotics, machine learning, and even volumetric projection to create 3D images in the air from a massive volume of rays. Additional data-driven performances have explored innovative applications of dance data and machine learning. These collaborations have been performed at major festivals including Ars Electronica, Sónar (Barcelona), Scopitone (Nantes), and MUTEK (Mexico City) to widespread media acclaim (WIRED, Discovery Channel, etc.)

Kyle McDonald is an artist working with code. He crafts interactive installations, sneaky interventions, playful websites, workshops, and toolkits for other artists working with code. Exploring possibilities of new technologies: to understand how they affect society, to misuse them, and build alternative futures; aiming to share a laugh, spark curiosity, create confusion, and share spaces with magical vibes. Working with machine learning, computer vision, social and surveillance tech spanning commercial and arts spaces. Previously adjunct professor at NYU's ITP, member of F.A.T. Lab, community manager for openFrameworks, and artist in residence at STUDIO for Creative Inquiry at CMU, and YCAM in Japan. Work commissioned and shown around the world, including: the V&A, NTT ICC, Ars Electronica, Sonar, Todays Art, and Eyebeam.

Satoshi Horii uses programming for interactive and video works in various fields across installations, live performances, VJ and commercials for the arts and design works. Since joining Rhizomatiks in 2006, he has been in charge of everything from dynamic picture creation to system design and implementation. He won the Grand Prize at the 16th Japan Media Arts Festival. He has also won the Silver Prize at the 60th Cannes Lion International Festival of Creativity.

Futa Kera was born in 1992 at Shibata City, Niigata Prefecture. Graduated from the Department of Information Design, Faculty of Art and Design, Tama Art University in 2016, and completed his master's degree at the Graduate School of Media and Governance, Keio University. From the interest of design and art integrated with the digital media, Futa creates experimental works using programming as a member of Rhizomatiks.

Studied video and visual expression at the School of Design of Kyushu University. While a student at Kyushu University, Kisaku joined "anno lab", a creative lab in Fukuoka and has been involved in the creation of many "interactive artworks” where the actions of the audience are reflected into the work.

Engineer/Artist. Graduated from the Department of Contorol Systems Engineering, Faculty of Engineering, Tokyo Institute of Technology, and Institute of Advanced Media Arts and Sciences(IAMAS). With device production as the main focus, Motoi has been actively involved in a number of advertising projects, arts production, workshops, and music video production.Prizes Motoi has received the Award of Distinction of the Prix Ars Electronica 2011 and the Grand Prize at the 16th Japan Media Arts Festival.