眼控觀偶 Gaze and Graze
擴散耦-科技與藝術的擴散、並行、融合 Diffusion Couple of Art and Technology
日期:2023/12/23-2024/03/03
地點:高雄市立美術館101-103 展間
2024 MUSE Design Awards Conceptual Design – Interaction SILVER Winner
“Gaze and Graze," an eye-tracking interactive installation supported by the Taiwan Ministry of Science and Technology Council project, was showcased at NYCU Arts Center (June 2023) and the Taiwan Kaohsiung Museum of Fine Arts (Dec 2023 to Mar 2024).
This innovative work deconstructs traditional Taiwanese Hand Puppetry, leveraging eye-tracking technology to redefine audience engagement. Spectators seated in front of the stage control puppets through eye movements while others on the ground observe this unique fusion of technology and culture. The installation transforms the audience into both viewers and participants, immersing them in the rich context of hand puppetry.
Utilizing the Stage of the Seden Society Puppet Theater provided by the National Taiwan Museum, “Gaze and Graze" addresses challenges facing traditional puppetry. Despite its cultural significance, the art form struggles with declining interest and a widening talent gap. Traditional puppet details, often overlooked, hinder a deeper appreciation of their artistic intricacies. This installation seeks to bridge this gap by integrating eye-tracking technology, enriching the audience’s understanding and experience of Taiwanese Hand Puppets.
While contemporary adaptations, such as 3D animation, aim to broaden puppetry’s appeal, live performances and audience interactions require enhancement. “Gaze and Graze" fills this gap by offering a unique interactive experience. Through eye-tracking, audiences can closely examine puppet details—costumes, patterns, and embroidery—gaining a profound understanding of their cultural and artistic significance. This fusion of traditional art and modern technology aims to enrich cultural experiences, preserve Taiwan’s heritage, and drive the continual innovation of cultural arts.
Interactive instructions: Controlling the puppet’s entrance and exit through eye movement, the audience sits in chairs in front of the stage and uses their eyes to observe the “entrance" or “exit" of the hand puppet in the performance.
Team members: I-Ping Chen, Tsuei-Ju Hsieh, Yun-Ju Chen, Chung-Yu Hsu
Special thanks: Chun-Cheng Hsu Lab, TOBII Co., Ltd, The Seidan Glove Puppetry Foundation
2023, Eye-tracking interactive installation, Depend on the space
Medium: Eye tracker, computer, projector, speaker, infrared sensor
《眼控觀偶》以眼動技術解構掌中戲視覺符號,邀請觀眾入坐在戲臺前方的椅子,以眼控互動的方式控制戲臺中舞台出場的戲偶,其它觀者席地而坐,觀賞由觀眾即是布袋戲導演的過程,透過投影創造一個布袋戲戲臺意象,營造觀眾即是觀賞者又是參與者,一同進到布袋戲演出的情境之中。
互動說明:以眼動控制戲偶出場,觀者坐在戲臺前方的椅子,用眼睛觀看戲臺中的「入相」或「出將」操控布袋戲偶。
團隊成員:陳一平、謝翠如、陳韻如、許仲佑
特別感謝:許峻誠實驗室、拓比有限公司、西田社布袋戲基金會
*西田社彩樓由國立臺灣博物館提供
2023年,眼控互動裝置,依場地而定
媒材:眼動儀、電腦、投影機、喇叭、紅外線感應器
















