Recently multimodal and affective technologies have been adopted to support expressive and engaging interaction, bringing up a plethora of new research questions. Among the challenges, few essential topics are 1) how to devise truly multimodal systems that can be used seamlessly for customized performance and content generation, and 2) how to utilize tracking of emotional cues and respond to them in order to create affective interaction loops. We present PuppetWall, a multi-user, multimodal system intended for digitally augmented puppeteering. This application allows natural interaction to control puppets and manipulate playgrounds comprised of background, props and puppets. PuppetWall utilizes hand movement tracking, a multi-touch display and emotion speech recognition input for interfacing. Here we document the technical features of the system and an initial evaluation. The evaluation involved two professional actors and also aimed at exploring naturally emerging expressive speech categories. We conclude by summarizing challenges in tracking emotional cues from acoustic features and their relevance for the design of affective interactive systems.
The Helsinki Institute for Information Technology HIIT conducts world-class research on future information technology. HIIT is a joint research institution of Helsinki University of Technology TKK and the University of Helsinki.
PuppetWall tkk 意味 | |
| 1 Likes | 1 Dislikes |
| 1,145 views views | 131 followers |
| Science & Technology | Upload TimePublished on 27 Aug 2008 |
Không có nhận xét nào:
Đăng nhận xét