Exploring How Interactive Technology Enhances Gesture-Based Expression and Engagement: A Design Study

Authors: Zhao, S.

Journal: MULTIMODAL TECHNOLOGIES AND INTERACTION

Volume: 3

Issue: 1

eISSN: 2414-4088

DOI: 10.3390/mti3010013

https://eprints.bournemouth.ac.uk/33441/

Source: Web of Science (Lite)

Exploring How Interactive Technology Enhances Gesture-Based Expression and Engagement: A Design Study

Authors: Zhao, S.

Journal: Multimodal Technologies Interact

Volume: 3

Issue: 1

Pages: 1-13

Publisher: Multidisciplinary Digital Publishing Institute

eISSN: 2414-4088

ISSN: 2414-4088

DOI: 10.3390/mti3010013

Abstract:

he interpretation and understanding of physical gestures play a significant role in various forms of art. Interactive technology and digital devices offer a plethora of opportunities for personal gesture-based experience and they assist in the creation of collaborative artwork. In this study, three prototypes for use with different digital devices (digital camera, PC camera, and Kinect) were designed. Subsequently, a series of workshops were conducted and in-depth interviews with participants from different cultural and occupational backgrounds. The latter were designed to explore how to specifically design personalised gesture-based expressions and how to engage the creativity of the participants in their gesture-based experiences. The findings indicated that, in terms of gesture-based interaction, the participants preferred to engage with the visual traces that were displayed at specific timings in multi-experience spaces. Their gesture-based interactions could effectively support non-verbal emotional expression. In addition, the participants were shown to be strongly inclined to combine their personal stories and emotions into their own gesture-based artworks. Based on the participants’ different cultural and occupational backgrounds, their artistic creation could be spontaneously formed.

https://eprints.bournemouth.ac.uk/33441/

https://doi.org/10.3390/mti3010013

Source: Manual

Exploring How Interactive Technology Enhances Gesture-Based Expression and Engagement: A Design Study

Authors: Zhao, S.

Journal: Multimodel Technologies and Interaction

Volume: 3

Issue: 1

Pages: 1-13

ISSN: 2414-4088

Abstract:

The interpretation and understanding of physical gestures play a significant role in various forms of art. Interactive technology and digital devices offer a plethora of opportunities for personal gesture-based experience and they assist in the creation of collaborative artwork. In this study, three prototypes for use with different digital devices (digital camera, PC camera, and Kinect) were designed. Subsequently, a series of workshops were conducted and in-depth interviews with participants from different cultural and occupational backgrounds. The latter were designed to explore how to specifically design personalised gesture-based expressions and how to engage the creativity of the participants in their gesture-based experiences. The findings indicated that, in terms of gesture-based interaction, the participants preferred to engage with the visual traces that were displayed at specific timings in multi-experience spaces. Their gesture-based interactions could effectively support non-verbal emotional expression. In addition, the participants were shown to be strongly inclined to combine their personal stories and emotions into their own gesture-based artworks. Based on the participants’ different cultural and occupational backgrounds, their artistic creation could be spontaneously formed.

https://eprints.bournemouth.ac.uk/33441/

Source: BURO EPrints