Deictic gestures are gestures we make during communication to point at objects or persons. Indicative acts of directing-to guide the addressee to an object, while placing-for acts place an object for the addressee’s attention. Commonly used presentation software tools, such as PowerPoint and Keynote, offer ample support for placing-for gestures, e.g. slide transitions, progressive disclosure of list items and animations. Such presentation tools, however, do not generally offer adequate support for the directing-to indicative act (i.e. pointing gestures). In this paper we argue the value of presenting deictic gestures to a remote audience. Our research approach is threefold: identify indicative acts that are naturally produced by presenters; design tangible gestures for multi-touch surfaces that replicate the intent of those indicative acts; and design a set of graphical effects for remote viewing that best represent these indicative acts for the audience. Clinton Jorge1, Jos P. van Leeuwen2, Dennis Dams3, Jan Bouwen4 1 University of Madeira, Madeira-ITI, Funchal, Portugal; 2 The Hague University of Applied Sciences, The Hague, Netherlands; 3,4 Bell Labs, Alcatel-Lucent, Antwerp, Belgium Copyright shared between: University of Madeira, Madeira-ITI, Funchal, Portugal; The Hague University of Applied Sciences, The Hague, Netherlands; Bell Labs, Alcatel-Lucent, Antwerp, Belgium
In this paper, we examine the process of designing robot-performed iconic hand gestures in the context of a long-term study into second language tutoring with children of approximately 5 years old. We explore four factors that may relate to their efficacy in supporting second language tutoring: the age of participating children; differences between gestures for various semantic categories, e.g. measurement words, such as small, versus counting words, such as five; the quality (comprehensibility) of the robot’s gestures; and spontaneous reenactment or imitation of the gestures. Age was found to relate to children’s learning outcomes, with older children benefiting more from the robot’s iconic gestures than younger children, particularly for measurement words. We found no conclusive evidence that the quality of the gestures or spontaneous reenactment of said gestures related to learning outcomes. We further propose several improvements to the process of designing and implementing a robot’s iconic gesture repertoire.
