Deictic gestures are gestures we make during communication to point at objects or persons. Indicative acts of directing-to guide the addressee to an object, while placing-for acts place an object for the addressee’s attention. Commonly used presentation software tools, such as PowerPoint and Keynote, offer ample support for placing-for gestures, e.g. slide transitions, progressive disclosure of list items and animations. Such presentation tools, however, do not generally offer adequate support for the directing-to indicative act (i.e. pointing gestures). In this paper we argue the value of presenting deictic gestures to a remote audience. Our research approach is threefold: identify indicative acts that are naturally produced by presenters; design tangible gestures for multi-touch surfaces that replicate the intent of those indicative acts; and design a set of graphical effects for remote viewing that best represent these indicative acts for the audience. Clinton Jorge1, Jos P. van Leeuwen2, Dennis Dams3, Jan Bouwen4 1 University of Madeira, Madeira-ITI, Funchal, Portugal; 2 The Hague University of Applied Sciences, The Hague, Netherlands; 3,4 Bell Labs, Alcatel-Lucent, Antwerp, Belgium Copyright shared between: University of Madeira, Madeira-ITI, Funchal, Portugal; The Hague University of Applied Sciences, The Hague, Netherlands; Bell Labs, Alcatel-Lucent, Antwerp, Belgium
The current study investigated how individual differences among children affect the added value of social robots for teaching second language (L2) vocabulary to young children. Specifically, we investigated the moderating role of three individual child characteristics deemed relevant for language learning: first language (L1) vocabulary knowledge, phonological memory, and selective attention. We expected children low in these abilities to particularly benefit from being assisted by a robot in a vocabulary training. An L2 English vocabulary training intervention consisting of seven sessions was administered to 193 monolingual Dutch five-year-old children over a three- to four-week period. Children were randomly assigned to one of three experimental conditions: 1) a tablet only, 2) a tablet and a robot that used deictic (pointing) gestures (the no-iconic-gestures condition), or 3) a tablet and a robot that used both deictic and iconic gestures (i.e., gestures depicting the target word; the iconic-gestures condition). There also was a control condition in which children did not receive a vocabulary training, but played dancing games with the robot. L2 word knowledge was measured directly after the training and two to four weeks later. In these post-tests, children in the experimental conditions outperformed children in the control condition on word knowledge, but there were no differences between the three experimental conditions. Several moderation effects were found. The robot's presence particularly benefited children with larger L1 vocabularies or poorer phonological memory, while children with smaller L1 vocabularies or better phonological memory performed better in the tablet-only condition. Children with larger L1 vocabularies and better phonological memory performed better in the no-iconic-gestures condition than in the iconic-gestures condition, while children with better selective attention performed better in the iconic-gestures condition than the no-iconic-gestures condition. Together, the results showed that the effects of the robot and its gestures differ across children, which should be taken into account when designing and evaluating robot-assisted L2 teaching interventions.
