from the article: "The purpose of this paper is to design a rubric instrument for assessing oral presentation performance in higher education and to test its validity with an expert group. Design/methodology/approach This study, using mixed methods, focusses on: designing a rubric by identifying assessment instruments in previous presentation research and implementing essential design characteristics in a preliminary developed rubric; and testing the validity of the constructed instrument with an expert group of higher educational professionals (n=38). Findings The result of this study is a validated rubric instrument consisting of 11 presentation criteria, their related levels in performance, and a five-point scoring scale. These adopted criteria correspond to the widely accepted main criteria for presentations, in both literature and educational practice, regarding aspects as content of the presentation, structure of the presentation, interaction with the audience and presentation delivery. Practical implications Implications for the use of the rubric instrument in educational practice refer to the extent to which the identified criteria should be adapted to the requirements of presenting in a certain domain and whether the amount and complexity of the information in the rubric, as criteria, levels and scales, can be used in an adequate manner within formative assessment processes. Originality/value This instrument offers the opportunity to formatively assess students’ oral presentation performance, since rubrics explicate criteria and expectations. Furthermore, such an instrument also facilitates feedback and self-assessment processes. Finally, the rubric, resulting from this study, could be used in future quasi-experimental studies to measure students’ development in presentation performance in a pre-and post-test situation."
LINK
from the article: "While previous studies have stressed the importance of feedback delivered by experts, it is unclear whether students' oral presentation competence can be fostered through innovative technology for delivering feedback. This experimental study examined the effectiveness of a virtual reality-based task, in which first-year undergraduate students practiced their presentation in a virtual environment and received feedback produced by the system, on their presentation competence components (i.e. cognition, behaviour and attitudes towards presenting). The effects were compared with a control condition, which was a face-to-face presentation task with expert feedback. The students’ performance was measured using pre- and post-test multiple-choice tests, validated rubrics, and self-evaluation instruments. Results revealed significant improvements from pre-test to post-test in all three presentation competence components, without a difference between the conditions. Furthermore, the self-evaluation tests showed that students who presented in virtual reality were appreciative of the detailed and analytical feedback they received. Because of sample size limitations, the effects found could not be generalised. Therefore, future research on a larger sample is needed to examine population effects. Follow-up studies should focus on the extent to which virtual reality-based tasks can encourage self-regulation skills for the effective and efficient integration of these tasks in presentation courses. "
LINK
While feedback is frequently emphasized as a crucial principle of presentation courses in higher education, previous studies revealed that teachers outperform peers in terms of impact on students’ development of oral presentation competence. Further, presentation research showed that the lack of quality of peer feedback can be considered as an essential argumentation for the identified differences in effect. Follow-up field experiments demonstrated that Virtual Reality (VR) can be considered as a valuable alternative feedback source for developing public speaking skills, since this technology is able to simulate real-life presentation situations as well as to deliver feedback from the VR system to the individual learner. Recent technological developments allowed to convert quantitative information from VR systems into qualitative feedback messages that directly relate to the standards for high-quality feedback. If students are able to individually interpret the feedback messages without the intervention of a human feedback source, it could enrich the quality of feedback in peer and self-learning and further increase students’ oral presentation competence development. This chapter provides a synthesis of the literature in presentation research with the aim to construct a research agenda on computer-mediated feedback in VR for peer learning in this field. Further, two recent VR experiments in presentation research are discussed with the aim to effectively construct feedback messages in VR for improving peer learning.
LINK
