BACKGROUND: Prediction models and prognostic scores have been increasingly popular in both clinical practice and clinical research settings, for example to aid in risk-based decision making or control for confounding. In many medical fields, a large number of prognostic scores are available, but practitioners may find it difficult to choose between them due to lack of external validation as well as lack of comparisons between them.METHODS: Borrowing methodology from network meta-analysis, we describe an approach to Multiple Score Comparison meta-analysis (MSC) which permits concurrent external validation and comparisons of prognostic scores using individual patient data (IPD) arising from a large-scale international collaboration. We describe the challenges in adapting network meta-analysis to the MSC setting, for instance the need to explicitly include correlations between the scores on a cohort level, and how to deal with many multi-score studies. We propose first using IPD to make cohort-level aggregate discrimination or calibration scores, comparing all to a common comparator. Then, standard network meta-analysis techniques can be applied, taking care to consider correlation structures in cohorts with multiple scores. Transitivity, consistency and heterogeneity are also examined.RESULTS: We provide a clinical application, comparing prognostic scores for 3-year mortality in patients with chronic obstructive pulmonary disease using data from a large-scale collaborative initiative. We focus on the discriminative properties of the prognostic scores. Our results show clear differences in performance, with ADO and eBODE showing higher discrimination with respect to mortality than other considered scores. The assumptions of transitivity and local and global consistency were not violated. Heterogeneity was small.CONCLUSIONS: We applied a network meta-analytic methodology to externally validate and concurrently compare the prognostic properties of clinical scores. Our large-scale external validation indicates that the scores with the best discriminative properties to predict 3 year mortality in patients with COPD are ADO and eBODE.
A promising contribution of Learning Analytics is the presentation of a learner's own learning behaviour and achievements via dashboards, often in comparison to peers, with the goal of improving self-regulated learning. However, there is a lack of empirical evidence on the impact of these dashboards and few designs are informed by theory. Many dashboard designs struggle to translate awareness of learning processes into actual self-regulated learning. In this study we investigate a Learning Analytics dashboard based on existing evidence on social comparison to support motivation, metacognition and academic achievement. Motivation plays a key role in whether learners will engage in self-regulated learning in the first place. Social comparison can be a significant driver in increasing motivation. We performed two randomised controlled interventions in different higher-education courses, one of which took place online due to the COVID-19 pandemic. Students were shown their current and predicted performance in a course alongside that of peers with similar goal grades. The sample of peers was selected in a way to elicit slight upward comparison. We found that the dashboard successfully promotes extrinsic motivation and leads to higher academic achievement, indicating an effect of dashboard exposure on learning behaviour, despite an absence of effects on metacognition. These results provide evidence that carefully designed social comparison, rooted in theory and empirical evidence, can be used to boost motivation and performance. Our dashboard is a successful example of how social comparison can be implemented in Learning Analytics Dashboards.
MULTIFILE
This report summarizes the result of the comparison between 4 weather stations: 2 Kestrels 5400 Heat Stress and 2 Davis Vantage Pro2. The measurements were performed from the 08/04/2019 to 11/04/2019 on the rooftop of the Benno Premselahuis from the Hogeschool van Amsterdam.
MULTIFILE
Due to their diverse funding sources, theatres are under increasing pressure to demonstrate impact on society. The Raad voor Cultuur (2023) for example advised the secretary of state to include societal impact as an additional evaluation measure next to artistic value. Many theaters, such as the Chassé Theater and Parkstad Limburg Theaters, have reformulated their missions to focus on impact of performances on visitors. This is a profound transformation from merely selling tickets and filling seats, and requires new measurement instruments to monitor, manage, and improve impact. Currently available instruments are insufficient, and effective monitoring is crucial to larger future projects that theaters are currently planning to systematically broaden impacts of performances on their communities. The specific goal of this project is to empower theaters to monitor and improve impact by developing a brief experience impact questionnaire, taking existing data from student projects conducted at the Chassé Theater about performing arts experiences on one hand, and experience impact theory innovations on the other, as starting points. We will develop potential items to measure and benchmark against established measures of valued societal outcomes, such as subjective well-being and quality of life. These will be measured in questionnaires developed with project partners Chassé Theater and Parkstad Limburg Theaters and administered before and after performances across a wide range of genres. The resulting data will enable comparison of new questionnaire items with benchmarked measures of valued societal outcomes. The final product of the project will be a brief impact questionnaire, which within several brief self-report instruments and just a few minutes can effectively be used to quantify the impact of a performing arts experience. A workshop and practice-oriented article will make this questionnaire implementable, thereby mobilizing the key enabling methodology of monitoring and impact measurement in the performing arts sector.
Due to their diverse funding sources, theatres are under increasing pressure to demonstrate impact on society. The Raad voor Cultuur (2023) for example advised the secretary of state to include societal impact as an additional evaluation measure next to artistic value. Many theaters, such as the Chassé Theater and Parkstad Limburg Theaters, have reformulated their missions to focus on impact of performances on visitors. This is a profound transformation from merely selling tickets and filling seats, and requires new measurement instruments to monitor, manage, and improve impact. Currently available instruments are insufficient, and effective monitoring is crucial to larger future projects that theaters are currently planning to systematically broaden impacts of performances on their communities.The specific goal of this project is to empower theaters to monitor and improve impact by developing a brief experience impact questionnaire, taking existing data from student projects conducted at the Chassé Theater about performing arts experiences on one hand, and experience impact theory innovations on the other, as starting points. We will develop potential items to measure and benchmark against established measures of valued societal outcomes, such as subjective well-being and quality of life. These will be measured in questionnaires developed with project partners Chassé Theater and Parkstad Limburg Theaters and administered before and after performances across a wide range of genres. The resulting data will enable comparison of new questionnaire items with benchmarked measures of valued societal outcomes. The final product of the project will be a brief impact questionnaire, which within several brief self-report instruments and just a few minutes can effectively be used to quantify the impact of a performing arts experience. A workshop and practice-oriented article will make this questionnaire implementable, thereby mobilizing the key enabling methodology of monitoring and impact measurement in the performing arts sector.Societal issueThe specific goal of this project is to empower theaters to monitor and improve impact by developing a brief experience impact questionnaire, taking existing data about performing arts experiences on one hand, and experience impact theory innovations on the other, as starting points. Benefit to societyWe will develop potential items to measure and benchmark against established measures of valued societal outcomes, such as subjective well-being and quality of life. Collaborative partnersChassé Theater N.V., Parkstad Limburg Theaters N.V.
Wheelchair users with a spinal cord injury (SCI) or amputation generally lead an inactive lifestyle, associated with reduced fitness and health. Digital interventions and sport and lifestyle applications (E-platforms) may be helpful in achieving a healthy lifestyle. Despite the potential positive effects of E-platforms in the general population, no studies are known investigating the effects for wheelchair users and existing E-platforms can not be used to the same extent and in the same manner by this population due to differences in physiology, body composition, exercise forms and responses, and risk injury. It is, therefore, our aim to adapt an existing E-platform (Virtuagym) within this project by using existing data collections and new data to be collected within the project. To reach this aim we intend to make several relevant databases from our network available for analysis, combine and reanalyze these existing databases to adapt the existing E-platform enabling wheelchair users to use it, evaluate and improve the use of the adapted E-platform, evaluate changes in healthy active lifestyle parameters, fitness, health and quality of life in users of the E-platform (both wheelchair users and general population) and identify determinants of these changes, identify factors affecting transitions from an inactive lifestyle, through an intermediate level, to an athlete level, comparing wheelchair users with the general population, and comparing Dutch with Brazilian individuals. The analysis of large datasets of exercise and fitness data from various types of individuals with and without disabilities, collected over the last years both in the Netherlands and Brazil, is an innovative and potentially fruitful approach. It is expected that the comparison of e.g. wheelchair users in Amsterdam vs. Sao Paulo or recreative athletes vs. elite athletes provides new insight in the factors determining a healthy and active lifestyle.
