Service of SURF
© 2025 SURF
Lecture in PhD Programme Life Science Education Research UMCU. Course Methods of Life Science Education Research. Utrecht, The Netherlands. abstract Audit trail procedures are applied as a way to check the validity of qualitative research designs, qualitative analyses, and the claims that are made. Audit trail procedures can be conducted based on the three criteria of visibility, comprehensibility, and acceptability (Akkerman et al., 2008). During an audit trail procedure, all documents and materials resulting from the data gathering and the data analysis are assessed by an auditor. In this presentation, we presented a summative audit trail procedure (Agricola, Prins, Van der Schaaf & Van Tartwijk, 2021), whereas in a second study we used a formative one (Agricola, Van der Schaaf, Prins & Van Tartwijk, 2022). For both studies, two different auditors were chosen. For the study presented in Agricola et al. (2021) the auditor was one of the PhD supervisors, while in that presented Agricola et al. (2022) was a junior researcher not involved in the project. The first auditor had a high level of expertise in the study’s topic and methodology. As a result, he was able to provide a professional and critical assessment report. Although the second auditor might be considered to be more objective than the first, as she was not involved in the project, more meetings were needed to explain the aim of the study and the aim of the audit trail procedure. There are many ideas about the criteria that qualitative studies should meet (De Kleijn en Van Leeuwen, 2018). I argue that procedures of checking for interrater agreement and understanding, the triangulation, and audit trail procedures can increase the internal validity of qualitative studies. Agricola, B. T., Prins, F. J., van der Schaaf, M. F., & van Tartwijk, J. (2021). Supervisor and Student Perspectives on Undergraduate Thesis Supervision in Higher Education. Scandinavian Journal of Educational Research, 65(5), 877-897. doi: https://doi.org/10.1080/00313831.2020.1775115 Agricola, B. T., van der Schaaf, M. F., Prins, F. J., & van Tartwijk, J. (2022). The development of research supervisors’ pedagogical content knowledge in a lesson study project. Educational Action Research. doi: https://doi.org/10.1080/09650792.2020.1832551 de Kleijn, R. A. M., & Van Leeuwen, A. (2018). Reflections and review on the audit procedure: Guidelines for more transparency. International Journal of Qualitative Methods, 17(1), 1-8. doi: https://doi.org/10.1177/1609406918763214 Akkerman, S., Admiraal, W., Brekelmans, M., & Oost, H. (2008). Auditing quality of research in social sciences. Quality & Quantity, 42(2), 257-274. doi: https://doi.org/10.1007/s11135-006-9044-4
Background: Healthy urban environments require careful planning and a testing of environmental quality that goes beyond statutory requirements. Moreover, it requires the inclusion of resident views, perceptions and experiences that help deepen the understanding of local (public health) problems. To facilitate this, neighbourhoods should be mapped in a way that is relevant to them. One way to do this is participative neighbourhood auditing. This paper provides an insight into availability and characteristics of participatory neighbourhood audit instruments. Methods: A scoping review in scientific and grey literature, consisting of the following steps: literature search, identification and selection of relevant audit instruments, data extraction and data charting (including a work meeting to discuss outputs), reporting. Results: In total, 13 participatory instruments were identified. The role of residents in most instruments was as ‘data collectors’; only few instruments included residents in other audit activities like problem definition or analysis of data. The instruments identified focus mainly on physical, not social, neighbourhood characteristics. Paper forms containing closed-ended questions or scales were the most often applied registration method. Conclusions: The results show that neighbourhood auditing could be improved by including social aspects in the audit tools. They also show that the role of residents in neighbourhood auditing is limited; however, little is known about how their engagement takes place in practice. Developers of new instruments need to balance not only social and physical aspects, but also resident engagement and scientific robustness. Technologies like mobile applications pose new opportunities for participative approaches in neighbourhood auditing.
OBJECTIVE: 'Better By Moving' is a multifaceted intervention developed and implemented in collaboration with patients and healthcare professionals to improve physical activity in hospitalized adults. This study aimed to understand if, how and why 'Better By Moving' resulted in higher levels of physical activity by evaluating both outcomes and implementation process.DESIGN: Mixed-methods study informed by the Medical Research Council guidance.SETTING: Tertiary hospital.PARTICIPANTS: Adult patients admitted to surgery, haematology, infectious diseases and cardiology wards, and healthcare professionals.MEASURES: Physical activity was evaluated before and after implementation using the Physical Activity Monitor AM400 on one random day during hospital stay between 8 am and 8 pm. Furthermore, the time spent lying on bed, length of stay and discharge destination was investigated. The implementation process was evaluated using an audit trail, surveys and interviews.RESULTS: There was no significant difference observed in physical activity (median [IQR] 23 [12-51] vs 27 [17-55] minutes, P = 0.107) and secondary outcomes before-after implementation. The intervention components' reach was moderate and adoption was low among patients and healthcare professionals. Patients indicated they perceived more encouragement from the environment and performed exercises more frequently, and healthcare professionals signalled increased awareness and confidence among colleagues. Support (priority, resources and involvement) was perceived a key contextual factor influencing the implementation and outcomes.CONCLUSION: Although implementing 'Better By Moving' did not result in significant improvements in outcomes at our centre, the process evaluation yielded important insights that may improve the effectiveness of implementing multifaceted interventions aiming to improve physical activity during hospital stay.