Zoekresultaten

Measuring safety in aviation

As part of their SMS, aviation service providers are required to develop and maintain the means to verify the safety performance of their organisation and to validate the effectiveness of safety risk controls. Furthermore, service providers must verify the safety performance of their organisation with reference to the safety performance indicators and safety performance targets of the SMS in support of their organisation’s safety objectives. However, SMEs lack sufficient data to set appropriate safety alerts and targets, or to monitor their performance, and no other objective criteria currently exist to measure the safety of their operations. The Aviation Academy of the Amsterdam University of Applied Sciences therefore took the initiative to develop alternative safety performance metrics. Based on a review of the scientific literature and a survey of existing safety metrics, we proposed several alternative safety metrics. After a review by industry and academia, we developed two alternative metrics into tools to help aviation organisations verify the safety performance of their organisations.The AVAV-SMS tool measures three areas within an organisation’s Safety Management System:• Institutionalisation (design and implementation along with time and internal/external process dependencies).• Capability (the extent to which managers have the capability to implement the SMS).• Effectiveness (the extent to which the SMS deliverables add value to the daily tasks of employees).The tool is scalable to the size and complexity of the organisation, which also makes it useful for small and medium-sized enterprises (SMEs). The AVAS-SCP tool also measures three areas in the organisation’s safety culture prerequisites to foster a positive safety culture:• Organisational plans (whether the company has designed/documented each of the safety cultureprerequisites).• Implementation (the extent to which the prerequisites are realised by the managers/supervisors acrossvarious organisational levels).• Perception (the degree to which frontline employees perceive the effects of managers’ actions relatedto safety culture).We field-tested these tools, demonstrating that they have adequate sensitivity to capture gaps between Work-as-Imagined (WaI) and Work-as-Done (WaD) across organisations. Both tools are therefore useful to organisations that want to self-assess their SMS and safety culture prerequisite levels and proceed to comparisons among various functions and levels and/or over time. Our field testing and observations during the turn-around processes of a regional airline confirm that significant differences exist between WaI and WaD. Although these differences may not automatically be detrimental to safety, gaining insight into them is clearly necessary to manage safety. We conceptually developed safety metrics based on the effectiveness of risk controls. However, these could not be fully field-tested within the scope of this research project. We recommend a continuation of research in this direction. We also explored safety metrics based on the scarcity of resources and system complexity. Again, more research is required here to determine whether these provide viable solutions.

Exploring the Embodied Experience of Walking Meetings through Bodystorming – Implications for Design

Walking meetings are a promising way to reduce unhealthy sedentary behavior at the office. Some aspects of walking meetings are however hard to assess using traditional research approaches that do not account well for the embodied experience of walking meetings. We conducted a series of 16 bodystorming sessions, featuring unusual walking meeting situations to engage participants (N=45) in a reflective experience. After each bodystorming, participants completed three tasks: a body map, an empathy map, and a rating of workload using the NASA-TLX scale. These embodied explorations provide insights on key themes related to walking meetings: material and tools, physical and mental demand, connection with the environment, social dynamics, and privacy. We discuss the role of technology and opportunities for technology-mediated walking meetings. We draw implications for the design of walking meeting technologies or services to account for embodied experiences, and the individual, social, and environmental factors at play.

Exploiting data from safety investigations and processes to assess performance of safety management aspects

This paper presents an alternative way to use records from safety investigations as a means to support the evaluation of safety management (SM) aspects. Datasets from safety investigation reports and progress records of an aviation organization were analyzed with the scope of assessing safety management’s role, speed of safety communication, timeliness of safety investigation processes and realization of safety recommendations, and the extent of convergence among SM and investigation teams. The results suggested an interfering role of the safety department, severe delays in safety investigations, timely implementation of recommendations, quick dissemination of investigation reports to the end-users, and a low ratio of investigation team recommendations included in the final safety investigation reports. The results were attributed to non-scalable safety investigation procedures, ineffective resource management, lack of consistent bidirectional communication, lack of investigators’ awareness about the overall organizational context, and a weak commitment of other departments to the realization of safety recommendations. The set of metrics and the combination of quantitative and qualitative methods presented in this paper can support organizations to the transition towards a performance-based evaluation of safety management.

Review of existing aviation safety metrics

Hazard analysis & safety requirements for small drone operations

Currently, published risk analyses for drones refer mainly to commercial systems, use data from civil aviation, and are based on probabilistic approaches without suggesting an inclusive list of hazards and respective requirements. Within this context, this paper presents: (1) a set of safety requirements generated from the application of the Systems Theoretic Process Analysis (STPA) technique on a generic small drone system; (2) a gap analysis between the set of safety requirements and the ones met by 19 popular drone models; (3) the extent of the differences between those models, their manufacturers, and the countries of origin; (4) the association of drone prices with the extent they meet the requirements derived by STPA. The application of STPA resulted in 70 safety requirements distributed across the authority, manufacturer, end user, and drone automation levels. A gap analysis showed high dissimilarities regarding the extent to which the 19 drones meet the same safety requirements. Statistical results suggested a positive correlation between drone prices and the extent that the 19 drones studied herein met the safety requirements generated by STPA, and significant differences were identified among the manufacturers. This work complements the existing risk assessment frameworks for small drones, and contributes to the establishment of a commonly endorsed international risk analysis framework. Such a framework will support the development of a holistic and methodologically justified standardization scheme for small drone flights.

How much do organizations plan for a positive safety culture?

Safety culture has been a topic of discussion in safety literature in the past three decades. Since its first mentioning after the Chernobyl accident much have been written about what fosters a positive safety culture within organizations. The Aviation Academy of the Amsterdam University of Applied Sciences conducted a literature review into safety culture development guidelines and identified a list of 37 prerequisites for safety culture development. Existing safety culture assessment tools target to measure the subjective perceptions of the workforce without examining the parameters affecting safety culture. Thus, they cannot be used to provide the organisations with guidance on the action points for improving their safety culture. To accommodate the need for practical guidance to companies, and as part of four-year research into Aviation Safety Metrics, the Aviation Academy has developed the AVAC-SCP tool, which aims to shed light on the planning and implementation for developing a safety culture. Knowledge experts and companies have reviewed the tool as a means to meet various criteria referred to literature with regards to safety metrics. The tool will enable organisations to derive actionable points from the results. A scoring method is included in the AVAC-SCP in order provide organizations with the ability to monitor their performance over time, compare between departments, and prioritize changes. The concept, academic background, reviews and other characteristics of the AVAC-SCP are discussed.