Modelling a quantitative assessment method of pilots’ performance in evidence-based training
Abstract
With the improvement in reliability of modern aircraft systems, an increase in their complexity led to the fact that failures became non-standard and problematic to predict. As a result, IATA guided the development of Evidence-Based Training (EBT), which is an innovative approach to the training and assessment of pilots’ competencies based on the evidence obtained from their performance. Yet, operators planning to use this framework should develop line-oriented scenarios based on EBT methodology and a grading system for a clear assessment. In this paper, a method for modelling a quantitative assessment and grading of pilots’ performance is proposed. The method may be used as part of an EBT assessment programme due to its adaptability to different grading strategies according to quantifiable error criteria, the number of occurrences during the evaluation, and prior data on the distribution of pilots by their competency levels.
Keyword : evidence-based training, pilot assessment, core competencies, grading system, error criteria, flight occurrences
This work is licensed under a Creative Commons Attribution 4.0 International License.
References
European Aviation Safety Agency. (2015). ED Decision 2015-027-R. Implementation of evidence-based training (EBT) within the European regulatory framework (pp. 1–11). https://www.easa.europa.eu/sites/default/files/dfu/ED
European Aviation Safety Agency. (2016a). EASA Part-FCL. https://www.easa.europa.eu/sites/default/files/dfu/Part-FCL.pdf
European Aviation Safety Agency. (2016b). European Aviation Safety Agency Acceptable Means of Compliance (AMC) and Guidance Material (GM) to Annex III-Part-ORO (Issue 2, p. 206). https://www.easa.europa.eu/sites/default/files/dfu/Consolidated
European Aviation Safety Agency. (2019). European Plan for Aviation Safety (EPAS) 2020–2024. https://www.easa.europa.eu/sites/default/files/dfu/EPAS_2020-2024.pdf
Federal Aviation Administration. (1988). Advisory Circular 25.1309–1A System Design and Analysis. https://www.faa.gov/documentLibrary/media/Advisory_Circular/AC_25.1309-1A.pdf
Federal Aviation Administration. (2013). SAFO 13002 manual flight operations. In Safety alert for operators. http://www.ict-21.ch/com-ict/IMG/pdf/Binder3-FAA-SAFO.pdf
Flight Safety Foundation. (1997). Facilitating LOS debriefings: A Training Manual (Issue November). FSF.
Hazzauri, M., & Shestakov, V. (2000). Statistical modelling of operative decision making by the ATC controller in conditions of insufficient information. In Nauchnyi vestnik MGTU GA (Issue September, pp. 67–76). MGTUGA.
International Air Transport Association. (2013). Evidence-based training implementation guide (1st ed., Issue July). IATA. https://www.iata.org/contentassets/c0f61fc821dc4f62bb6441d7abedb076/ebt-implementation-guide.pdf
International Civil Aviation Organization. (2013). Manual of Evidence-based Training DOC 9995 (1st ed.). ICAO.
Karaush, V. L. (1991). Statisticheskoe modelirovanie processa prinyatia reshenia operatorom (pilotom) v usloviah ogranichennoi informacii [Doctoral Dissertation, Saint Petersburg State University of Civil Aviation]. Saint Petersburg, Russia.
Mixon, T. R., & Moroney, W. F. (1981). An annotated bibliography of objective pilot performance measures (Technical report: IH-330). Naval Training Equipment Center. Orlando, FL. https://apps.dtic.mil/sti/pdfs/ADA113170.pdf