A Comparative Analysis: EBT/CBTA vs. Conventional Pilot Training Methodologies

I. Executive Summary

This report provides a comprehensive analysis of the fundamental distinctions between conventional pilot training methodologies and the modern, data-driven frameworks of Evidence-Based Training (EBT) and Competency-Based Training and Assessment (CBTA). The aviation industry’s continuous pursuit of enhanced safety and operational efficiency has necessitated a significant evolution from traditional time-based, maneuver-centric approaches to more adaptive, competency-focused paradigms. This analysis highlights the critical differences in training progression, grading systems, and the integrated nature of competency assessment and skill tests. The modern approach, rooted in real-world operational data, fosters greater pilot resilience and adaptability, preparing aviation professionals more effectively for the complexities and unforeseen challenges inherent in contemporary commercial air transport operations.

II. Introduction: The Evolution of Pilot Training

The landscape of aviation training has undergone a transformative shift, driven by an imperative for continuous improvement in safety and operational efficiency. Historically, international standards and national regulations for airline pilot training were predominantly shaped by accident data from early-generation jet aircraft.¹ This foundational approach often led to a perception that simply repeating pilot exposure to “worst-case” events in training was sufficient to ensure safety.¹ Over time, as new types of events emerged, they were incrementally added to existing requirements, resulting in progressively crowded training programs. This accumulation of discrete requirements inadvertently fostered a “tick-box” approach to training, where the emphasis was on completing a checklist of items rather than cultivating deep understanding or adaptive capabilities.¹

This “tick-box” mentality represents a profound systemic flaw, extending beyond mere administrative inefficiency. It fundamentally undermines the acquisition of deep learning and adaptive skills. Such an approach incentivizes rote performance primarily for the sake of passing a check, rather than fostering genuine understanding, critical thinking, and the flexible application of knowledge in novel, dynamic situations. This can create a dangerous illusion of proficiency, where pilots might meet regulatory minimums without possessing the robust resilience and problem-solving capabilities essential for managing unforeseen operational challenges. The subsequent development of EBT and CBTA directly confronts this by prioritizing comprehensive competency development over superficial compliance.

Concurrently, advancements in aircraft design, automation, and system integration have demonstrably improved operational safety in many respects but have also introduced new operational complexities and challenges.² Early human factors studies, such as those conducted by NASA in the 1970s, revealed a critical gap in understanding the human role in aircraft accidents. Incidents were often attributed simply to “pilot error” without adequate explanation of the underlying causes, even as mechanical reliability significantly improved.³ While technological progress has enhanced aircraft reliability and reduced certain types of errors, it has simultaneously introduced new intricacies in human-machine interaction. This has shifted the focus of accident causation from purely technical failures to human factors, such as situation awareness, decision-making, and workload management in highly automated environments. EBT and CBTA’s explicit integration of non-technical competencies—such as Communication, Leadership and Teamwork, Problem Solving and Decision Making, Situation Awareness, and Workload Management—is a direct, data-driven response to this evolving risk landscape. The aim is to equip pilots with the holistic skillset necessary to operate safely and effectively in modern, complex cockpits.¹

Recognizing these limitations of conventional training, the International Civil Aviation Organization (ICAO) initiated a global safety improvement project to strategically review recurrent and type-rating training for airline pilots.¹ This initiative led to the development of Evidence-Based Training (EBT) and Competency-Based Training and Assessment (CBTA), marking a significant evolution in pilot training methodologies. The purpose of this report is to delineate the core distinctions between conventional and EBT/CBTA pilot training frameworks, focusing on their progression models, grading systems, and the intersection of competencies and skill tests, supported by illustrative examples.

III. Conventional Pilot Training: A Time-Based and Maneuver-Centric Approach

Conventional pilot training has historically followed a highly structured, modular, and sequential progression, emphasizing the accumulation of fixed flight hours and the successful execution of specific maneuvers.

A. Progression Model

In conventional pilot training, progression is primarily determined by the accumulation of prescribed flight hours and the successful completion of distinct training phases.⁶ This model operates on the assumption that a certain quantity of exposure directly correlates with proficiency. Trainees advance through a series of sequential modules, each requiring a predefined curriculum and adherence to minimum hour requirements. For instance, a typical pathway might involve earning a Private Pilot Certificate, followed by an Instrument Rating, then a Commercial Pilot Certificate, and subsequent Multi-Engine Add-Ons, ultimately leading to the 1,500 flight hours often required for airline placement.⁶

The training syllabus within each phase is largely standardized, with a strong emphasis on the mastery of specific flight maneuvers and procedures, such as steep turns, emergency descents, and various instrument approaches.⁸ Training often involves repeating exposure to “worst-case” events, which can lead to a focus on anticipated and rehearsed scenarios.¹ While this approach provides a clear, predictable structure, it offers limited customization to individual learning styles or specific operational contexts, despite some flexibility in choosing instructors or training locations.⁷

This emphasis on repetition for a fixed set of maneuvers, while building technical skill in rehearsed scenarios, can inadvertently lead to a “brittle” skillset. Pilots may become highly proficient at performing pre-defined maneuvers but might lack the adaptability and underlying cognitive abilities, such as problem-solving and situation awareness, to effectively manage novel or unexpected situations that deviate from the trained script.⁹ This creates a critical gap between achieving a “pass” on a standardized test and possessing true operational resilience in a dynamic real-world environment. The focus on “how many” and “how often” in conventional grading reinforces this quantity-over-quality approach, where the primary objective is the correct performance of the maneuver, not necessarily a deeper understanding of principles or adaptation to variations.¹⁰

B. Grading System

The evaluation in conventional training is heavily focused on assessing the performance of individual flight maneuvers against predefined standards and tolerances. These standards dictate acceptable deviations for parameters such as altitude (+/- 100 feet), airspeed (+/- 10 knots), and heading (+/- 15 degrees).¹⁰ Assessments, particularly practical tests or “checkrides,” frequently result in a binary pass/fail outcome for individual tasks or the entire examination. For example, a single maneuver performed “Below Acceptable Standards” (often a Grade 5 on a 5-point scale) can lead to the failure of an entire stage check.¹⁰

Regulatory frameworks govern these assessments. In the United States, the Federal Aviation Administration (FAA) historically utilized Practical Test Standards (PTS) and has largely transitioned to Airman Certification Standards (ACS). While ACS integrates knowledge and risk management elements, its core still defines acceptable performance for “flight proficiency” (skills) through specific tasks.¹² In Europe, the European Union Aviation Safety Agency (EASA) Private Pilot License (PPL) theoretical exams require a 75% pass mark per subject, and practical tests adhere to similar task-oriented standards.¹⁴

Some flight schools employ a numerical grading scale for individual maneuvers, such as a 5-point scale where 1 is “Excellent” and 5 is “Below Acceptable Standards”.¹⁰ A consistent “Average” (Grade 3) or better is often required for a recommendation for a practical test.¹⁰ Overall performance on stage checks might be assigned a percentage, with a minimum passing threshold, for instance, 80%.¹⁰

Feedback in this system is typically provided by the instructor after a maneuver or session, often highlighting deviations from the standard and what went wrong.¹⁵ While rubrics exist to guide assessment, the interpretation can sometimes be subjective. This reliance on subjective instructor observation introduces inherent variability and potential biases into the grading process. For example, “halo error,” where an instructor’s personal biases or over-identification with a student compromise objectivity, is a recognized concern.¹⁵ Such subjectivity can lead to inconsistencies in assessment standards across different instructors or training institutions, making it challenging to ensure truly standardized and objective evaluations of pilot capability, especially for less quantifiable “non-technical” skills. This stands in stark contrast to the EBT/CBTA approach, which emphasizes data-driven, objective assessment based on observable behaviors to minimize subjective influences and enhance inter-rater reliability among instructors.

C. Skill Test Integration

In conventional training, skill tests, often referred to as “checkrides,” primarily serve as summative evaluations conducted at the culmination of specific training phases.¹⁶ Their main purpose is to verify a pilot’s ability to perform a prescribed set of maneuvers and procedures to a regulatory standard, acting as a gate to the next training level or license.¹⁶ Although theoretical knowledge is a prerequisite for these tests, the assessment of knowledge (typically through written examinations) and practical skills (flight tests) are generally distinct events, with less emphasis on their integrated application in complex scenarios.¹⁴ Due to the fixed curriculum and maneuver-based assessment, the scenarios encountered in these skill tests are often highly predictable, allowing pilots to practice for specific test items.⁹ This predictability, while ensuring compliance with a defined standard, means that skill tests in conventional training primarily verify the ability to perform specific, pre-defined actions. They are less focused on assessing broader decision-making, adaptability, or the underlying competencies required to manage unforeseen or complex operational challenges.

IV. EBT/CBTA Framework: A Data-Driven and Competency-Focused Paradigm

The EBT/CBTA framework represents a significant paradigm shift, moving away from traditional hours-based training towards a system centered on demonstrated proficiency in core competencies.

A. Progression Model

EBT/CBTA embodies a learner-centric approach, prioritizing the individual pilot’s growth and development.⁵ Progression is determined by demonstrated proficiency across a comprehensive set of core competencies, rather than simply accumulating flight hours.¹ This ensures that training adapts to the trainee’s specific needs and learning pace. A hallmark of EBT/CBTA is its capacity for adaptive and individualized training paths. It leverages real-world operational data and evidence—derived from accidents, incidents, and daily flight operations—to identify specific training needs and customize learning paths for individuals and airlines.¹ This creates a continuous feedback loop, enabling aviation professionals to constantly assess their performance, adapt their training, and enhance their operational effectiveness and resilience.¹⁷

A central tenet of EBT/CBTA is the integration of a broad range of technical and non-technical (behavioral) competencies. These competencies are considered the fundamental building blocks for safe, effective, and efficient flight operations.¹ The key pilot competencies, as defined by international aviation bodies like ICAO and EASA, include:

• Application of Procedures ¹
• Communication ¹
• Aircraft Flight Path Management (Automation) ¹
• Aircraft Flight Path Management (Manual Control) ¹
• Leadership and Teamwork ¹
• Problem Solving and Decision Making ¹
• Situation Awareness ¹
• Workload Management ¹
• Application of Knowledge (an additional competency proposed by EASA for EBT) ⁴

These competencies are assessed through observable behaviors (OBs) that demonstrate the pilot’s underlying knowledge, skills, and attitudes in dynamic operational contexts.¹ Progression in EBT/CBTA is thus dynamic and adaptive, prioritizing the cultivation of robust capabilities and resilience in managing threats and errors, rather than strict adherence to a fixed schedule or minimum hours. The overarching objective is to equip pilots to manage previously unseen dangerous situations effectively.¹

The underlying concept of EBT is resilience, which refers to the ability to return from an undesired situation to a safe operating level.²³ This objective goes beyond mere compliance or basic operational proficiency; it is about cultivating a pilot’s inherent ability to anticipate, adapt to, and recover from unforeseen, complex, and potentially dangerous situations.²³ This represents a crucial evolution from traditional training, which, by focusing on rehearsed events and fixed procedures, could inadvertently foster rigidity rather than adaptability.⁹ The data-driven, iterative feedback mechanisms and exposure to a wide variety of dynamic, complex scenarios within EBT/CBTA are specifically designed to build this adaptive capacity, making pilots more robust and safer in an ever-changing operational environment.¹

B. Grading System

EBT/CBTA employs performance-based assessments and scenario-based evaluations, moving beyond traditional testing and rote memorization.¹⁷ The focus is on a pilot’s ability to apply knowledge and skills, adapt to situations, and make effective decisions in realistic simulated environments.¹⁷ Continuous feedback loops are integral to this process, allowing learners to refine their skills and address weaknesses.¹⁷

Competency assessment is rigorously structured around observable behaviors (OBs) that manifest a pilot’s underlying knowledge, skills, and attitudes.¹ Instructors are trained to accurately identify and assess these OBs.¹ The ICAO/IATA assessment method, known as the ORCA process, guides instructors to Observe, Record, Classify (against OBs and competencies), and Assess (determine the root cause of performance).¹

To ensure consistency and objectivity, performance is assessed across three dimensions, often referred to as “HOW WELL” dimensions:

1. How many required OBs the trainee demonstrated.¹
2. How often the trainee demonstrated the required OB(s).¹
3. The outcome of Threat and Error Management (TEM) specifically related to the assessed competency.¹

This multi-dimensional approach allows for a more nuanced numerical scale (e.g., a 5-point scale) for each competency, accompanied by qualitative descriptors for each level.¹ This provides more granular feedback than a simple pass/fail. The grading system can include:

• Level 0 (Competent Metrics): A binary assessment indicating whether the pilot is competent or not.¹
• Level 1 (Competency Metrics): A numeric grade (e.g., 1 to 5) for each competency.¹
• Level 2 (Observable Behavior Metrics): Recording specific OBs.¹
• Level 3 (TEM Metrics): Recording Threats, Errors, or Reduction of Safety Margin.¹

IATA recommends an “adequate” level of performance, corresponding to a Grade 3 on a 5-point scale, for each pilot competency at the end of an EBT module.¹ This provides a reasonable safety margin above minimal acceptable performance.

The shift in assessment from “what” a pilot did to “how” and “why” they performed represents a profound pedagogical and philosophical change in aviation training. Conventional assessment often merely verifies if a pilot landed within parameters. EBT/CBTA, however, delves deeper into how performance occurred (e.g., were control inputs smooth and coordinated? How effective was communication?) and, critically, why it occurred (e.g., was the threat effectively managed? Was the decision-making process sound?).¹ This diagnostic capability allows for highly targeted and effective training interventions, addressing fundamental skill or behavioral deficiencies rather than simply correcting superficial symptoms. This moves training from rote compliance to genuine understanding and adaptive capability.

EBT/CBTA grading provides a comprehensive, diagnostic view of performance, directly linking assessment outcomes to identified training needs. It moves beyond a simple “tick-box” approach to a nuanced evaluation of capability, focusing on the quality and effectiveness of performance in context.

Example Case Study: DGI Training Store’s Shift in Dangerous Goods Training

To illustrate the difference in grading and progression, consider a pilot undergoing mandatory dangerous goods training, as exemplified by DGI Training Store’s transition.²⁸

Conventional Grading (Old System):

Under the traditional approach, the pilot would take a comprehensive exam covering various topics such as classification, identification, packing, marking, labeling, documentation, placarding, handling/segregation, safety, and security. The grading was based on an overall score, with a typical passing threshold of, for example, 80%. A pilot could achieve an overall score of 85% and pass the exam, even if they scored poorly (e.g., 5 points out of 10, indicating a fail) on critical sections like “Placarding,” “Handling/Segregation,” and “Safety”.²⁸ The feedback provided might only indicate the overall score, without detailed breakdown of specific weaknesses. This system allowed for a pilot to be deemed “competent” overall while harboring significant, safety-critical knowledge or skill gaps in specific areas.

CBTA Grading (New System 2022):

Under the CBTA approach, the same pilot might still achieve an 85% overall score on the comprehensive exam. However, because CBTA requires proficiency in all learning objectives, the pilot would FAIL the exam due to failing the “Placarding,” “Handling/Segregation,” and “Safety” competency elements.²⁸ The crucial difference is that the pilot would

not need to retake the entire exam. Instead, remediation and retesting would be targeted only on those specific failed competency elements. This ensures that the pilot achieves true proficiency across all critical areas before being certified.

Impact:

This example vividly illustrates how CBTA’s granular, competency-based grading ensures true proficiency across all critical areas, preventing a pilot from passing an overall test while harboring significant, safety-critical knowledge or skill gaps. The targeted remediation also makes the training process more efficient and effective, as resources are directed precisely where needed, rather than requiring a complete re-do of the entire training module.²⁸ This shift moves beyond a superficial “pass” to guarantee a deeper and more reliable level of competence.

C. Competencies and Skill Test Intersection

EBT/CBTA fundamentally redefines the traditional relationship between training and checking, moving from distinct, often separate, events to an integrated, continuous assessment of competencies within realistic, dynamic scenarios.¹ Skill tests, rather than serving as standalone summative gates, are often integrated into the training continuum as formative assessments. For instance, in EBT recurrent training, an initial Evaluation (EVAL) module provides a “first look” at a pilot’s performance in a line-oriented flight scenario without prior briefing.¹ This diagnostic assessment identifies specific training needs and competency gaps.

Subsequent training modules, such as Scenario-Based Training (SBT) and In-Seat Instruction (ISI), are then tailored to address these identified weaknesses, focusing on the application of competencies in complex situations.¹ The emphasis shifts from merely repeating a maneuver to understanding the root causes of performance deficiencies and developing adaptive strategies.¹ This iterative process allows pilots to learn more effectively in a non-punitive environment, where assessment serves as a tool for continuous improvement rather than solely a pass/fail judgment.

This represents a fundamental reordering of the learning and assessment process. Instead of training for a test, EBT/CBTA uses assessment as a tool for continuous learning and improvement. The initial evaluation serves as a diagnostic, identifying specific competency gaps, which then inform highly personalized and efficient subsequent training. This iterative feedback loop transforms the “skill test” from a singular, high-stakes pass/fail gate into an integrated, developmental journey, fostering a culture of continuous learning and adaptation rather than just compliance. This also significantly enhances the psychological safety of the training environment, where errors are viewed as valuable learning opportunities rather than punitive failures.

The role of the instructor evolves from a traditional “examiner” or “content deliverer” to a “facilitator” and “coach”.¹⁷ Instructors are trained to observe and assess observable behaviors, provide objective and constructive feedback, and guide trainees in developing their competencies, including self-assessment. They focus on the “how” and “why” of performance, not just the “what”.¹

In contrast, conventional training often maintains a more compartmentalized approach, where theoretical knowledge is tested separately from practical skills, and skill tests are high-stakes, summative events. The focus is primarily on the accurate execution of specific tasks, with less emphasis on the underlying cognitive processes, decision-making, or the integration of technical and non-technical skills in complex, unforeseen circumstances.¹⁷

The core innovation of EBT/CBTA lies in its attempt to open the “black box” of human performance in aviation. Historically, there was a lack of understanding regarding the human role in aircraft accidents, and explanations for pilot error were often inadequate.³ By systematically collecting and analyzing granular data on observable behaviors and their link to specific competencies, EBT/CBTA provides objective, evidence-based insights into why certain performance occurs or fails to occur.¹ This diagnostic capability enables highly targeted interventions and continuous program improvement, moving beyond superficial corrections to address fundamental skill or behavioral deficiencies. However, this shift necessitates significant investment in robust data collection, analysis, and management systems, along with the development of specialized data science and artificial intelligence expertise, which pose considerable technical and financial challenges.²¹ It also introduces critical considerations regarding data privacy and security.²¹

V. Comparative Analysis: Key Differences and Intersections

The transition from conventional to EBT/CBTA methodologies marks a fundamental shift in the philosophy, structure, and assessment of pilot training. The following tables summarize these critical differences.

A. Progression Model Comparison

Table 1 provides a clear, side-by-side visual representation that distills complex information into an easily digestible format. For aviation training executives or regulatory policy analysts, this immediate comparative view is invaluable for quickly grasping the fundamental differences in training philosophy, structure, and outcomes, highlighting the paradigm shift at a glance.

Table 1: Progression Model Comparison (Conventional vs. EBT/CBTA)

Criterion	Conventional Training	EBT/CBTA
Basis of Progression	Fixed minimum flight hours (e.g., 250 hours for CPL, 1500 for ATP).6	Demonstrated proficiency in core competencies.1
Flexibility	Rigid, sequential modules with predefined content.6	Adaptive, individualized training paths based on real-world data and individual needs.17
Primary Focus	Mastery of discrete maneuvers and tasks; regulatory compliance.2	Development of integrated technical and non-technical competencies, resilience, threat and error management.1
Duration	Predetermined, often time-bound phases (e.g., 12-24 months for integrated programs, 2-3 years for modular).6	Competency-driven, may vary based on individual learning pace and identified needs.1
Learning Approach	Often passive, repetition-based, leading to a “tick-box” mentality.1	Learner-centric, active, scenario-based, continuous data-driven feedback.17
Remediation Strategy	Repetition of failed maneuvers/tasks, potentially requiring re-do of entire segments.10	Targeted training on specific competency gaps identified through detailed assessment.28

B. Grading System Comparison

Table 2 visually clarifies the fundamental shift in how pilot performance is evaluated. It moves from a simple compliance-based approach to a diagnostic, data-informed methodology, emphasizing the increased granularity, objectivity, and actionable nature of EBT/CBTA grading. This is crucial for understanding how training effectiveness is measured and improved.

Table 2: Grading System Comparison (Conventional vs. EBT/CBTA)

Criterion	Conventional Training	EBT/CBTA
Assessment Focus	Accuracy and adherence to parameters for individual maneuvers/tasks.8	Observable Behaviors (OBs) demonstrating core competencies; effectiveness in Threat and Error Management (TEM).1
Scale Type	Often binary (Pass/Fail) or simple numerical scale (e.g., 1-5) for maneuvers; overall percentage for checks.6	Multi-level, nuanced grading (e.g., ICAO/IATA 5-point scale) with qualitative descriptors for “How Many,” “How Often,” and “TEM Outcome”.1
Feedback Mechanism	Instructor observation and debriefing, often subjective; focuses on “what went wrong”.15	Continuous, data-driven, objective feedback loops; instructor as facilitator/coach; focuses on “how” and “why” performance occurred.1
Underlying Philosophy	Compliance with minimum standards; “tick-box” approach.1	Enhanced safety, operational resilience, continuous improvement, adaptability.23
Data Source for Assessment	Instructor’s subjective judgment, limited quantitative data from maneuver performance.15	Operational data, accident/incident data, detailed simulator data, structured instructor observations, potentially AI/ML insights.1

C. Intersection of Competencies and Skill Tests

EBT/CBTA fundamentally redefines the traditional relationship between training and checking, moving from distinct, often separate, events to an integrated, continuous assessment of competencies within realistic, dynamic scenarios.¹ Skill tests, rather than being standalone summative gates, are often integrated into the training continuum as formative assessments. For instance, in EBT recurrent training, an initial Evaluation (EVAL) module provides a “first look” at a pilot’s performance in a line-oriented flight scenario without prior briefing.¹ This diagnostic assessment identifies specific training needs and competency gaps. Subsequent training modules, such as Scenario-Based Training (SBT) and In-Seat Instruction (ISI), are then tailored to address these identified weaknesses, focusing on the application of competencies in complex situations.¹ The emphasis shifts from merely repeating a maneuver to understanding the root causes of performance deficiencies and developing adaptive strategies.¹ This iterative process allows pilots to learn more effectively in a non-punitive environment, where assessment serves as a tool for continuous improvement rather than solely a pass/fail judgment.

This represents a fundamental reordering of the learning and assessment process. Instead of training for a test, EBT/CBTA uses assessment as a tool for continuous learning and improvement. The initial evaluation serves as a diagnostic, identifying specific competency gaps, which then inform highly personalized and efficient subsequent training. This iterative feedback loop transforms the “skill test” from a singular, high-stakes pass/fail gate into an integrated, developmental journey, fostering a culture of continuous learning and adaptation rather than just compliance. This also significantly enhances the psychological safety of the training environment, where errors are viewed as valuable learning opportunities rather than punitive failures.

The ultimate objective of EBT/CBTA transcends mere compliance or basic operational proficiency. It is about cultivating resilience—the pilot’s inherent ability to anticipate, adapt to, and recover from unforeseen, complex, and potentially dangerous situations.²³ This is a crucial evolution from traditional training, which, by focusing on rehearsed events and fixed procedures, could inadvertently foster rigidity rather than adaptability.⁹ The data-driven, iterative feedback mechanisms and exposure to a wide variety of dynamic, complex scenarios within EBT/CBTA are specifically designed to build this adaptive capacity, making pilots more robust and safer in an ever-changing operational environment.

Furthermore, EBT/CBTA’s core innovation lies in its attempt to open the “black box” of human performance in aviation. Early human factors studies highlighted a lack of understanding of the human role in aircraft accidents, and explanations for pilot error were often inadequate.³ By systematically collecting and analyzing granular data on observable behaviors and their link to specific competencies, EBT/CBTA provides objective, evidence-based insights into why certain performance occurs or fails to occur.¹ This diagnostic capability enables highly targeted interventions and continuous program improvement, moving beyond superficial corrections to address fundamental skill or behavioral deficiencies. However, this shift necessitates significant investment in robust data collection, analysis, and management systems, along with the development of specialized data science and artificial intelligence expertise, which pose considerable technical and financial challenges.²¹ It also introduces critical considerations regarding data privacy and security.²¹

VI. Implementation Challenges and Strategic Considerations

The transition to EBT/CBTA, while highly beneficial, is not without its complexities, encompassing cultural, technical, financial, and regulatory hurdles. These challenges are often interconnected, requiring a holistic approach for successful implementation.

A. Cultural Resistance and Mindset Shifts

A primary challenge in implementing EBT/CBTA is the inherent resistance stemming from established organizational cultures and a reluctance to embrace technological and methodological change.²⁹ Effective CBTA implementation necessitates a fundamental rethinking and transformation of the existing organizational culture.³⁰

The transition demands a significant shift in the roles of instructors and evaluators. They must move from a traditional didactic approach—primarily delivering content and conducting pass/fail checks—to a more facilitative, coaching, and guiding role.¹⁷ This includes training instructors to accurately assess competencies through performance-based criteria, provide nuanced feedback, and focus on root causes of performance issues.¹ This profound shift can be met with resistance from instructors accustomed to established practices and a focus on objective, data-driven training can be perceived as a threat to subjective opinions.³³

For trainees, the shift from a checklist-oriented, hours-based system to a learner-centric, competency-based approach requires a new mindset.¹⁷ While CBTA is designed to be adaptive to individual needs, there can be initial resistance or discomfort with the continuous, nuanced assessment and the focus on broader competencies rather than just task completion.²¹

Successful implementation also hinges on absolute full support and commitment from all levels of management.²⁵ This includes not only understanding the principles and benefits of EBT/CBTA but also being prepared for the substantial investment of time, effort, and financial resources required for the transition.²¹ The most complex and often underestimated challenge in EBT/CBTA implementation is indeed the human element, requiring profound shifts in established behaviors, beliefs, and organizational norms across all levels of the training ecosystem.¹⁷

B. Technical and Financial Challenges

EBT/CBTA is inherently data-driven, necessitating robust systems for data collection, analysis, and storage.¹ Challenges include managing the sheer volume of observable behaviors (OBs) to be collected, ensuring data consistency and quality, and the need for sophisticated flight data analysis software.²¹ This often requires specialized data analytics expertise, which may not be readily available within traditional training departments.²¹

Effective implementation of EBT/CBTA relies heavily on advanced flight simulation training devices (FSTDs), including those integrated with virtual reality (VR), augmented reality (AR), mixed reality (MR), Digital Twins, and Artificial Intelligence (AI).¹⁷ The procurement and integration of such state-of-the-art equipment represent a significant initial investment, and these technologies are currently rare in many training institutions, particularly in some regions.²⁹ Integrating AI into simulators also presents technical hurdles, including ensuring reliability, transparency, and the ability to handle human behavioral variability.³⁹

While EBT/CBTA promises long-term benefits such as enhanced safety, improved efficiency, and potential cost savings (e.g., reduced delays/cancellations), the upfront financial investment is substantial.⁴³ This includes costs for acquiring advanced technology, developing new competency-based curricula, and extensive retraining of staff.⁴³ Smaller operators, in particular, may face significant budget constraints and resource limitations in undertaking such a comprehensive transformation.²⁵ The technological leap required for EBT/CBTA is substantial, demanding significant capital investment in infrastructure and specialized expertise in data science and AI, which are often external to traditional aviation training. This necessitates careful financial planning and potentially new funding models.²¹

C. Regulatory Complexities and Global Harmonization

EBT/CBTA is a global safety improvement initiative championed by ICAO, which has extended its principles to all licensing and operator training.¹ However, the actual implementation and regulatory adoption vary significantly across major aviation markets, such as Europe, North America, and Asia.⁵¹

Despite ICAO’s global standards, regulatory complexity and inconsistencies persist among national and international authorities, including the FAA, EASA, and local Civil Aviation Authorities (CAAs).¹ Airlines operating internationally must comply with multiple jurisdictions simultaneously, each with distinct requirements, which adds layers of complexity to standardization.⁴⁸

Key challenges include aligning safety and training data taxonomies, formalizing robust data protection and privacy protocols for sensitive training data, and ensuring international license recognition for pilots trained under diverse CBTA programs.⁵⁰ The shift from time-based to performance-based licensing also requires new competency standards to be defined by State licensing authorities.⁵⁰ While ICAO provides a global framework, the actual implementation and regulatory adoption vary significantly by region, creating a patchwork of compliance requirements that can hinder seamless global standardization and pilot mobility. This necessitates ongoing efforts towards harmonization and mutual recognition.

D. Challenges for Ab-Initio vs. Recurrent Training

EBT was primarily developed and implemented for recurrent and type-rating training for experienced airline pilots, leveraging their existing operational data and experience.¹ A significant challenge for ab-initio (initial cadet) pilot training under EBT/CBTA is the inherent lack of operational data for new entrants.²¹ Since EBT is fundamentally data-driven, relying on evidence collected from operations and training, this creates a “cold start” problem for new cadets who have no prior operational history.¹

The inherent lack of historical operational data for ab-initio cadets creates a significant hurdle for implementing a truly evidence-based approach in initial training. This necessitates alternative strategies: perhaps leveraging aggregated industry-wide data, utilizing advanced simulators for synthetic data generation, or initially adopting a more prescriptive CBTA framework that gradually transitions to a fully data-driven model as individual operational data accumulates.²¹ This also implies a critical need for robust data sharing mechanisms and collaboration between flight schools (Approved Training Organizations – ATOs) and airlines (Air Operator Certificate holders – AOCs) to ensure a seamless and data-informed progression from initial training to line operations.

Ab-initio programs need to adapt their curriculum to encourage learning beyond minimum knowledge requirements, focusing on the quality of education rather than just accumulating hours.³⁰ This requires different strategies for competency development and assessment compared to experienced pilots.⁹ Guidance for CBTA in practical flight training for academies is still developing, often “trickling down” from recurrent EBT experience.¹⁸ Data indicates that there are distinct generational differences in patterns of existing risk that are not adequately addressed by current training, implying different training needs for new versus experienced pilots.⁹

The research reveals that the various implementation challenges are not isolated but deeply interconnected. For instance, cultural resistance directly impacts the willingness of instructors to adopt new roles and the overall acceptance of data-driven training.³⁰ Financial constraints limit the ability to invest in essential digital infrastructure and integrate advanced simulation technologies.²⁹ Furthermore, regulatory inconsistencies across different regions complicate global standardization efforts, impacting the seamless transfer of pilots and training methodologies.⁵⁰

Implementing EBT/CBTA is not a modular upgrade but a systemic, holistic transformation of the entire aviation training ecosystem. Success in one area (e.g., effective data collection) is contingent upon simultaneous progress and integration across other dimensions (e.g., instructor retraining, management buy-in, regulatory alignment, and substantial financial investment). A piecemeal or siloed approach is unlikely to yield optimal results. Therefore, a coordinated, multi-faceted strategic plan that addresses human, technical, financial, and regulatory dimensions concurrently is essential for successful and sustainable EBT/CBTA implementation. The necessary mindset shift across all stakeholders emerges as an overarching critical factor, as it underpins the willingness to invest, adapt, and collaborate across the industry.¹⁷

VII. Conclusion and Recommendations

EBT/CBTA represents a critical evolution in aviation training, moving beyond outdated, hours-based, and maneuver-centric approaches. It is a global safety improvement initiative supported by leading aviation organizations such as ICAO, EASA, and IATA, fundamentally enhancing safety and operational effectiveness.¹ By focusing on the development of core competencies, fostering resilience, and leveraging data-driven insights, EBT/CBTA prepares pilots more effectively for the complexities and unforeseen challenges of modern commercial air transport operations, shifting from mere “tick-box” compliance to genuine operational capability.¹

To ensure successful implementation and optimization of EBT/CBTA, the following strategic recommendations are crucial:

• Phased Implementation Strategies: Organizations should adopt a well-coordinated, phased approach to EBT/CBTA implementation. This allows for gradual integration, learning from initial experiences (e.g., EASA’s progression from ‘mixed EBT’ to ‘baseline EBT’), and building upon existing successful elements where possible, rather than attempting a disruptive, large-scale overhaul.⁵³
• Investment in Instructor Training and Development: Prioritize comprehensive training programs for instructors and evaluators. This training must focus on fostering a facilitative, coaching approach, developing expertise in competency-based assessment, and proficiency in utilizing data-driven tools and feedback mechanisms.¹⁷ Establishing robust Instructor Concordance Assurance Programs (ICAP) is vital to ensure standardization and objectivity in assessments across the training fleet.
• Robust Data Infrastructure and Analytics Capabilities: Allocate significant resources to establish and maintain advanced digital infrastructure, including state-of-the-art flight simulators and sophisticated data analysis systems.¹⁷ Develop in-house data analytics expertise or forge strategic partnerships with external specialists to effectively collect, process, analyze, and integrate diverse operational and training data.²¹ Crucially, implement stringent data protection and privacy protocols to ensure the ethical and secure use of sensitive performance data.⁵⁰
• Fostering a Culture of Continuous Learning and Feedback: Cultivate an organizational culture that actively embraces change, values continuous improvement, and promotes psychological safety within the training environment.¹⁷ This involves encouraging open feedback, viewing errors as learning opportunities, and fostering a collaborative mindset among trainees, instructors, and management. Continuous feedback loops for learners are paramount for skill refinement and adaptation.¹⁷
• Proactive Regulatory Engagement and Harmonization: Actively engage with national and international regulatory bodies (e.g., ICAO, EASA, FAA) to contribute to the ongoing development of harmonized standards and address existing regional inconsistencies in EBT/CBTA implementation.¹ Advocate for clear, adaptable guidelines, particularly for ab-initio CBTA programs, to ensure consistency and facilitate international license recognition.⁵⁰
• Strategic Leveraging of AI and Immersive Technologies: Explore and strategically integrate emerging technologies such as Artificial Intelligence (AI) and immersive technologies (Virtual Reality, Augmented Reality, Digital Twins) into training programs.¹⁷ These technologies can significantly enhance realism, enable personalized learning paths, and improve data collection capabilities.³⁹ However, their implementation must be carefully managed to address associated technical challenges, ethical considerations (e.g., bias, transparency), and human factors integration.³¹

Future Outlook:

EBT/CBTA is not merely a transient trend but the definitive future of aviation training. Its continuous evolution, driven by new operational evidence, technological advancements, and a deeper understanding of human performance, is essential for preparing the next generation of pilots to operate safely, efficiently, and with unparalleled resilience in an increasingly complex and dynamic global aviation environment.

Works cited

1. Evidence-based training (EBT) | SKYbrary Aviation Safety, https://skybrary.aero/articles/evidence-based-training-ebt
2. Data Report for Evidence-Based Training – IATA, https://www.iata.org/contentassets/c0f61fc821dc4f62bb6441d7abedb076/data-report-for-evidence-basted-training-ed20one.pdf
3. Competency Based Training and Assessment, CBTA, in aviation training – CAE, https://www.cae.com/blog/competency-based-training-and-assessment-cbta-in-aviation-training/
4. CBTA Instructional System Design – ICAO, https://www.icao.int/safety/OPS/OPS-Normal/Pages/CBTA-Instructional-system-design.aspx
5. Flight Competency-Based Training and Assessment (CBTA) – Boeing Global Services, https://services.boeing.com/training-solutions/flight-training/flight-competency-based-training-and-assessment
6. Airline Career Pilot Program Flight Training Timeline / ATP Flight …, https://atpflightschool.com/airline-career-pilot-program/flight-training-timeline.html
7. Pilot Training: Conventional Vs Cadet Pilot Program – Aviacons, https://aviacons.org/pilot-training-pathways/
8. FLIGHT OPERATIONS PILOT AND INSTRUCTOR TECHNIQUES FOR OPERATIONS AND FLIGHT MANEUVERS – College of Liberal Arts | – Louisiana Tech University, https://liberalarts.latech.edu/documents/2018/07/flight-operations-techniques-and-maneuvers.pdf
9. EBT Principles – salient.aero, https://salient.aero/the-evidence-based-training-principles/
10. FLIGHT TRAINING EVALUATION AND GRADING: Evaluation of a pilot trainee’s ability to perform individual maneuvers or tasks, http://www.usflightacademy.org/files/courses/USFA%20Flight%20Training%20Evaluation%20and%20Grading.pdf
11. Pre-Solo Cross-Country Check Flight – Chief of Naval Air Training, https://www.cnatra.navy.mil/local/docs/forms/3501.2.pdf
12. Practical Test Standards – Wikipedia, https://en.wikipedia.org/wiki/Practical_Test_Standards
13. Airman Certification Standards (ACS) Frequently Asked Questions for Applicants, Instructors, and Evaluators – FAA, https://www.faa.gov/sites/faa.gov/files/training_testing/testing/acs/acs_faq.pdf
14. EASA PPL Theory Exams Explained: Everything You Need to Know, https://www.easyeasa.com/post/easa-ppl-theory-exams-explained-everything-you-need-to-know
15. Critique & Evaluation – CFI Notebook, https://www.cfinotebook.net/lesson-plans/fundamentals-of-instructing/critique-and-evaluation
16. Integrated Commercial Pilot Courses (ICPC) – MFC Training – Moncton Flight College, https://mfctraining.com/professional-programs/integrated-airline-transport-license-iatl/
17. What is CBTA in aviation training? – Hinfact, https://hinfact.com/2025/03/07/cbta-aviation-training/
18. Evidence-Based Training – CAT Leader Forum, https://catleaderforum.events.halldale.dev/evidence-based-training/
19. CBTA and EBT: The Future Training Methodologies of Aviation, https://aeroteam.dk/cbta-and-ebt-the-future-training-methodologies-of-aviation/
20. Is CBTA the Future of Pilot Training? Airbus’ Head of Pedagogy & Standards provides his insight, https://aircraft.airbus.com/en/newsroom/stories/2024-12-is-cbta-the-future-of-pilot-training-airbus-head-of-pedagogy-standards
21. Evidence-Based Training Implementation Guide, Edition 2, EN – IATA, https://www.iata.org/contentassets/632cceb91d1f41d18cec52e375f38e73/ebt-implementation-guide.pdf
22. Outdated Training? – Flight Safety Foundation, https://flightsafety.org/asw-article/outdated-training/
23. Evidence based training (EBT) modules & what to expect – CAE, https://www.cae.com/blog/evidence-based-training-ebt-modules-what-to-expect/
24. Competency-based Training & Assessment (CBTA) – JAA TO, https://jaato.com/competency-based-training-assessment/
25. COMPETENCY BASED TRAINING & ASSESSMENT Implementation – AMFTA, https://www.amfta.org/wp-content/uploads/2025/05/AMFTA-CBTA-Implementation-guide-ref-202505.01.pdf
26. Instructor and Evaluator Training Edition 2 – IFALPA, https://www.ifalpa.org/media/3630/guidance-material-and-best-practices-for-instructor-and-evaluator-training.pdf
27. Competency Assessment and Evaluation for Pilots, Instructors and Evaluators Guidance Material – IATA, https://www.iata.org/contentassets/c0f61fc821dc4f62bb6441d7abedb076/competency-assessment-and-evaluation-for-pilots-instructors-and-evaluators-gm.pdf
28. Competency-Based Training and Assessment Overview and FAQ …, https://dgitraining.com/blog/competencybased-training-and-assessment-overview-and-faq/
29. A Study on the Integration of Evidence-Based Training (EBT) and …, https://www.jksaa.org/archive/view_article?pid=jksaa-33-1-71
30. (PDF) The Implementation of Competency-Based Training and …, https://www.researchgate.net/publication/368284427_The_Implementation_of_Competency-Based_Training_and_Assessment_CBTA_Framework_in_Aviation_Intelligence_Human_Systems
31. EBT-CBTA in Aviation Training: The Turkish Airlines Case Study – ResearchGate, https://www.researchgate.net/publication/372226815_EBT-CBTA_in_Aviation_Training_The_Turkish_Airlines_Case_Study
32. Competency-Based Training and Assessment (CBTA) Framework in Global Aviation Training, https://openaccess-api.cms-conferences.org/articles/download/978-1-958651-68-1_0
33. Norman MacLeod – Astrom Training, https://astromtraining.com/html/otherdocuments/EBT.htm
34. Data-Driven Aerospace Engineering: Reframing the Industry with Machine Learning | AIAA Journal, https://arc.aiaa.org/doi/10.2514/1.J060131
35. Analysis: Overhauling Aviation Training: The Global Push for New Standards — Part I, https://futureaviationaerospaceworkforce.com/2025/04/21/analysis-overhauling-aviation-training-the-global-push-for-new-standards/
36. Mutual acceptance of pilot licences, flight training organizations approvals – ICAO, https://www.icao.int/Meetings/AMC/NGAP/Documentation/Background%20document%20on%20Transitioning%20Regulatory%20Frameworks%20to%20Support%20Competency-Based%20Training%20and%20Assessments.pdf
37. RAeS Webinar: Flight Crew Competence; Assessing what and how? – YouTube, https://www.youtube.com/watch?v=UPXc7r5BAlk
38. The Implementation Challenges of Immersive … – Coventry University, https://pureportal.coventry.ac.uk/files/79698922/Binder5_1_.pdf
39. The Future of Flight Training: How AI is Revolutionizing Aviation Education – Venture West, https://www.flyvwa.com/blog/the-future-of-flight-training-how-ai-is-revolutionizing-aviation-education
40. Artificial Intelligence in Airline Pilot Training – Lund University Publications, https://lup.lub.lu.se/luur/download?func=downloadFile&recordOId=9201916&fileOId=9201917
41. Aviation Training in 2025: Balancing Progress and Challenges | Halldale Group, https://www.halldale.com/civil-aviation/aviation-training-in-2025-balancing-progress-and-challenges
42. Aviation Intelligence: How AI is Transforming Flight Training and Safety | Halldale Group, https://www.halldale.com/events-news-hub/aviation-intelligence-how-ai-is-transforming-flight-training-and-safety
43. Evidence Based Training Explained – WingTalkers, https://wingtalkers.com/innovation/evidence-based-training-aviation/
44. Evidence-Based Training (EBT) – IATA, https://www.iata.org/en/services/consulting/safety-operations/evidence-based-training/
45. How Competency-Based Pilot Training Can Save Airlines Millions …, https://www.halldale.com/civil-aviation/21484-cat-how-competency-based-pilot-training-can-save-airlines-millions
46. The Implementation of Competency-Based Training and …, https://www.researchgate.net/publication/366159328_The_Implementation_of_Competency-Based_Training_and_Assessment_CBTA_Framework_in_Aviation_Manpower_Planning
47. CBTA and Evidence based Training at Emirates – ICAO, https://www.icao.int/MID/Documents/2022/CRM/EBT%20Presentation%20ICAO%20June%202022.pdf
48. Regulatory Compliance: Staying Aligned With FAA, EASA, ICAO, and Local Regulations, https://aviationsafetyblog.asms-pro.com/blog/regulatory-compliance-staying-aligned-with-faa-easa-icao-and-local-regulations
49. CBTA: Enhancing Safety Outcomes and Enabling Adaptive, Pilot-Centered Training Journeys | Halldale Group, https://www.halldale.com/civil-aviation/cbta-enhancing-safety-and-adaptive-training
50. COMPETENCY BASED TRAINING AND ASSESSMENT … – ICAO, https://www.icao.int/Meetings/HLCC2021/Documents/WP/EN/SAF/wp_029_en.pdf
51. EBT, AQP, ATQP. What’s the difference? – salient.aero, https://salient.aero/ebt-aqp-atqp-whats-the-difference/
52. Current barriers and challenges for the implementation and enhancement of EBT/CBTA programmes – YouTube, https://www.youtube.com/watch?v=Avfxiz_LuXY
53. The use of data to fulfil and raise EBT programmes – Alg Global, https://www.alg-global.com/blog/aviation/shaping-future-training-shift-approach-flight-crew-training-programmes
54. EBT Page – AviaQuality, https://www.aviaquality.com/ebtpage
55. aircraft.airbus.com, https://aircraft.airbus.com/en/newsroom/stories/2024-12-is-cbta-the-future-of-pilot-training-airbus-head-of-pedagogy-standards#:~:text=Adopting%20CBTA%20offers%20several%20advantages,train%20for%20every%20possible%20scenario.