Papers by Angela C . M . Garcia
Journal of Teaching English for Specific and Academic Purposes
Since the publication of the International Civil Aviation Organization (ICAO)’s language proficie... more Since the publication of the International Civil Aviation Organization (ICAO)’s language proficiency requirements, a number of different tests have been developed and implemented around the world to assess pilots and air traffic controllers’ proficiency in English. Meanwhile, researchers have questioned the clarity and appropriateness of the policy, and the reliability of tests (e.g., Alderson 2011; Douglas 2004; Emery 2014). ICAO has recently acknowledged that, over the years, multiple interpretations of the policy have led to practices that might undermine the meaningfulness of aviation English tests (ICAO 2022b). However, the ICAO Rating Scale remains as the instrument to be used in assessing pilots and air traffic controllers’ aeronautical language proficiency. Thus, this article explores the construct of aeronautical English listening tests stated in the comprehension descriptors of the ICAO rating scale, as well as the elements of the other descriptors that may inform the defi...
The Especialist, 2020
Contextos e construtos: implicações para o teste de compreensão auditiva de pilotos na comunicaçã... more Contextos e construtos: implicações para o teste de compreensão auditiva de pilotos na comunicação com controladores de tráfego aéreo
ICAO Journal, 2018
Journal encourages submissions from interested individuals, Organizations and States wishing to s... more Journal encourages submissions from interested individuals, Organizations and States wishing to share updates, perspectives or analysis related to global civil aviation. Subscriptions and single copies Yearly subscription (4 issues) US $40. Single copies available for US $10. For subscription and sales information, please contact the Sales and Customer Relationship Unit
The Especialist, 2020
This article addresses the most common language problems of Brazilian pilots regarding structure,... more This article addresses the most common language problems of Brazilian pilots regarding structure, a fundamental skill in aeronautical communications (DOC 9835). We aim to present an overview of the most specific errors made by student-pilots and Santos Dumont English Assessment (SDEA) test takers and compare them in order to better understand their language competence. The qualitative analysis will be based on lists which feature data collected from classroom work (student pilots) and SDEA report forms (RFs). The study is intended to provide researchers with more tools to deal with Aviation English focusing on pilot performance, as well as to contribute to better curriculum design and improvements in assessment practices.
The Especialist, 2020
The International Civil Aviation Organization (ICAO) published the Language Proficiency Requireme... more The International Civil Aviation Organization (ICAO) published the Language Proficiency Requirements for pilots and air traffic controllers (ATCOs) in 2003. Research has shown that there is still a lack of clarity regarding what needs to be assessed in terms of the English used by pilots and ATCOs in radiotelephony
(DOUGLAS, 2014; EMERY, 2014; KIM; BILLINGTON, 2016; KIM; ELDER, 2015; MONTEIRO, 2019; READ; KNOCH, 2009). The purpose of the present study was to investigate the nature of the listening tasks performed by pilots as an essential step in test development and validation. This explanatory sequential mixed-methods study (CRESWELL, 2015), elicited questionnaire responses from 156 pilots (Phase 1) and subsequently interviewed six aeronautical English experts (Phase 2) to better understand the characteristics of the listening tasks that pilots undertake during radiotelephony communications. Quantitative and qualitative data were analysed, and findings were merged. They provide information that may usefully inform the development of the listening test construct and the test specifications.
The International Civil Aviation Organization (ICAO) standard and
recommended practices (SARPs) r... more The International Civil Aviation Organization (ICAO) standard and
recommended practices (SARPs) related to the language use for aeronautical radiotelephony communications were published in March 2003. Twelve years after their publication, in the light of research suggesting the revision of the ICAO policy, it is important to learn what experts who have been working with the ICAO language proficiency requirements (LPRs) think are their strengths and weaknesses according to their experiences. This dissertation investigates experienced test raters and test developers’ opinions about the ICAO LPRs. Six expert professionals were interviewed in this qualitative analytic research and the data were analysed in accordance with the thematic analyses method. The discussions included not only general features of the
policy but also the specific features of the assessment criteria. The research puts forward suggestions of improvements to be made to the ICAO policy and recommends ICAO to revise the LPRs at the earliest.
Thesis Chapters by Angela C . M . Garcia
Doctoral Dissertation, 2023
In 2003, the International Civil Aviation Organization (ICAO) published its Language Proficiency ... more In 2003, the International Civil Aviation Organization (ICAO) published its Language Proficiency Requirements (LPRs), requiring pilots and air traffic controllers (ATCOs) to demonstrate their ability to speak and understand the language used in radiotelephony communications. Over the years, multiple interpretations of the policy have led to practices that may have undermined the meaningfulness of the LPRs (ICAO, 2022). This is likely due to issues such as the presence of ambiguity and uncertainty in the policy as well as the lack of clarity regarding the nature of the language that needs to be assessed (e.g., Alderson, 2010; Douglas, 2004; Kim, 2012). Since the ICAO Test Design Guidelines (TDGs) recommend that tests should contain tasks dedicated to the assessment of listening separately from speaking, the goal of this doctoral research was to address the initial stages of the development of a test to assess pilots’ listening comprehension in isolation: the definition of the listening construct. Construct definition is an essential step in test development and validation, and it forms the basis for the development of test specifications. To investigate what should be assessed in such a test, three perspectives were taken into consideration. A review of the academic literature and research was made to better understand the construct of listening tests, and, more specifically, the features of aeronautical English listening that may contribute to misunderstandings between pilots and ATCOs. An analysis of the ICAO rating scale was also conducted to examine the listening construct underpinned by the descriptors. Additionally, the perceptions of pilots and other key stakeholders regarding the assessment needs in relation to the listening performed by pilots in radiotelephony communications with ATCOs was investigated. The conceptual foundation underpinning this research project is the sociocognitive theory developed by Weir (2005), which takes into account both individuals’ cognitive processes and the features of the context in which the tasks are performed. The results of the three analyses were merged to define the construct based on the operations pilots need to be able to perform and the conditions under which they operate.
Uploads
Papers by Angela C . M . Garcia
(DOUGLAS, 2014; EMERY, 2014; KIM; BILLINGTON, 2016; KIM; ELDER, 2015; MONTEIRO, 2019; READ; KNOCH, 2009). The purpose of the present study was to investigate the nature of the listening tasks performed by pilots as an essential step in test development and validation. This explanatory sequential mixed-methods study (CRESWELL, 2015), elicited questionnaire responses from 156 pilots (Phase 1) and subsequently interviewed six aeronautical English experts (Phase 2) to better understand the characteristics of the listening tasks that pilots undertake during radiotelephony communications. Quantitative and qualitative data were analysed, and findings were merged. They provide information that may usefully inform the development of the listening test construct and the test specifications.
recommended practices (SARPs) related to the language use for aeronautical radiotelephony communications were published in March 2003. Twelve years after their publication, in the light of research suggesting the revision of the ICAO policy, it is important to learn what experts who have been working with the ICAO language proficiency requirements (LPRs) think are their strengths and weaknesses according to their experiences. This dissertation investigates experienced test raters and test developers’ opinions about the ICAO LPRs. Six expert professionals were interviewed in this qualitative analytic research and the data were analysed in accordance with the thematic analyses method. The discussions included not only general features of the
policy but also the specific features of the assessment criteria. The research puts forward suggestions of improvements to be made to the ICAO policy and recommends ICAO to revise the LPRs at the earliest.
Thesis Chapters by Angela C . M . Garcia
(DOUGLAS, 2014; EMERY, 2014; KIM; BILLINGTON, 2016; KIM; ELDER, 2015; MONTEIRO, 2019; READ; KNOCH, 2009). The purpose of the present study was to investigate the nature of the listening tasks performed by pilots as an essential step in test development and validation. This explanatory sequential mixed-methods study (CRESWELL, 2015), elicited questionnaire responses from 156 pilots (Phase 1) and subsequently interviewed six aeronautical English experts (Phase 2) to better understand the characteristics of the listening tasks that pilots undertake during radiotelephony communications. Quantitative and qualitative data were analysed, and findings were merged. They provide information that may usefully inform the development of the listening test construct and the test specifications.
recommended practices (SARPs) related to the language use for aeronautical radiotelephony communications were published in March 2003. Twelve years after their publication, in the light of research suggesting the revision of the ICAO policy, it is important to learn what experts who have been working with the ICAO language proficiency requirements (LPRs) think are their strengths and weaknesses according to their experiences. This dissertation investigates experienced test raters and test developers’ opinions about the ICAO LPRs. Six expert professionals were interviewed in this qualitative analytic research and the data were analysed in accordance with the thematic analyses method. The discussions included not only general features of the
policy but also the specific features of the assessment criteria. The research puts forward suggestions of improvements to be made to the ICAO policy and recommends ICAO to revise the LPRs at the earliest.