Resource Management in the Development of Assessment Materials for Aviation Personnel Language Training under Digitalisation

Marina Kazakova; Natalia Lukicheva; Elena Assovskaya

doi:10.34755/l1164-4960-2776-h

UDC 338.36

RESOURCE MANAGEMENT IN THE DEVELOPMENT OF ASSESSMENT MATERIALS FOR AVIATION PERSONNEL LANGUAGE TRAINING UNDER DIGITALISATION Resource Management in the Development of Assessment Materials for Aviation Personnel Language Training under Digitalisation

АА Аа

Published in Journal of Applied Research · Issue 7, 2026 · ELocator: 104-113 · Rubric: ECONOMICS. ECONOMIC SCIENCES.

DOI: https://doi.org/10.34755/l1164-4960-2776-h

Received: 04.10.2026 Accepted: 16.10.2026 Published: 16.10.2026

Authors

Marina Kazakova

Natalia Lukicheva

Elena Assovskaya

Marina Kazakova

Saint Petersburg State University of Civil Aviation Starshiy prepodavatel' · Saint Petersburg

Natalia Lukicheva

Saint Petersburg State University of Civil Aviation Starshiy prepodavatel' · Saint Petersburg

Elena Assovskaya

Saint Petersburg State University of Civil Aviation Starshiy prepodavatel' · Saint Petersburg

ABSTRACT

The article proposes an economic and managerial model for applying generative artificial intelligence to the development of assessment item banks in aviation English. The relevance stems from ICAO Doc 10197, which shifted test construct requirements towards radiotelephony context and non-routine situations, and from the high unit cost of conventional item development, estimated at USD 500-2000 per item. The aim is to build a computational model linking specification-driven item generation with the unit cost and labour input structure of an organisation. A generation protocol is proposed, comprising six specification blocks and a six-criterion expert rejection loop, together with item prototypes mapped to ICAO rating scale descriptors. Indicators of unit cost, batch break-even point and critical rejection rate are introduced. The calculation shows that the technology breaks even from a batch of 16 items, delivers a 53 per cent reduction in unit cost for a batch of 100 items and becomes unjustified when the rejection rate exceeds 72.4 per cent. The novelty lies in formalising the link between item generation technology and the labour input structure of an educational organisation.

KEYWORDS

aviation personnel language training, aviation English, assessment materials, ICAO rating scale, generative artificial intelligence, automated item generation, human in the loop, unit cost, break-even point, educational resource management

Text

Text (PDF)

Read Download

1. Prilozhenie 1 k Konvencii o mezhdunarodnoy grazhdanskoy aviacii. Vydacha svidetel'stv aviacionnomu personalu. - 12-e izd. - Monreal' : IKAO, 2018. - 208 s. - Tekst : neposredstvennyy.

2. Doc 9835. Manual on the Implementation of ICAO Language Proficiency Requirements. - 2nd ed. - Montreal : ICAO, 2010. - Tekst : neposredstvennyy.

3. Doc 10197. Test Design Guidelines: Handbook on the Design of Tests for the ICAO Language Proficiency Requirements. - Montreal : ICAO, 2024. - Tekst : neposredstvennyy.

4. ICAO LPR Test Design Guidelines. - Tekst : elektronnyy // International Civil Aviation English Association : [sayt]. - URL: https://www.icaea.aero/projects/icao-lpr-tdg/ (data obrascheniya: 20.08.2026).

5. National Language Proficiency : FAQ n. 142141. - Tekst : elektronnyy // European Union Aviation Safety Agency : [sayt]. - 27.06.2025. - URL: https://www.easa.europa.eu/en/faq/142141 (data obrascheniya: 20.08.2026).

6. Automated Reading Passage Generation with OpenAI's Large Language Model / U. Bezirhan, M. von Davier. - Tekst : elektronnyy // arXiv preprint. - 2023. - arXiv:2304.04616.

7. What is Automated Item Generation? - Tekst : elektronnyy // Assessment Systems : [sayt]. - URL: https://assess.com/what-is-automated-item-generation/ (data obrascheniya: 20.08.2026).

8. Ultimate Guide to Automated Item Generation. - Tekst : elektronnyy // Caveon : [sayt]. - URL: https://caveon.com/resource/ultimate-guide-automated-item-generation/ (data obrascheniya: 20.08.2026).

9. Language assessment in the era of generative artificial intelligence: Opportunities, challenges, and future directions. - Tekst : elektronnyy // System. - 2025. - DOIhttps://doi.org/10.1016/j.system.2025.103783.

10. A suggestive approach for assessing item quality, usability and validity of Automatic Item Generation / F. Falcao, D. M. Pereira, N. Goncalves [et al.]. - Tekst : neposredstvennyy // Advances in Health Sciences Education. - 2023. - DOIhttps://doi.org/10.1007/s10459-023-10225-y.

11. Automatic Item Generation for Personality Situational Judgment Tests with Large Language Models. - Tekst : elektronnyy // arXiv preprint. - 2024. - arXiv:2412.12144.

12. Prompting Strategies for Language Model-Based Item Generation in K-12 Education: Bridging the Gap Between Small and Large Language Models. - Tekst : elektronnyy // arXiv preprint. - 2025. - arXiv:2508.20217.

13. Evaluating automated evaluation systems for spoken English proficiency: An exploratory comparative study with human raters / T. Chen, S. Sun. - Tekst : neposredstvennyy // PLoS ONE. - 2025. - Vol. 20, no. 3. - Art. e0320811. - DOIhttps://doi.org/10.1371/journal.pone.0320811.

14. Evaluating an AI speaking assessment tool: Score accuracy, perceived validity, and oral peer feedback as feedback enhancement. - Tekst : neposredstvennyy // Journal of English for Academic Purposes. - 2025. - Vol. 75. - Art. 101505. - DOIhttps://doi.org/10.1016/j.jeap.2025.101505.

15. Assessing Whisper automatic speech recognition and WER scoring for elicited imitation: Steps toward automation / M. McGuire [et al.]. - Tekst : neposredstvennyy // Research Methods in Applied Linguistics. - 2025. - DOIhttps://doi.org/10.1016/j.rmal.2025.100197.

16. Prilozhenie 10 k Konvencii o mezhdunarodnoy grazhdanskoy aviacii. Aviacionnaya elektrosvyaz'. Tom II. Pravila svyazi, vklyuchaya pravila, imeyuschie status PANS. - 7-e izd. - Monreal' : IKAO, 2016. - Tekst : neposredstvennyy.

PDF JATS XML

Deputy Editor-in-Chief

Ol'ga Shatalova

Chief Editor

Raiganat Babaeva

downloads

GOST

Kazakova M. A., Lukicheva N. E., Assovskaya E. I. Resource Management in the Development of Assessment Materials for Aviation Personnel Language Training under Digitalisation // Journal of Applied Research. 2026. no. 7. 104-113. DOI: https://doi.org/10.34755/l1164-4960-2776-h. (Date of access 19.10.2026).

MLA

Marina Kazakova, Lukicheva N. E., Assovskaya E. I.. "Resource Management in the Development of Assessment Materials for Aviation Personnel Language Training under Digitalisation." Journal of Applied Research.7 (2026): 104-113. DOI: https://doi.org/10.34755/l1164-4960-2776-h.

APA

Kazakova M. A., Lukicheva N. E., Assovskaya E. I. (2026). Resource Management in the Development of Assessment Materials for Aviation Personnel Language Training under Digitalisation. Journal of Applied Research(7), 104-113. https://doi.org/10.34755/l1164-4960-2776-h

Chicago

Marina Kazakova, Lukicheva N. E., Assovskaya E. I.. "Resource Management in the Development of Assessment Materials for Aviation Personnel Language Training under Digitalisation." Journal of Applied Research, no. 7 (2026): 104-113. https://doi.org/10.34755/l1164-4960-2776-h.

WIKI

{{cite journal | author = Kazakova M. A., Lukicheva N. E., Assovskaya E. I. | title = Resource Management in the Development of Assessment Materials for Aviation Personnel Language Training under Digitalisation | journal = Journal of Applied Research | year = 2026 | issue = 7 | pages = 104-113 | doi = 10.34755/l1164-4960-2776-h }}

Copy

Export: BibTeX EndNote RefMan RusMARC

RESOURCE MANAGEMENT IN THE DEVELOPMENT OF ASSESSMENT MATERIALS FOR AVIATION PERSONNEL LANGUAGE TRAINING UNDER DIGITALISATION Resource Management in the Development of Assessment Materials for Aviation Personnel Language Training under Digitalisation

Confirmation