A Corpus-Based Study of English vocabulary to create a Karuta Card game, based on Part 2 (Question-Response) of the TOEIC listening test

Nipawan Navawatana; Kyle  Nathan Kohler

doi:10.14456/apbj.2026.1

Authors

Nipawan Navawatana Business English Language Program, Humanities and Social Sciences Faculty , Pibulsongkram Rajabhat University
Kyle Nathan Kohler English Language Program, Humanites Faculty, Naresuan University

DOI:

https://doi.org/10.14456/apbj.2026.1

Keywords:

TOEIC listening test, General Service List, Academic Word List, Outside Word List, Karuta card game

Abstract

This research aimed to compile, categorize, and analyze the vocabulary found in Part 2 (Question–Response) of mock TOEIC listening tests to assess the lexical difficulty according to the Common European Framework of Reference for Languages (CEFR), and to apply the vocabulary obtained from Objective 1 to the development of game-based learning (GBL) English instructional materials (Karuta card game). The findings revealed a total of 1,587 content words, most of which appeared in the General Service List (GSL). On average, the identified vocabulary corresponded to the CEFR B1 level of lexical difficulty. The vocabulary in this study was classified into 987 words in the General Service List (GSL), consisting of 686 words at the K1 level and 301 words at the K2 level; 409 words in the Outside Word List (OWL); and 191 words in the Academic Word List (AWL). Most of the vocabulary appearing in these lists was categorized at the B1 level. In addition, the questions created for the Karuta card game incorporated vocabulary from the GSL K1 word list, which was compiled as part of this study from several sets of mock tests of Part 2 (Question–Response).

References

Adipat, S., Laksana, K., Busayanon, K., Asawasowan, A., & Adipat, B. (2021). Engaging students in the learning process with game-based learning: The fundamental concepts. International Journal of Technology in Education, 4(3), 542–552. https://doi.org/10.46328/ijte.169

Anthony, L. (2024). AntConc (Version 2.1.1) [Computer software]. Waseda University. Retrieved from https://www.laurenceanthony.net/software/AntConc

Anthony, L. (2024). TagAnt (Version 2.1.1) [Computer software]. Waseda University. Retrieved from https://www.laurenceanthony.net/software/TagAnt

Arzfi, B. P., Montessori, M., & Rusdinal. (2025). Development of digital game based learning model teaching materials to improve learning outcomes in primary schools. Educational Process: International Journal, 15, Article e2025114. https://doi.org/10.22521/edupij.2025.15.114

Biber, D., Johansson, S., Leech, G., Conrad, S., & Finegan, E. (1999). Longman grammar of spoken and written English. Longman.

Browne, C., Culligan, B., & Phillips, J. (2013). New general service list. Retrieved from http://www.newgeneralservicelist.org/

Bull, D. (1996). Karuta: Sports or culture? Retrieved January 7, 2025, from http://www.asahi-net.or.jp/~xs3d-bull/essays/karuta/karuta.html

Bunyarat, P. (2020). A corpus-based study of specialized vocabularies in industrial work for developing industrial word lists of English for science and technology class. Journal of Language, Region & Culture, 9(2), 123–151.

Chen, C., & Truscott, J. (2010). The effects of repetition and L1 lexicalization on incidental vocabulary acquisition. Applied Linguistics, 31(5), 693–713. https://doi.org/10.1093/applin/amq031

Chowdhury, M., Dixon, L. Q., Kuo, L.-J., Donaldson, J. P., Eslami, Z., Viruru, R., & Luo, W. (2024). Digital game-based language learning for vocabulary development. Computers and Education Open, 6, 100160. https://doi.org/10.1016/j.caeo.2024.100160

Chung, T., & Nation, P. (2004). Identifying technical vocabulary. System, 32(2), 251 -263. https://doi.org/10.1016/j.system.2003.11.008

Cobb, T. (2021). Web VocabProfile [Computer software]. Retrieved from http://www.lextutor.ca/vp/

Coxhead, A. (2000). A new academic word list. TESOL Quarterly, 34(2), 213–238. https://doi.org/10.2307/3587951

Coxhead, A., & Hirsh, D. (2007). A pilot science-specific word list for EAP. Revue Française de Linguistique Appliquée, XII(2), 65–78. https://doi.org/10.3917/rfla.122.0065

Educational Testing Service. (2025). TOEIC listening test [Memoread website]. Retrieved from https://memmoread.website/listening-test/

Fries, C. C. (1952). The structure of English. Harcourt, Brace & World.

Goh, C. C. M. (2022). Teaching listening in the language classroom. SEAMEO Regional Language Centre.

Hunston, S. (2011). Corpus approaches to evaluation: Phraseology and evaluative language. Routledge.

Khemmanee, T. (2023). The science of teaching: Knowledge for effective learning management. Chulalongkorn University Press.

Li, Z., Zhiyou, J., Zhang, X., & Reynolds, B. L. (2024). Mastery of listening and reading vocabulary levels in relation to CEFR: Insight into student admission and English as a medium of instruction. Languages, 9(7), 223. https://doi.org/10.3390/languages9070229

Ling, L. (2021). Barron’s TOEIC practice exams. Barron’s Educational Series.

Mat Husin, M. Z. M., & Azmuddin, R. A. (2022). Learner engagement in using Kahoot! within a university English proficiency course. Educational Process: International Journal, 11(2), 167–180. https://doi.org/10.22521/edupij.2022.112.9

McCarthy, M., & McCarten, J. (2022). Writing corpus-informed materials. In J. Norton & H. Buchanan (Eds.), The Routledge handbook of materials development for language teaching (pp. 170–184). Routledge.

Murphy, M. L. (2010). Lexical meaning. Cambridge University Press.

Nakasun, N., & Nakasun, C. (2016). Games: Innovation for creative education. Romphruek Journal, Krirk University, 34(3), 160–182.

Nation, I. S. P. (2008). Teaching vocabulary: Strategies and techniques. Heinle.

Navawatana, N. (2025). An analysis of student language errors: A case study from a Thai institutional language test. Journal of Community Development Research (Humanities and Social Sciences), 18(3), 69–85.

Saito, K., & Lyster, R. (2012). Effects of form-focused instruction and corrective feedback on L2 pronunciation development of /ɹ/ by Japanese learners of English. Language Learning, 62(2), 595–633. https://doi.org/10.1111/j.1467-9922.2011.00639.x

Saraiwang, S., & Worawong, K. (2023). The use of task-based and game-based learning in English learning at small primary schools in Nakhon Pathom, Thailand. PASAA, 67, 101–138.

Sengchuen, N. (2023). A study of vocabulary corpus in TOEIC tests for developing a vocabulary list for the listening test. Journal of Humanities and Social Sciences, Kamphaeng Phet Rajabhat University, 29(1), 74–90.

Stæhr, L. S. (2008). Vocabulary size and the skills of listening, reading, and writing. Language Learning Journal, 36(2), 139–152. https://doi.org/10.1080/09571730802389975

Tarigan, B., & Hati, L. P. (2021). Using Karuta game to enhance vocabulary mastery of elementary school students in Sidomulyo of Sibiru Biru Sub-District. Abdimas Talenta, 6(2), 292–297.

Taynton, K., & Yamada, M. (2012). Using a Japanese card game Karuta to enhance listening and speaking skills in Japanese learners of English. Journal of Shitennoji University, 53, 407–416.

Vandergrift, L. (2016). Listening: Theory and practice in modern foreign language competence[Resource guide]. LLAS Centre for Languages, Linguistics and Area Studies. http://www.llas.ac.uk/resources/gpg/67

West, M. (1953). A general service list of English words. Longman, Green & Co.

Xu, Z., Chen, Z., Eutsler, L., Geng, Z., & Kogut, A. (2020). A scoping review of digital game-based technology on English language learning. Educational Technology Research and Development, 68(3), 877–904. https://doi.org/10.1007/s11423-020-09767-4

Zuharoh, A. (2014). Improving students’ vocabulary mastery by using karuta card game: A classroom action research of the seventh grade students of SMP N 2 Gebog Kudus in the academic year 2013/2014) [Unpublished undergraduate thesis]. Universitas Muria Kudus.