Establishing CEFR-Referenced Cut Scores for the Royal Police Cadet Academy Test of English Proficiency (RPCA-TEP) Using the Modified Angoff Method
Article Sidebar
Main Article Content
Abstract
The Royal Police Cadet Academy Test of English Proficiency (RPCA-TEP) was designed to evaluate the English language proficiency of police cadets in accordance with the mandate of the Higher Education Commission, which requires English proficiency testing aligned with the Common European Framework of Reference (CEFR). This study aimed to align RPCA-TEP scores with CEFR proficiency levels. Using the Modified Angoff method, 13 subject-matter experts provided judgments on the likelihood of borderline candidates at CEFR levels A2, B1, and B2 answering test items correctly. The analysis established cut-off scores out of 120, with candidates scoring 26–55 classified as A2, 56–82 as B1, and 83–120 as B2. The findings highlight the potential of the RPCA-TEP as a CEFR-referenced assessment tool and recommend further refinement using CEFR ability descriptors to guide future test development.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
The content and information contained in the published article in the Journal of Educational Measurement Mahasarakham University represent the opinions and responsibilities of the authors directly. The editorial board of the journal is not necessarily in agreement with or responsible for any of the content.
The articles, data, content, images, etc. that have been published in the Journal of Educational Measurement Mahasarakham University are copyrighted by the journal. If any individual or organization wishes to reproduce or perform any actions involving the entirety or any part of the content, they must obtain written permission from the Journal of Educational Measurement Mahasarakham University.
References
Cizek, G. J. (2012). Setting performance standards: Foundations, methods, and innovations (2nd ed.). Routledge.
Cizek, G. J., & Bunch, M. B. (2007). Standard setting: A guide to establishing and evaluating performance standards on tests. Sage.
Council of Europe. (2001). Common European Framework of Reference for Languages: Learning, teaching, assessment. Cambridge University Press.
Hambleton, R. K., & Pitoniak, M. J. (2006). Setting performance standards. In R. L. Brennan (Ed.), Educational measurement (4th ed., pp. 433–470). Praeger.
Ricker, K. L. (2006). Setting cut-scores: A critical review of the Angoff and modified Angoff methods. The Alberta Journal of Educational Research, 52(1), 53–64.
Sae-Jeng, S. (2018). Problems and needs of the occupational English language skills for Thai tourist police officers working at one of the international airports in Thailand [Independent study]. Thammasat University. https://ethesisarchive.library.tu.ac.th/thesis/2018/TU_2018_6021040271_10740_10283.pdf
Suwannaphim, S. (2011). English oral communication problems of police officers in high tourism areas [Master’s thesis]. Khon Kaen University.
Tannenbaum, R. J., & Cho, Y. (2014). Critical thinking and the Angoff method: A study of standard-setting panelists’ judgments. Educational Measurement: Issues and Practice, 33(2), 14–24. https://doi.org/10.1111/emip.12033
