Development and Validation of the Psychometric Properties of Situational Online Test for Assessing Intercultural Competence of Upper Secondary School Students by Applying the Intercultural Development Continuum: Graded Response Model and Confirmatory Factor Analysis
Article Sidebar
Main Article Content
Abstract
The purpose of this research was to develop and examine the psychometric properties of a test for assessing the intercultural competency of upper secondary school students based on the concept of the intercultural development continuum. The sample consisted of 604 upper secondary school students from schools under the Office of the Basic Education Commission (OBEC) in Bangkok. The research tool was an online situational test measuring intercultural competency based on the concept of the intercultural development continuum. It was conducted online using the SurveyMonkey website. Data were analyzed using the Content Validity Index, Cronbach's alpha coefficient, Confirmatory Factor Analysis methods, and the Graded Response Model (GRM). The findings indicated that: (1) All of the questions had content validity. (2) The situational online test showed excellent internal consistency based on Cronbach's alpha (0.937). (3) The results of the Confirmatory Factor Analysis indicated that the model was consistent with the empirical data. And (4) the results of the analysis of threshold () and slope parameter (
) using the Graded Response Model (GRM) suggested that each item had a wide distribution of response results at each ability level. When considering the value of most thresholds and the slope parameter (
), the slope parameter value (
) matched the criteria. It indicated that the questions were appropriate and could classify the abilities of test takers who responded at a good level, Additionally, they could best provide information for test takers with moderate ability.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
The content and information contained in the published article in the Journal of Educational Measurement Mahasarakham University represent the opinions and responsibilities of the authors directly. The editorial board of the journal is not necessarily in agreement with or responsible for any of the content.
The articles, data, content, images, etc. that have been published in the Journal of Educational Measurement Mahasarakham University are copyrighted by the journal. If any individual or organization wishes to reproduce or perform any actions involving the entirety or any part of the content, they must obtain written permission from the Journal of Educational Measurement Mahasarakham University.
References
Adams, R. J. (2005). Reliability as a measurement design effect. Studies in Educational Evaluation, 31, 162-172. https://doi.org/10.1016/j.stueduc.2005.05.008
Bennett, M. (1986). A developmental approach to training intercultural sensitivity. In J. Martin (Guest Eds.), Special issue on intercultural training. International Journal of Intercultural Relations, 10(2), 179–186.
Bennett, M. (2013) Basic concepts of intercultural communication: Paradigms, principles, & practices. Intercultural Press.
De Ayala, R. J. (2009). The Theory and Practice of Item Response Theory. The Guildford Press.
Ebel, R. L. (1972). Essentials of Educational Measurement. Prentice Hall.
Guzmána, E. V., Muschardb, B., Gerolamoa, M., Kohlb, H., & Rozenfeld, H. (2020). Characteristics and Skills of Leadership in the Context of Industry 4.0. Journal of Procedia Manufacturing, 43(1), 543-550.
Kerlinger, F. N. (1986). Foundations of Behavioral Research (3 ed.). Holt, Rinehart and Winston.
Polit, D. F., & Beck, C. T. (2017). Nursing research: Generating and assessing evidence for nursing practice (10th ed.). Lippincott Williams & Wilkins.
Banchong, P., Mutuwong, C., Ngoenbanrung, J., Mahantagai, P., & Lawthong, N. (2023). Psychometric Properties and Factor of Intercultural Competence Based on the Intercultural Development Continuum for Undergraduate Students. Journal of Education Studies, 51(4), 1-14. (in Thai)
Chantarasenanon, C. (2010). Development of a Cultural Competence Scale for Secondary School Students [Doctoral Dissertation]. Chulalongkorn University. (in Thai)
Kanjanawasee, S. (2013). Classical Test Theory (7th ed.). Chulalongkorn University Press. (in Thai)
Kanjanawasee, S. (2020). Modern test theories (5th ed.). Chulalongkorn University Press. (in Thai)
Masantiah, C. (2023). Developing a Digital Empathy Scale to Measure and Assess Upper Secondary School Students in the 21St Century: An Application of Item Response Theory. Journal of Educational Measurement Mahasarakham University, 29(2), 53-68. (in Thai)
Office of The National Education Commission. (2023). Educational statistics for academic year 2023. Office of the National Education Commission. http://www.bopp.go.th/?page_id=3544 (in Thai)
Ritjaroon, P. (2002). Measurement evaluation (2nd ed.). House of Kermyst Co.,Ltd. (in Thai)
Sakolkijrungroj, S. (2017). Polytomous Item Response Theory Models for Affective Variables. Sukhothai Thammathirat Open University. https://www.stou.ac.th/offices/ore/info/cae/viewkb.aspx?id=291 (in Thai)
Suksawang, P. (2013). The Basics of Structural Equation Modeling. Princess Naradhiwas University Journal, 6(2), 136-145. (in Thai)
Tangdhanakanond, K. (2018). Development of a process to change teachers’ misconception in using portfolio for elementary school student assessment [Complete Research Report]. Thailand Science Research and Inovation. (in Thai)
Thepsathit, P., Jongsooksai, P., Bowornthammarat, P., Saejea, S., & Chaimongkol, N. (2022). Data Analysis in Polytomous Item Response Theory Using R. Journal of Educational Measurement Mahasarakham University, 28(2), 13-26. (in Thai)
Vanichbuncha, K. (2012). Statistical analysis for research (6th ed.). Chulalongkorn University Press. (in Thai)
Wiratchai, N. (2005). LISREL modeling Statistics analysis for Research (3rd ed.). Chulalongkorn University Press. (in Thai)