The Validation of the Construct Validity of the Core Competency Measurement Model for Third Grade Students
Article Sidebar
Main Article Content
Abstract
The purpose of this research was to create and develop a core competency test for grade 3 students, and to validate the structural validity of the model for measuring the core competencies of grade 3 students. A sample of 370 grade 3 students in Surin Province was drawn from multi-stage random sampling. The research tools were four sets of core competency tests for grade 3 students developed by the researchers. Data were analyzed, using the mean and standard deviation to verify the prediction accuracy from the receiver operating characteristic (ROC) graph, and the area under the ROC curve was obtained. The validation of the structural validity of the model for measuring core competencies was done through second-order confirmatory factor analysis. The research results revealed that:
1. The results of the creation and development of the core competency test showed that there are 4 competencies: (1) the literacy competency test had 44 items; (2) the ability core competency had 29 items, (3) the well-being core competency had 26 items, and (4) the core competency for social concern had 26 items. The items had a discrimination from 0.20 to 0.69, and the test had a reliability from 0.85 to 0.91. In the results of the analysis of the receiver operating characteristic (ROC) and area under the curve to check the sensitivity, there was an AUC value between 0.817 and 0.999. It can be concluded that every test set was highly accurate.
2. The validation of the construct validity of the core competency measurement model for third-grade students revealed 4core competencies and it was found that: (1) The model for measuring the literacy competencies had construct validity, with a Chi-Square test = 19.13, df =13, p-value = 0.10, RMSEA = 0.036, CFI = 0.99, TLI = 0.99, and SRMR = 0.01; (2) the ability core competency measurement model had construct validity, with a Chi-Square test = 3.89, df = 6, p-value = 0.52, RMSEA = 0.00, CFI = 1.00, TLI = 1.00, and SRMR = 0.01; (3) the model for measuring well-being competencies had construct validity, with a Chi-Square test = 4.48, df = 3, p-value = 0.21, RMSEA = 0.03, CFI = 0.99, TLI = 0.99, SRMR = 0.01, and the model for measuring social concern competencies had construct validity, with a Chi-Square test = 1.05, df=2, p-value =.59, RMSEA = 0.01, CFI = 1.00, TLI = 1.00, and SRMR = 0.01. Therefore, it can be concluded that all models measuring the core competencies of students in Grade 3 had construct validity.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
The content and information contained in the published article in the Journal of Educational Measurement Mahasarakham University represent the opinions and responsibilities of the authors directly. The editorial board of the journal is not necessarily in agreement with or responsible for any of the content.
The articles, data, content, images, etc. that have been published in the Journal of Educational Measurement Mahasarakham University are copyrighted by the journal. If any individual or organization wishes to reproduce or perform any actions involving the entirety or any part of the content, they must obtain written permission from the Journal of Educational Measurement Mahasarakham University.
References
Hair, J., Black, W., Babin, B., Anderson, R., & Tatham, R. (2006). Multivariate Data Analysis (6th ed.). Pearson Prentice Hall.
Hooper, D., Coughlan, J., & Mullen, M. R. (2008). Structural Equation Modelling: Guidelines for Determining Model Fit. Electronic Journal of Business Research Methods, 6(1), 53-60.
Hu, L. T., & Bentler, P. M. (1999). Cutoff Criteria for Fit Indexes in Covariance Structure Analysis: Conventional Criteria versus New Alternatives. Structural Equation Modeling, 6, 1-55. http://dx.doi.org/10.1080/10705519909540118
Kline, P. (1999). A Handbook of Psychological Testing (2nd ed). Routledge.
Steiger, J. H. (2007). Understanding the Limitations of Global Fit Assessment in Structural Equation Modeling. Personality and Individual Differences, 42, 893-898. https://doi.org/10.1016/j.paid.2006.09.017
Steven, J. P. (2009). Applied multivariate statistics for the social sciences. Routledge.
Tabachnick, B. G., & Fidell, L. S. (2007). Using Multivariate Statistics (5th ed.). Allyn and Bacon.
Independent Commission for Educational Reform. (2019). Report on the mission of educational reform through curriculum and competency-based teaching. The working group plans to develop a framework for core competencies for students at the basic education level in the subcommittee on teaching and learning management [Online Report]. https://www.thaiedreform.org/wp-content/uploads/2019/08/Core_competency_11.pdf (in Thai)
Ingsathit, A. (n.d.). Principles for considering the application of diagnostic research in medical practice [Instructional document]. Faculty of Medicine Ramathibodi Hospital. Mahidol University. https://www.rama.mahidol.ac.th/fammed/sites/default/files/public/pdf/EBM_Diagnostic_study.pdf (in Thai)
Kanjanawasee, S. (2009). Classical Test Theory (6th ed.). Chulalongkorn University Press. (in Thai)
Khaemmanee, T. (2019). 10 core competencies that shape Thai children to be smart and knowledgeable, live happily, have high abilities and care about society [Online]. http://site.ksp.or.th/content.php?site=library&SiteMenuID=4472&Action=view&Sys_Page=&Sys_PageSize=&DataID=2251 (in Thai)
Lee, S., & Dajpratham, P. (2017). To assess the criterion validity of the Thai version of the 9- and the 2-questions of the Patient Health Questionnaire (PHQ-9 and PHQ-2) as screening instruments for major depression in Thai elderly. J Thai Rehabil Med, 27(1), 30-37. (in Thai)
Makmee, P. (2021). Using the Mplus program to analyze data for research development [Lecture Document]. National Research Council of Thailand (NRCT). (in Thai)
Office of the Education Council. (2019). Report on the results of research and development of the competency framework for early primary school students for basic education courses. Ministry of Education. (in Thai)
Rangsungnoen, K. (2011). Factor analysis with SPSS and AMOS for research. SE-ED Education. (in Thai)
Runghuapai, R. (2015). A Development of collaborative learning competencies model for primary students [Doctoral Disserrtation]. Srinakharinwirot University. (in Thai)
Tangpattanakit, J., & Senariddhikrai, P. (2022). The Role of Confirmatory Factor Analysis (CFA) in Structural Equation Modeling (SEM), Journal of Management Sciences Kasetsart University, 1(2). (in Thai)
Thanapatpisarn, P. (2022). [Fundamental Data Analytics & Data Scientist EP.21] Model Performance was measured by Evaluation Metrics Part 2. https://datascihaeng.medium.com/evaluation-matrix-part2-a7d83aea6537 (in Thai)
Wiratchai, N. (2006). LISREL Model: statistical analysis for research (3rd ed.). Chulalongkorn University Press. (in Thai)
XCL World Academy. (2021). 10 effective strategies for managing exam stress To be successful [online]. https://www.xwa.edu.sg/th/blog/tips-guides/10-effective-strategies-for-successfully-managing-exam-stress/ (in Thai)