The Validation of the Construct Validity of the Core Competency Measurement Model for Third Grade Students

Main Article Content

Treekom Prommaboon
Siriluck Boongthong
Wanida Homjan
Boontawee Imboonta
Watcharaporn Ruangsit
Prachit Inthakanok
Suphathanakrit Yodsala

Abstract

The purpose of this research was to create and develop a core competency test for grade 3 students, and to validate the structural validity of the model for measuring the core competencies of grade 3 students. A sample of 370 grade 3 students in Surin Province was drawn from multi-stage random sampling. The research tools were four sets of core competency tests for grade 3 students developed by the researchers. Data were analyzed, using the mean and standard deviation to verify the prediction accuracy from the receiver operating characteristic (ROC) graph, and the area under the ROC curve was obtained. The validation of the structural validity of the model for measuring core competencies was done through second-order confirmatory factor analysis. The research results revealed that:
1. The results of the creation and development of the core competency test showed that there are 4 competencies: (1) the literacy competency test had 44 items; (2) the ability core competency had 29 items, (3) the well-being core competency had 26 items, and (4) the core competency for social concern had 26 items. The items had a discrimination from 0.20 to 0.69, and the test had a reliability from 0.85 to 0.91. In the results of the analysis of the receiver operating characteristic (ROC) and area under the curve to check the sensitivity, there was an AUC value between 0.817 and 0.999. It can be concluded that every test set was highly accurate.
2. The validation of the construct validity of the core competency measurement model for third-grade students revealed 4core competencies and it was found that: (1) The model for measuring the literacy competencies had construct validity, with a Chi-Square test = 19.13, df =13, p-value = 0.10, RMSEA = 0.036, CFI = 0.99, TLI = 0.99, and SRMR = 0.01; (2) the ability core competency measurement model had construct validity, with a Chi-Square test = 3.89, df = 6, p-value = 0.52, RMSEA = 0.00, CFI = 1.00, TLI = 1.00, and SRMR = 0.01; (3) the model for measuring well-being competencies had construct validity, with a Chi-Square test = 4.48, df = 3, p-value = 0.21, RMSEA = 0.03, CFI = 0.99, TLI = 0.99, SRMR = 0.01, and the model for measuring social concern competencies had construct validity, with a Chi-Square test = 1.05, df=2, p-value =.59, RMSEA = 0.01, CFI = 1.00, TLI = 1.00, and SRMR = 0.01. Therefore, it can be concluded that all models measuring the core competencies of students in Grade 3 had construct validity.

Article Details

Section
Research Article

References

Hair, J., Black, W., Babin, B., Anderson, R., & Tatham, R. (2006). Multivariate Data Analysis (6th ed.). Pearson Prentice Hall.

Hooper, D., Coughlan, J., & Mullen, M. R. (2008). Structural Equation Modelling: Guidelines for Determining Model Fit. Electronic Journal of Business Research Methods, 6(1), 53-60.

Hu, L. T., & Bentler, P. M. (1999). Cutoff Criteria for Fit Indexes in Covariance Structure Analysis: Conventional Criteria versus New Alternatives. Structural Equation Modeling, 6, 1-55. http://dx.doi.org/10.1080/10705519909540118

Kline, P. (1999). A Handbook of Psychological Testing (2nd ed). Routledge.

Steiger, J. H. (2007). Understanding the Limitations of Global Fit Assessment in Structural Equation Modeling. Personality and Individual Differences, 42, 893-898. https://doi.org/10.1016/j.paid.2006.09.017

Steven, J. P. (2009). Applied multivariate statistics for the social sciences. Routledge.

Tabachnick, B. G., & Fidell, L. S. (2007). Using Multivariate Statistics (5th ed.). Allyn and Bacon.

Independent Commission for Educational Reform. (2019). Report on the mission of educational reform through curriculum and competency-based teaching. The working group plans to develop a framework for core competencies for students at the basic education level in the subcommittee on teaching and learning management [Online Report]. https://www.thaiedreform.org/wp-content/uploads/2019/08/Core_competency_11.pdf (in Thai)

Ingsathit, A. (n.d.). Principles for considering the application of diagnostic research in medical practice [Instructional document]. Faculty of Medicine Ramathibodi Hospital. Mahidol University. https://www.rama.mahidol.ac.th/fammed/sites/default/files/public/pdf/EBM_Diagnostic_study.pdf (in Thai)

Kanjanawasee, S. (2009). Classical Test Theory (6th ed.). Chulalongkorn University Press. (in Thai)

Khaemmanee, T. (2019). 10 core competencies that shape Thai children to be smart and knowledgeable, live happily, have high abilities and care about society [Online]. http://site.ksp.or.th/content.php?site=library&SiteMenuID=4472&Action=view&Sys_Page=&Sys_PageSize=&DataID=2251 (in Thai)

Lee, S., & Dajpratham, P. (2017). To assess the criterion validity of the Thai version of the 9- and the 2-questions of the Patient Health Questionnaire (PHQ-9 and PHQ-2) as screening instruments for major depression in Thai elderly. J Thai Rehabil Med, 27(1), 30-37. (in Thai)

Makmee, P. (2021). Using the Mplus program to analyze data for research development [Lecture Document]. National Research Council of Thailand (NRCT). (in Thai)

Office of the Education Council. (2019). Report on the results of research and development of the competency framework for early primary school students for basic education courses. Ministry of Education. (in Thai)

Rangsungnoen, K. (2011). Factor analysis with SPSS and AMOS for research. SE-ED Education. (in Thai)

Runghuapai, R. (2015). A Development of collaborative learning competencies model for primary students [Doctoral Disserrtation]. Srinakharinwirot University. (in Thai)

Tangpattanakit, J., & Senariddhikrai, P. (2022). The Role of Confirmatory Factor Analysis (CFA) in Structural Equation Modeling (SEM), Journal of Management Sciences Kasetsart University, 1(2). (in Thai)

Thanapatpisarn, P. (2022). [Fundamental Data Analytics & Data Scientist EP.21] Model Performance was measured by Evaluation Metrics Part 2. https://datascihaeng.medium.com/evaluation-matrix-part2-a7d83aea6537 (in Thai)

Wiratchai, N. (2006). LISREL Model: statistical analysis for research (3rd ed.). Chulalongkorn University Press. (in Thai)

XCL World Academy. (2021). 10 effective strategies for managing exam stress To be successful [online]. https://www.xwa.edu.sg/th/blog/tips-guides/10-effective-strategies-for-successfully-managing-exam-stress/ (in Thai)