Development of a Multidimensional Mathematical Literacy Test in an Application Platform for Grade 9 Students with Feedback Integration

Main Article Content

Pranee Kaewma
Namthip Ongardwanich
Samran Mejang

Abstract

This research aimed to develop a Multidimensional Mathematical Literacy Test in an application platform for Grade 9 students with integrated feedback. The sample consisted of 483 students from the Secondary Educational Service Area Office in Tak Province, selected through a multi-stage sampling method. The results from developing the test using Multidimensional Item Response Theory (MIRT) indicated that the assessment demonstrated high quality in terms of validity. A panel of five experts evaluated the content for coherence and relevance, with 30 items meeting the established criteria and achieving Item-Objective Congruence (IOC) values ranging from .60 to 1.00. The data were analyzed using MIRT with the NOHARM software, applying a multivariate cumulative normal model. The analysis revealed that the test exhibited multidimensional discrimination (MDISC) values ranging from 0.247 to 3.029, and difficulty (MDIFF) values ranging from -1.023 to 2.830. The item information function indicated that the test provided the most information for students within the moderate ability range.

Article Details

Section
Research Article

References

OECD. (2018). PISA 2022 Mathematics Framework (draft). https://pisa2022-maths.oecd.org

Rupp, A. A., & Templin, J. (2008). The effects of Q-matrix misspecification on parameter estimates and classification accuracy in the DINA model. Educational and Psychological Measurement, 68(1), 78–96. https://doi.org/10.1177/0013164407301545

Kaewmanee, K. (2009). The development of electronic books to enhance reading comprehension skills Thai Language Learning Group: Local Set for Phitsanulok Residents for 6th Grade Elementary Students [Master’s thesis]. Naresuan University. (in Thai)

Kanjanawasee, S. (2007). Modern test theory (3th ed.). Chulalongkorn University Press. (in Thai)

Kanjanawasee, S. (2009). Classical test theory (6th ed.). Chulalongkorn University Press. (in Thai)

Khlangbunkrong, K. (2012). A web application to assist mothers in monitoring children's health and recording their development [Bachelor of Science’s thesis], King Mongkut's University of Technology Thonburi. (in Thai)

Klanin, S., Dechsri, P., & Pramojanee, A. (2008). Knowledge and Scientific Competence for Tomorrow's World. Seven Printing Group. (in Thai)

Manochanpen, N. (2022). TDRI points out that Thai students' PISA scores have declined in all competencies, reflecting an educational crisis that must be urgently addressed at its root causes. https://thestandard.co/tdri-pisa-test-results/ (in Thai)

Masantiah, J. (2017). Development of a computer-based testing system with immediate feedback for different student’s ability levels: application of Rasch SIRT model [Doctoral dissertation]. Chulalongkorn University Press. (in Thai)

Tayraukhum, S. (2010). Statistical Methodologies for Empirical Research. Department of Educational Research and Development, Faculty of Education, Mahasarakham University. (in Thai)

Tayraukhum, S. (n.d). Teaching materials on the development of multidimensional tests, Department of Research and Educational Development. Mahasarakham University. (in Thai)