Development and Validation of Cognitive Diagnostic Test on pH of Acid-Base Solution using G-DINA Model
Article Sidebar
Main Article Content
Abstract
The purpose of this research was to develop and validate a cognitive diagnostic test using the G-DINA model as a Cognitive Diagnostic Model (CDM). The research instrument was a cognitive diagnostic test in pH of acid-base solutions. The cognitive diagnostic test in this research was a 4-choice test that contained 25 questions. Each item aimed to measure one to three attributes. The sample of this research consisted of 622 grade 11 students in the academic year 2023, in schools under the Office of the Basic Education Commission (OBEC), Ministry of Education. The results of this research showed that the attributes used in diagnosing the pH of acid-base solutions consisted of 3 characteristics: 1) calculating the hydronium ion or hydroxide ion concentration of acid and base solutions, 2) calculating the pH of acid and base solutions, and 3) determining the acidity-baseness of a solution from the pH range of the indicator. The results of the Q-matrix validated by the expert judgment method revealed that all of the test items could accurately classify attributes (IOC = 1.00). The results of the discriminant index (r = 0.19 to 0.71) showed that 21 out of 25 questions with discriminant index passed the criteria, accounting for 84 percent. The result of the diagnostic analysis obtained by using the G-DINA Model indicated that the diagnostic test was able to classify test takers with 93.8% accuracy. The results of the reliability passed the criteria ( = 0.88). Therefore, the diagnostic test was a quality test that can be used to diagnose the concept of pH of acid-base solutions.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
The content and information contained in the published article in the Journal of Educational Measurement Mahasarakham University represent the opinions and responsibilities of the authors directly. The editorial board of the journal is not necessarily in agreement with or responsible for any of the content.
The articles, data, content, images, etc. that have been published in the Journal of Educational Measurement Mahasarakham University are copyrighted by the journal. If any individual or organization wishes to reproduce or perform any actions involving the entirety or any part of the content, they must obtain written permission from the Journal of Educational Measurement Mahasarakham University.
References
Chaimongkol, N., & Ngudgratoke, S. (2018). Cognitive Diagnostic Report for large scale testing: A case of Ordinary National Education Testing (ONET) in Thailand. Yearbook of Teacher Education, 316-322.
de la Torre, J. (2011). The Generalized DINA Model Framework. Psychometrika, 76(2), 179-199. https://doi.org/10.1007/s11336-011-9207-7
de la Torre, J., & Akbay, L. (2019). Implementation of Cognitive Diagnosis Modeling using the GDINA R Package. Eurasian Journal of Educational Research (EJER), 19, 171-192. https://doi.org/10.14689/ejer.2019.80.9
de la Torre, J., & Chiu, C, Y. (2016). A general method of empirical Q-matrix validation. Psychometrika, 81(2), 253-273. https://doi.org/10.1007/s11336-015-9467-8
Hoe, K. Y., & Subramaniam, R. (2016). On the prevalence of alternative conceptions on acid–base chemistry among secondary students: insights from cognitive and confidence measures. Chemistry Education Research and Practice, 2016(17), 263-282. https://doi.org/https://doi.org/10.1039/C5RP00146C
Ma, W., & de la Torre, J. (2019). Category-Level Model Selection for the Sequential G-DINA Model. Journal of Educational and Behavioral Statistics, 44(1), 45-77. https://doi.org/10.3102/1076998618792484
Ma, W., & de la Torre, J. (2020). GDINA: An R Package for Cognitive Diagnosis Modeling. Journal of Statistical Software, 93(14), 1–26. https://doi.org/10.18637/jss.v093.i14
Mubarokah, F, D., Mulyani, S., & Indriyanti, N, Y. (2018). Identifying Students’ Misconceptions of Acid-Base Concepts Using a Three-Tier Diagnostic Test: A Case of Indonesia and Thailand. Journal of Turkish Science Education, 15, 51-58. https://doi.org/10.12973/tused.10256a
Nájera, P., Sorrel, M. A., & Abad, F. J. (2019). Reconsidering Cutoff Points in the General Method of Empirical Q-Matrix Validation. Educational and Psychological Measurement, 79(4), 727-753. https://doi.org/10.1177/0013164418822700
Oguz Basokcu, T., Tuncay O., & Hulya K. (2013). Model Data Fit Comparison between DINA and G-DINA in Cognitive Diagnostic Models. Education Journal, 2(6), 256-262. https://doi.org/10.11648/j.edu.20130206.18
Shi, Q., Ma, W., Robitzsch, A., Sorrel, M, A., & Man, K. (2021). Cognitively Diagnostic Analysis Using the G-DINA Model in R. Psych 2021, 3, 812-835. https://doi.org/10.3390/psych3040052
Soeharto, S., Csapó, B., Sarimanah, E., Dewi, F.I., & Sabri, T. (2019). A Review of Students’ Common Misconceptions in Science and Their Diagnostic Assessment Tools. Indonesian Journal of Science Education, 8(2), 247-266. https://doi.org/10.15294/JPII.V8I2.18649
Susilaningsih, E., Nuswowati, M., & Muttaqiin, U. (2020). Using open reasoned Three-tier Test to identify acid-base conceptual understanding of senior high school student. Journal of Physics: Conference Series, 1567, 022055. https://doi.org/10.1088/1742-6596/1567/2/022055
Taber, K. S. (2018). The Use of Cronbach’s Alpha When Developing and Reporting Research Instruments in Science Education. Research in Science Education, 48, 1273–1296. https://doi.org/10.1007/s11165-016-9602-2
Wang, W., Song, L., Chen, P., Meng, Y., & Ding, S. (2015). Attribute-Level and Pattern-Level Classification Consistency and Accuracy Indices for Cognitive Diagnostic Assessment. Journal of Educational Measurement, 52(4), 457–476. http://www.jstor.org/stable/43940633
Wise, S, L., & Kong, X, J. (2005). Response Time Effort: A New Measure of Examinee Motivation in Computer-Based Tests. Applied Measurement in Education, 18, 163 - 183.
Chaimongkol, N., Anantasawas, S., & Rumsaeng, V. (2020). The Development of Cognitive Diagnostic Test in Covalent Molecules: An Application of G-DINA Model. Journal of Education Naresuan University, 24(1), 123-137. (in Thai)
Kanjanawasee, S. (2013). Classical Test Theory (7th ed.). Chulalongkorn University Press. (in Thai)
Office of Basic Education Policy and Planning. (2023). Educational statistics for academic year 2023. http://www.bopp.go.th/?page_id=3544 (in Thai)