The Development of a Critical Thinking Skills Measurement Tool in Science and Technology for Grade 6 Students

Main Article Content

Piyaporn Prathomwong
Prakittiya Tuksino

Abstract

This research aimed to: 1) identify the components and behavioral indicators of critical thinking skills in sixth-grade students; 2) develop and examine the quality of a critical thinking skills assessment tool for sixth-grade students; and 3) establish cutoff scores for critical thinking skills using a design-based research approach. The sample consisted of 500 sixth-grade students selected through multi-stage random sampling for the main phase of data collection. The instrument was a multiple-choice test with four options per item; a correct response received 1 point, while an incorrect response received 0 points. Data were analyzed using classical test theory (CTT) and item response theory (IRT). The findings as follows:
1. The synthesis of critical thinking components resulted in five key elements: 1) problem identification, 2) hypothesis formulation, 3) data collection, 4) data analysis, and 5) conclusion drawing.
2. The quality assessment of the instrument revealed that the item-objective congruence index was 1.00 for all 40 items. The quality after using with item response theory, it was found that the discrimination parameter (ai) was between 0.39 and 5.03, the difficulty parameter (bi) was between -1.29 and 5.14, and the guessing parameter (ci) was between 0.13 and 0.27.
3. Model fit indices suggested that a three-class latent model—comprising high, medium, and low critical thinking skill groups—was the most appropriate (Likelihood = -11858.198, df = 378, AIC = 23960.395, BIC = 24474.578, Adj.BIC = 24087.342, Ek = 0.846). The cutoff scores were 23.7 (between high and medium groups) and 16.1 (between medium and low groups).

Article Details

Section
Research Article

References

Davis, L. L. (1992). Instrument review: Getting the most from your panel of experts. Applied Nursing Research, 5(4), 194–197. https://doi.org/10.1016/S0897-1897(05)80008-4

Ennis, R. H., & Millman, J. (1985). Cornell Critical Thinking Test, Level X. Midwest Publications.

Glass, G. V. (1978). Standards and criteria. Journal of Educational Measurement, 15(4), 243–257.

Hooper, D., Coughlan, J., & Mullen, M. R. (2008). Structural equation modelling: Guidelines for determining model fit. Electronic Journal of Business Research Methods, 6(1), 53–60.

Millman, J. (1973). Passing scores and test length for domain-referenced measures. Review of Educational Research, 43(2), 205–216. https://doi.org/10.3102/00346543043002205

Schumacker, R. E., & Lomax, R. G. (2004). A beginner’s guide to structural equation modeling (2nd ed.). Lawrence Erlbaum Associates.

Watson, G., & Glaser, E. M. (1980). Watson-Glaser Critical Thinking Appraisal, Forms A and B manual. The Psychological Corporation.

Yamane, T. (1973). Statistics: An introductory analysis (3rd ed.). Harper & Row.

Kammanee, T. (2018). Teaching theory: Knowledge for organizing effective learning processes. Chulalongkorn University. (in Thai)

Kanjanawasee, S. (2013). Classical test theory (7th ed.). Chulalongkorn University Press. (in Thai)

Kanjanawasee, S. (2020). Modern test theory (5th ed.). Chulalongkorn University Press. (in Thai)

Malingam, C. (2015). A development of scientific mild scale for lower secondary school students: Application of latent class analysis for establishing cut scores [Master’s thesis]. Chulalongkorn University. (in Thai)

Wonggom, J. (2009). Critical thinking ability and learning achievement in science subject for grade 7 students on the property and separation of substances by inquiry cycle [Master’s thesis]. Khon Kaen University. (in Thai)