Meta-Analysis of the Effective Learning Activities Model On Students' Problem-Solving Thinking: Propensity Score Matching

Main Article Content

Supansa Surin
Suntonrapot Dumrongpanit

Abstract

The research aimed to: 1) investigate the effect sizes and research characteristics that influence students' problem-solving thinking, and 2) compare the effect sizes of the learning activity model to develop students' problem-solving thinking after adjusting the propensity score matching. Thirty-five graduate-level research papers published from 2002 to 2022 were studied. Data were gathered, using a form for recording research characteristics and an assessment form for assessing research quality. Effect sizes were calculated, using Glass's method, and the data were analyzed, using random effects, fixed effects, meta-regression, and propensity score matching techniques. The research findings revealed that:


1) Researches focusing on learning management models significantly influenced students' problem-solving abilities at a high level ( gif.latex?\bar{d} = 1.395). The research characteristics with 4 variables—the university producing the research, the field, the total duration, and the quality—significantly influenced students' problem-solving thinking at a statistically significant level of .05; and 2) after adjusting the propensity score matching, it was found that inquiry-based learning had the greatest impact on students' problem-solving thinking. Designing learning activities that allow students to explore problems, create understanding, expand their thinking through collaborative discussion, and assess outcomes according to the appropriateness of each context will improve students' problem-solving thinking.

Article Details

Section
Research Article

References

Akkerman, S., Admiraal, W., Brekelmans, M., & Oost, H. (2008). Auditing quality of research in social sciences. Quality & Quantity, 42, 257-274. https://doi.org/10.1007/s11135-006-9044-4

Austin, P. C. (2009). The relative ability of different propensity score methods to balance measured covariates between treated and untreated subjects in observational studies. Medical Decision Making, 29(6), 661-677. https://doi.org/10.1177/0272989X09341755

Bai, H. (2011). A comparison of propensity score matching methods for reducing selection bias. International Journal of Research & Method in Education, 34(1), 81-107. https://doi.org/10.1080/1743727X.2011.552338

Benedetto, U., Head, S. J., Angelini, G. D., & Blackstone, E. H. (2018). Statistical primer: propensity score matching and its alternatives. European Journal of Cardio-Thoracic Surgery, 53(6), 1112-1117. https://doi.org/10.1093/ejcts/ezy167

Borenstein, M., Hedges, L. V., Higgins, J. P., & Rothstein, H. R. (Eds.). (2021). Introduction to meta-analysis. John Wiley & Sons.

Card, N. A. (2012). Applied meta-analysis for social science research. The Guilford Press.

Cooper, H., Hedges, L. V., & Valentine, J. C. (2019). The handbook of research synthesis and meta-analysis (3rd ed.). Russell Sage Foundation. https://doi.org/10.7758/9781610448864

Czodrowski, P. (2014). Count on kappa. Journal of Computer-aided Molecular Design, 28, 1049-1055. https://doi.org/10.1007/s10822-014-9759-6

Dewey, J. (2022). How we think. DigiCat.

Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997). Bias in meta-analysis detected by a simple, graphical test. BMJ, 315, 629-634. https://doi.org/10.1136/bmj.315.7109.629

Eisenkraft, A. (2003). Expanding the 5e model. The Science Teacher, 70(6), 56–59.

Glass, G. V. (1976). Primary, secondary, and meta-analysis of research. Educational Researcher, 5(10), 3-8. https://doi.org/10.3102/0013189X005010003

Isaksen, S. G., Dorval, K. B., & Treffinger, D. J. (2010). Creative approaches to problem solving: A framework for innovation and change. SAGE publications.

Itsarangkul-Na-Ayutthaya, T., & Damrongpanit, S. (2022a). A meta-analysis of instructional management models affecting creative thinking development. European Journal of Educational Research, 11(4), 2069-2085. https://doi.org/10.12973/eu-jer.11.4.2069

Itsarangkul-Na-Ayutthaya, T., & Damrongpanit, S. (2022b). A meta-analysis of instructional management model for students' creative thinking development: An application of propensity score matching. European Journal of Educational Research, 11(4), 2429-2444. https://doi.org/10.12973/eu-jer.11.4.2429

Johnson, D. W., & Johnson, R. T. (2009). An educational psychology success story: Social interdependence theory and cooperative learning. Educational researcher, 38(5),

-379. https://doi.org/10.3102/0013189X09339057

Mayer, R. E. (2019). Problem solving. Oxford Research Encyclopedia of Education. https://doi.org/10.1093/acrefore/9780190264093.013.860

National Research Council. (2012). Education for life and work: Developing transferable knowledge and skills in the 21st century. National Academies Press.

Rosenbaum, P. R., & Rubin, D. B. (2023). Propensity scores in the design of observational studies for causal effects. Biometrika, 110(1), 1-13. https://doi.org/10.1093/biomet/asac054

Thornton, A., & Lee, P. (2000). Publication bias in meta-analysis: its causes and consequences. Journal of Clinical Epidemiology, 53(2), 207-216. https://doi.org/10.1016/S0895-4356(99)00161-4

Van Houwelingen, H. C., Arends, L. R., & Stijnen, T. (2002). Advanced methods in meta analysis: multivariate approach and meta‐regression. Statistics in Medicine, 21(4), 589-624. https://doi.org/10.1002/sim.1040

Vevea, J. L., Coburn, K. M., & Sutton, A. J. (2019). Publication bias. In H. Cooper, L. V. Hedges, & J. C. Valentine (Eds.), The handbook of research synthesis and meta-analysis (3rd ed., pp. 383-429). Russell Sage Foundation. https://doi.org/10.7758/9781610448864.21

Khunchana, W. (2007). Meta-analysis of research on student's problem solving skills. [Master’s thesis]. Chulalongkorn University. (in Thai)

Susaorat, P. (2010). Cognitive Development (5th ed.). 9119 Technique Printing Co., Ltd. (in Thai)