The Development of a Scale to Measure Growth Mindsets for Lower Secondary School Students with the Application of Anchoring Vignettes
Article Sidebar
Main Article Content
Abstract
This research aimed to: 1) develop a scale and a set of anchoring vignettes to measure growth mindsets for lower secondary school students, and 2) validate the developed scale by applying the anchoring vignettes as supplementary tools to aid students in interpreting and responding to the scale items effectively. The sample for this study comprised 300 lower secondary school students enrolled in the LamPang Primary Educational Service Area Offices 1 to 3. They were selected using a multi-stage random sampling method to ensure representation across the schools. The research utilized a combination of a growth mindsets scale and anchoring vignettes as its primary data collection tools. Data analysis was conducted using Cronbach's alpha coefficient to assess internal consistency, Pearson’s correlation coefficient to explore relationships between variables, confirmatory factor analysis to validate the scale structure, and item response theory to evaluate item performance and characteristics. The results of the study revealed two main findings. Firstly, the developed growth mindset scale exhibited acceptable content validity, with a content validity index ranging from .60 to 1.00. Additionally, the high Cronbach’s alpha coefficients of .91 indicated a high level of internal consistency within the scale. Furthermore, the analysis confirmed that the developed vignettes met the assumption of vignette equivalence, as respondents perceived the situations described in the vignettes uniformly. Secondly, the utilization of anchoring vignettes to mitigate response biases resulted in an improved quality of growth mindset measurement. This improvement was evidenced by enhancements in Cronbach’s alpha coefficients, item discrimination, factor structure, and construct validity. Moreover, the data analysis employing item response theory demonstrated that the incorporation of anchoring vignettes in measuring growth mindsets led to enhanced measurement precision across a wide range of proficiency levels.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
The content and information contained in the published article in the Journal of Educational Measurement Mahasarakham University represent the opinions and responsibilities of the authors directly. The editorial board of the journal is not necessarily in agreement with or responsible for any of the content.
The articles, data, content, images, etc. that have been published in the Journal of Educational Measurement Mahasarakham University are copyrighted by the journal. If any individual or organization wishes to reproduce or perform any actions involving the entirety or any part of the content, they must obtain written permission from the Journal of Educational Measurement Mahasarakham University.
References
Dweck, C. S. (2000). Self-theories: Their role in motivation, personality, and development. Psychology Press.
Dweck, C. S. (2006). Mindset: The new psychology of success. Random House.
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2018). Multivariate data analysis (8th ed.). Cengage Learning.
Hopkins, D. J., & King, G. (2010). Improving anchoring vignettes: Designing surveys to correct interpersonal incomparability. Public Opinion Quarterly, 74(2), 201–222. https://doi.org/10.1093/poq/nfq011
King, G., Murray, C. J. L., Salomon, J. A., & Tandon, A. (2009). Anchoring vignettes: Frequently asked questions. Retrieved January 15, 2011, from https://gking.harvard.edu/files/gking/files/vfaq.pdf
King, G., Murray, C. J., Salomon, J. A., & Tandon, A. (2004). Enhancing the validity and cross-cultural comparability of measurement in survey research. American Political Science Review, 98(1), 191–207. https://doi.org/10.1017/S000305540400108X
Kyllonen, P. C. (2012, May). Measurement of 21st century skills within the Common Core State Standards. Paper presented at the Invitational Research Symposium on Technology Enhanced Assessments, 7–8.
Kyllonen, P. C., & Bertling, J. J. (2014). Innovative questionnaire assessment methods to increase cross-country comparability. In L. Rutkowski, M. von Davier, & D. Rutkowski (Eds.), Handbook of international large-scale assessment: Background, technical issues, and methods of data analysis (pp. 277–286). CRC Press.
Messick, S. (1995). Validity of psychological assessment: Validity of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50(9), 741–749. https://doi.org/10.1037/0003-066X.50.9.741
Midkiff, B., Langer, M., Demetriou, C., & Panter, A. T. (2018). An IRT analysis of the growth mindset scale. In V. Cherkassky, V. Vovk, & H. Wang (Eds.), Quantitative psychology (pp. 203–214). Springer. https://doi.org/10.1007/978-3-319-77249-3_14
Mõttus, R., Allik, J., Realo, A., Rossier, J., Zecca, G., Ah-Kion, J., Amoussou-Yéyé, D., Bäckström, M., Barkauskiene, R., Barry, O., Bhowon, U., Björklund, F., Bochaver, A., Bochaver, K., de Bruin, G., Cabrera, H. F., Chen, S. X., Church, A. T., Cissé, D. D., Dahourou, D., ..., Johnson, W. (2012). The effect of response style on self-reported conscientiousness across 20 countries. Personality and Social Psychology Bulletin, 38(11), 1423–1436. https://doi.org/10.1177/0146167212451275
Organisation for Economic Co-operation and Development. (2014). PISA 2012 technical report. https://www.oecd.org/pisa/pisaproducts/PISA-2012-technical-report-final.pdf
Primi, R., Zanon, C., Santos, D., De Fruyt, F., & John, O. (2016). Anchoring vignettes. European Journal of Psychological Assessment, 32(1), 39-51. https://doi.org/10.1027/1015-5759/a000336
Reckase, M. D. (1979). Unifactor latent trait models applied to multifactor tests: Results and implications. Journal of Educational Statistics, 4(3), 207-230. https://doi.org/10.3102/10769986004003207
Rissanen, I., Kuusisto, E., Tuominen, M., & Tirri, K. (2019). In search of a growth mindset pedagogy: A case study of one teacher's classroom practices in a Finnish elementary school. Teaching and Teacher Education, 77, 204-213.
Stankov, L., Lee, J., & Paek, I. (2009). Realism of confidence judgments. European Journal of Psychological Assessment, 25, 123-130.
Stankov, L., Lee, J., Luo, W., & Hogan, D. J. (2012). Confidence: A better predictor of academic achievement than self-efficacy, self-concept, and anxiety?. Learning and Individual Differences, 22(6), 747-758. https://doi.org/10.1016/j.lindif.2012.05.013
Steven, J. P. (2009). Applied multivariate statistics for the social sciences (p. 345). Routledge.
von Davier, M. (2010). Why sum scores may not tell us all about test takers. Newborn and Infant Nursing Reviews, 10(1), 27–36. https://doi.org/10.1053/j.nainr.2009.12.011
von Davier, M., Shin, H. J., Khorramdel, L., & Stankov, L. (2018). The effects of vignette scoring on reliability and validity of self-reports. Applied Psychological Measurement, 42(4), 291-306. https://doi.org/10.1177/0146621617730389
Wand, J., King, G., & Lau, O. (2011). Anchors: Software for anchoring vignette data. Journal of Statistical Software, 42, 1-25.
Westby, C. (2020). Growth mindsets: Ideas from Carol Dweck. Word of Mouth, 31(5), 1-3.
Yılmaz, E. (2022). Development of Mindset Theory Scale (Growth and Fixed Mindset): A validity and reliability study. Research on Education and Psychology (REP), 6, 1-24.
Absuksiri, A. (2022). Psychology for teachers (7th ed.). Chulalongkorn University Press. (in Thai)
Choothong, M. (2014). A development of students’ achievement motivation assessment tool using anchoring vignette [Master’s thesis]. Chulalongkorn University. (in Thai)
Janprasert, B. (2019). A development of study burnout measurement tool using anchoring vignette. Veridian E-Journal Silpakorn University, 12(2), 825–845. (in Thai)
Kaewkua, V. (2020). A development of the goodness scale to evaluate growing good program: Score adjustment by using anchoring vignettes method [Doctoral dissertation]. Chulalongkorn University. (in Thai)
Kanjanawasee, S. (2020). Classical Test Theory (4th ed.). Chulalongkorn University Press. (in Thai)
Limsantitham, N., Khumwong, P., Phonpoke, N., & Dahsah, C. (2019). Growth mindset in science learning of lower secondary students in schools under the Bangkok Metropolitan Administration. Srinakharinwirot Science Journal, 35(2), 149-165. (in Thai)
Rungrotrangsan, K. (2017). A development of the sportsmanship scale of athletes in the Institute of Physical Education [Master’s thesis]. Songkla University. (in Thai)
Suriyachanhom, T., & Piyakul, A. (2018). The factors and the indicators of growth mindset for undergraduate teacher professional students. Journal of Graduate School, Pitchayatat, 14(1), 81-90. (in Thai)
Sutthisomboon, S. L. (2020). Growth mindset intervention in teaching and learning: Meta-analysis and content analysis [Doctoral dissertation]. Rangsit University. (in Thai)
Tippawon, C. (2019). Development indicators of growth mindset for sixth grade students [Master’s thesis]. Mahasarakham University. (in Thai)
Untong, A., Guntawongwan, K., & Piromsombat, K. (2018). Correcting scale perception bias in measuring local residents’ perception in tourism development impact using anchoring vignettes. Journal of Research Methodology, 30(2), 225–250. (in Thai)
Wongyai, W., & Patphol, M. (2019). Learning management for enhancing growth mindset. Sikkha Journal of Education, 6(1), 52–60. (in Thai)
Wongyai, W., & Patphol, M. (2020). Learning based on growth mindset. Graduate School, Srinakharinwirot University. (in Thai)
