The Guidelines for Utilizing the Assessment of Executive Function Skill in Research

Main Article Content

Warabud Suppalarkbunlue

Abstract

This article aims to review previous research related to the assessment of executive function (EF). EF skill is controlling emotions, thoughts, and behaviors so they are expressed appropriately in the situation one is facing, to achieve the goals (goal-directed behavior). EF continuously changes throughout one’s life and it is important for human development. Therefore, in assessing the EF skill, it is necessary to choose methods that are suitable for research objectives, elements of EF to be assessed, and the age of the sample, so that the assessment results can indicate the level of EF skill as close to reality as possible. This article describes 3 types of assessment (i.e., behavioral rating scale, performance-based assessment, and brain imaging). Each type reveals information from different contexts i.e., normal situations, challenging situations under standard conditions, and related areas of brain function, respectively. In addition, this article also presents the analysis of the strengths and limitations of each type, guidelines for selecting assessment methods, and examples of research that assessed EF skills in Thailand, so that researchers can choose an appropriate method for their research design.

Article Details

Section
Academic Article

References

Abdul Rahman, A., Carroll, D. J., Espy, K. A., & Wiebe, S. A. (2017). Neural Correlates of Response Inhibition in Early Childhood: Evidence from a Go/No-Go Task. Developmental neuropsychology, 42(5), 336–350.

Baggetta, P., & Alexander, P. A. (2016). Conceptualization and operationalization of executive function. Mind, Brain, and Education, 10(1), 10-33.

Bernier, A., Carlson, S. M., & Whipple, N. (2010). From external regulation to self-regulation: Early parenting precursors of young children’s executive functioning. Child development, 81(1), 326-339.

Best, J. R., & Miller, P. H. (2010). A developmental perspective on executive function. Child development, 81(6), 1641-1660.

Bezdjian, S., Baker, L. A., Lozano, D. I., & Raine, A. (2009). Assessing inattention and impulsivity in children during the Go/NoGo task. The British journal of developmental psychology, 27(2), 365–383.

Bialystok, E. (2015). Bilingualism and the development of executive function: The role of attention. Child development perspectives, 9(2), 117-121.

Carlson, S. M. (2005). Developmentally sensitive measures of executive function in preschool children. Developmental neuropsychology, 28(2), 595–616.

Diamond, A. (2013). Executive functions. Annual review of psychology, 64, 135-168.

García-Molina, A. (2012). Phineas Gage y and the enigma of the prefrontal cortex. Neurologia, 27(6), 370-375.

Gioia, G. A., Isquith, P. K., Guy, S. C., & Kenworthy, L. (2000). Behavior rating inventory of executive function: BRIEF. Psychological Assessment Resources.

Guo, X., Ohsawa, C., Suzuki, A., & Sekiyama, K. (2018). Improved Digit Span in Children after a 6-Week Intervention of Playing a Musical Instrument: An Exploratory Randomized Controlled Trial. Frontiers in Psychology, 8, 2303. https://doi.org/10.3389/fpsyg.2017.02303

Heaton, R. K., Chelune, G. J., Talley, J. L., Kay, G. G., & Curtiss, G. (1993). Wisconsin Card Sorting Test Manual- Revised and Expanded. PAR.

Huizinga, M., & Smidts, D. P. (2010). Age-related changes in executive function: A normative study with the Dutch version of the Behavior Rating Inventory of Executive Function (BRIEF). Child neuropsychology, 17(1), 51-66.

Jirout, J., LoCasale-Crouch, J., Turnbull, K., Gu, Y., Cubides, M., Garzione, S., Evans, T.M., Weltman, A.L. & Kranz, S. (2019). How lifestyle factors affect cognitive and executive function and the ability to learn in children. Nutrients, 11(8), 1953.

Kilenthong, W. T., Boonsanong, K., Duangchaiyoosook, S., Jantorn, W., & Khruapradit, V. (2023). Learning losses from school closure due to the COVID-19 pandemic for Thai kindergartners. Economics of Education Review, 96, 102455.

Koike, S., Nishimura, Y., Takizawa, R., Yahata, N., & Kasai, K. (2013). Near-infrared spectroscopy in schizophrenia: a possible biomarker for predicting clinical outcome and treatment response. Frontiers in psychiatry, 4, 145.

Lawson, G. M., Hook, C. J., & Farah, M. J. (2018). A meta-analysis of the relationship between socioeconomic status and executive function performance among children. Developmental science, 21(2), e12529.

Lertladaluck, K., Suppalarkbunlue, W., Moriguchi, Y., & Chutabhakdikul, N. (2021). School based mindfulness intervention improves executive functions and self-regulation in preschoolers at risk. The Journal of Behavioral Science, 16(2), 58-72.

Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000). The unity and diversity of executive functions and their contributions to complex “frontal lobe” tasks: A latent variable analysis. Cognitive psychology, 41(1), 49-100.

Moffitt, T. E., Arseneault, L., Belsky, D., Dickson, N., Hancox, R. J., Harrington, H., Houtsa, R., Poultonc, R, Robertsd, B. W., Rossa, S., Searse, M. R., Thomsong, M., & Caspi, A. (2011). A gradient of childhood self-control predicts health, wealth, and public safety. Proceedings of the national Academy of Sciences, 108(7), 2693-2698.

Muir, R. A., Howard, S. J., & Kervin, L. (2023). Interventions and Approaches Targeting Early Self-Regulation or Executive Functioning in Preschools: A Systematic Review. Educational Psychology Review, 35(1), 27.

Parkes, J. (2000). Relationship between reliability and cost of performance assessment. Education policy analysis archives, 8, 16-30.

Raver, C. C., Jones, S. M., Li-Grining, C., Zhai, F., Bub, K., & Pressler, E. (2011). CSRP’s impact on low-income preschoolers’ preacademic skills: self-regulation as a mediating mechanism. Child development, 82(1), 362-378.

Richmond-Rakerd, L. S., Caspi, A., Ambler, A., d'Arbeloff, T., de Bruine, M., Elliott, M., Harrington, H., Hogan, S., Houts, R. M., Ireland, D., Keenan, R., Knodt, A. R., Melzer, T. R., Park, S., Poulton, R., Ramrakha, S., Rasmussen, L. J. H., Sack, E., Schmidt, A. T., Sison, M. L., Wertz, J., Hariri, A. R., & Moffitt, T. E. (2021). Childhood self-control forecasts the pace of midlife aging and preparedness for old age. Proceedings of the National Academy of Sciences of the United States of America, 118(3), e2010211118. https://doi.org/10.1073/pnas.2010211118

Rosas, R., Espinoza, V., Martínez, C., & Santa-Cruz, C. (2022). Playful Testing of Executive Functions with Yellow-Red: Tablet-Based Battery for Children between 6 and 11. Journal of Intelligence, 10(4), 125.

Rueda, M. R., Fan, J., McCandliss, B. D., Halparin, J. D., Gruber, D. B., Lercari, L. P., & Posner, M. I. (2004). Development of attentional networks in childhood. Neuropsychologia, 42(8), 1029–1040.

Rupsuwan, T., Chiengchana, N., & Buranaprapuk, A. (2023). The Effect of Virtual Music Therapy Interventions on the Executive Function of a Child with Autism Spectrum Disorder: A Single-Case Study. Journal of Ratchasuda College for Research and Development of Persons with Disabilities, 19(1), 39-60.

Schmidt, E. L., Burge, W., Visscher, K. M., & Ross, L. A. (2016). Cortical thickness in frontoparietal and cingulo-opercular networks predicts executive function performance in older adults. Neuropsychology, 30(3), 322.

Shallice, T. I. M., & Burgess, P. W. (1991). Deficits in strategy application following frontal lobe damage in man. Brain, 114(2), 727-741.

Shing, Y. L., Lindenberger, U., Diamond, A., Li, S. C., & Davidson, M. C. (2010). Memory maintenance and inhibitory control differentiate from early childhood to adolescence. Developmental Neuropsychology, 35(6), 679-697.

Soto, E. F., Kofler, M. J., Singh, L. J., Wells, E. L., Irwin, L. N., Groves, N. B., and Miller, C. E. (2020). Executive functioning rating scales: Ecologically valid or construct invalid? Neuropsychology, 34(6), 605.

Strommen, E. A. (1973). Verbal self-regulation in a children's game: Impulsive errors on "Simon says." Child Development, 44(4), 849–853. https://doi.org/10.2307/1127737

Suppalarkbunlue, W., Chutabhakdikul, N., Lertladaluck, K., & Moriguchi, Y. (2023a). Promoting Inhibitory Control in Preschool Children Through Music-Movement Activities in the Classroom. Journal of Research in Childhood Education, 37(2), 275-291.

Suppalarkbunlue, W., Duangchaiyoosook, S., Khruapradit, V., & Kilenthong, W. T. (2023b). Material incentive motivation and working memory performance of kindergartners: A large-scale randomized controlled trial. Journal of Experimental Child Psychology, 235, 105730.

Tau, G. Z., & Peterson, B. S. (2010). Normal development of brain circuits. Neuropsychopharmacology, 35(1), 147-168.

Thammachai, A., Parasin, N., Wongsaya, E., & Seeharach, K. (2017). Relationship of Functional Mobility and Quality of Life with Executive Function in Older Adults. Srinagarind Medical Journal, 32(5), 435-43.

Toplak, M. E., West, R. F., & Stanovich, K. E. (2013). Practitioner review: Do performance-based measures and ratings of executive function assess the same construct? Journal of child psychology and psychiatry, 54(2), 131–143.

Volpe, R. J., Briesch, A. M., & Gadow, K. D. (2011). The efficiency of behavior rating scales to assess inattentive-overactive and oppositional-defiant behaviors: applying generalizability theory to streamline assessment. Journal of school psychology, 49(1), 131–155.

Wechsler, D. (2003). Wechsler intelligence scale for children (4th ed.). Pearson.

Weintraub, S., Dikmen, S. S., Heaton, R. K., Tulsky, D. S., Zelazo, P. D., Bauer, P. J., ... & Gershon, R. C. (2013). Cognition assessment using the NIH Toolbox. Neurology, 80(11 Supplement 3), S54-S64.

Wiebe, S. A., Espy, K. A., & Charak, D. (2008). Using confirmatory factor analysis to understand executive control in preschool children: I. Latent structure. Developmental psychology, 44(2), 575-587.

Willoughby, M. T., Blair, C. B., Wirth, R. J., & Greenberg, M. (2012). The measurement of executive function at age 5: psychometric properties and relationship to academic achievement. Psychological assessment, 24(1), 226–239.

Zelazo, P. D. (2006). The Dimensional Change Card Sort (DCCS): A method of assessing executive function in children. Nature protocols, 1(1), 297-301.

Zelazo, P. D., & Carlson, S. M. (2012). Hot and cool executive function in childhood and adolescence: Development and plasticity. Child development perspectives, 6(4), 354 360.

Arsarthong, P., & Palapol, T. (2022). Development Models to Promote Executive Functions of Early Childhood with Participation of Families and Communities in Roi Et Province. Thai Red Cross Nursing Journal, 15(2), 266-282. (in Thai)

Chularut, P., Aeamtussana, T., & Ayudhaya, P. K. N. (2019). A construction of Executive Function inventory for adolescent students of senior high school level. Suthiparithat, 33(107), 94–110. (in Thai)

Chutabhakdikul, N., Thanasetkorn, P., Lertawasdatrakul, O., & Ruksee, N. (2017). Tools Development and Normative Criteria for Assessment of Executive Function in Early Childhood. Research Center for Neuroscience, Institute of Molecular Biosciences, Mahidol University. (in Thai)

Luechakul, N., Banjong, S., Phangsanga, D. (2022). The Development of Executive Functions Skills of Kindergarten 2/1 Students in Anubansamsen School (The Government Lottery Office Support) by Using Online Role-Play Activities. SSRU Academic Journal of Education, 6(1), 77-86. (in Thai)

Research Institute for Policy Evaluation and Design (RIPED). (2021). Report on project of development database of RIECE Thailand (Thailand early childhood longitudinal data) [Report]. Propose to Equitable Education Fund (EEF). (in Thai)

Research Institute for Policy Evaluation and Design (RIPED). (2022). Report on survey of school readiness status of Thai’ preschool children, phase 5 [Report]. Propose to Equitable Education Fund (EEF). (in Thai)

Saengsawang, T. (2016). Executive Function skills: Measurement model and development guidelines for elementary school students [Doctoral dissertation]. Srinakharinwirot University. (in Thai)

Samanpan, N. (2022). Development of Music Instructional Model For Enhancing Executive Function Skills for Mathayomsuksa 3 Students. Journal of MCU Peace Studies, 10(2), 665-674. (in Thai)

Saripan, S., Phruttikul, S., Sonboon, C. (2021). Effect of the enhancement kindergarteners’ Executive Function by using Plan-Do-Review process based on High/Scope curriculum. Journal of Education Burapha University, 32(3), 56-70. (in Thai)

Sonboon, C. (2021). Effect of learning experience management by implementing MATH-3C learning model on Executive Function skills of kindergarteners. Journal of Education Burapha University, 32(3), 24-40. (in Thai)

Suriyajantratong, S. (2022). Enhancing working memory and social skills of students with autism spectrum disorder through a music based intervention in a parallel classroom [Doctoral dissertation]. Chulalongkorn University. (in Thai)