Multilevel Construct Validity of the Personnel Administration Subscale of the Internal Integrity and Transparency Assessment
Article Sidebar
Main Article Content
Abstract
The purpose of this study was to provide construct validity evidence for item Q26 in the personnel administration subscale of the Internal Integrity and Transparency Assessment (IIT). The data were obtained from 3,040 internal respondents across 105 local government organizations in Phitsanulok and Phichit provinces. Ten items of the personnel administration subscale were analyzed, yielding a Cronbach’s alpha coefficient of 0.794. Multilevel confirmatory factor analysis (MCFA) was employed to examine the factor structure at the individual and organizational levels. The results indicated that item Q26 exhibited negative and low factor loadings across all analytical models, including the single-level model and both within-level and between-level models. In contrast, the remaining nine items demonstrated positive and substantial factor loadings. Furthermore, factor loadings in the between-level model were consistently higher than those in the within-level and single-level models. These findings suggest that including item Q26 with the other items may lead to negative distortion in the interpretation of organizational performance outcomes, indicating that Q26 may not be an appropriate indicator of the personnel administration construct.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
The content and information contained in the published article in the Journal of Educational Measurement Mahasarakham University represent the opinions and responsibilities of the authors directly. The editorial board of the journal is not necessarily in agreement with or responsible for any of the content.
The articles, data, content, images, etc. that have been published in the Journal of Educational Measurement Mahasarakham University are copyrighted by the journal. If any individual or organization wishes to reproduce or perform any actions involving the entirety or any part of the content, they must obtain written permission from the Journal of Educational Measurement Mahasarakham University.
References
Bollen, K. A. (1984). Multiple indicators: Internal consistency or no necessary relationship? Quality & Quantity, 18(4), 377–385. https://doi.org/10.1007/BF00227593
Comrey, A. L., & Lee, H. B. (1992). A first course in factor analysis (2nd ed.). Lawrence Erlbaum Associates.
Dyer, N. G., Hanges, P. J., & Hall, R. J. (2005). Applying multilevel confirmatory factor analysis techniques to the study of leadership. The Leadership Quarterly, 16, 149–167.
Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2022). A Primer on Partial Least Squares Structural Equation Modeling (PLS-SEM) (3rd ed.). SAGE.
Hu, L., & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3, 424–453.
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55.
Kline, R. B. (2016). Principles and practice of structural equation modeling (4th ed.). The Guilford Press.
Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Addison-Wesley.
Merkle, E. C., You, D., & Preacher, K. J. (2016). Testing non-nested structural equation models. Psychological Methods, 21(2), 151–163. https://doi.org/10.1037/met0000038
Muthen, B. O. (1994). Multilevel covariance structure analysis. Sociological Methods & Research, 22(3), 376–398.
Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (5th ed.). Pearson.
van de Vijver, F. J. R. (2011). Capturing bias in structural equation modeling. In M. Davidov, P. Schmidt, & J. Billiet (Eds.), Cross-cultural analysis: Methods and applications (pp. 3–34). Routledge.
Lakpetch, P. (2014). Multilevel confirmatory factor analysis of the five forces model in the hotel industry of Thailand for the ASEAN Economic Community. Journal of Research Methodology, 27(3), 281–301. (in Thai)
Moonmuang, S. (2014). Applying multilevel confirmatory factor analysis techniques to the study of school principals’ academic leadership. Academic Journal of Bangkok Thonburi University, 2(2), 24–35. (in Thai)
Office of Public Sector Anti-Corruption Commission (PACC). (2016). Integrity and transparency assessment manual. https://www.pacc.go.th/pacc_2015/uploads/files/pap/07042015/07042015e%20.pdf (in Thai)
Office of the National Anti-Corruption Commission (NACC). (2016). Integrity and transparency assessment background. http://www.nacc.go.th/ewt_news.php?nid=10564 (in Thai)
Office of the National Anti-Corruption Commission (NACC). (2024). Integrity and transparency assessment manual 2024. Office of the National Anti-Corruption Commission. (in Thai)
