Journal of Educational Measurement Mahasarakham University

Developing a Computerized Adaptive Test to Assess Students' Metacognition in Open and Distance Learning Environment

Anusorn Koedsri , Thanyasinee Laosum — Sat, 30 Dec 2023 00:00:00 +0700

This study assessed the adaptability of the MetaCAT system, which was developed on the Concerto platform for measuring metacognition, in an open and distance learning (ODL) context. In 2022, 70 undergraduate students, each with basic computer skills, from an open university participated in the study.

The findings, based on three indicators, provided evidence of the system's effectiveness in assessing metacognition among students of ODL. The first indicator assessed the relationship between the test taker's ability estimate and the difficulty of the items administered to them. A Pearson's correlation coefficient of 0.70 was obtained, denoting a significant correlation between ability estimates and test difficulty. This result was considered acceptable within the scope of the study. The second indicator evaluated the ratio of the standard deviation of item difficulty to the standard deviation of ability estimates, and was found to be 1.32. This suggests an imbalance in item difficulty parameters. The third indicator, which estimated the reduction in the variance of item difficulty parameters, yielded a value of 0.61. This value, albeit slightly lower than the results of Reckase et al.'s simulation study, still fell within the acceptable levels of fit for the MetaCAT system.

The study demonstrated that MetaCAT has satisfactory adaptability and reliability for measuring metacognition in ODL settings, as supported by indicators 1 and 3. Although minor deviations were observed in indicators 2 and 3, suggesting potential areas for refinement, future research could yield a more precise adaptability assessment by using a larger pool of questions and by increasing the sample size.

Developing a Digital Empathy Scale to Measure and Assess Upper Secondary School Students in the 21St Century: An Application of Item Response Theory

Chuthaphon Masantiah — Sat, 30 Dec 2023 00:00:00 +0700

This research aimed to (1) investigate and synthesize specific models and characteristics of a digital empathy scale to measure and assess upper secondary school students, (2) assess the needs of the specific models and characteristics of the digital empathy scale, and (3) study the psychometric properties of the digital empathy scale through application of the Item Response Theory. The study was divided into 3 stages. Stage 1 dealt with the study and synthesis of the model and characteristics of the digital empathy scale. Data were collected from a literature synthesis and interviews with 5 experts. Data analysis employed content analysis. Stage 2 dealt with assessment of needs of the models and characteristics of the digital empathy scale. The target group comprised 143 teachers and 755 students, totaling 898). A need assessment form was used in collecting the data and the modified Priority Needs Index (PNI) was used in prioritizing the needs. Stage 3 dealt with the study on psychometric properties of the digital empathy scale. The target group comprised 755 students. The digital empathy scale was used in collecting the data and the Grade Response Model (GRM) was used in analyzing the psychometric properties, namely: (1) content validity, (2) reliability, (3) item information function, (4) test information function, (5) slope, and (6) threshold, using the MULTILOG 7.03 program.
The findings revealed that:
1) The digital empathy comprised 5 components, namely: posting, sharing, commenting, responsive reactions, and other forms of assistance. The majority of the measure's format and specific characteristics were multiple-choice with multiple scoring.
2) Regarding the needs of the specific models and characteristics of the digital empathy scale, it was found that (1) the rating scale ranked first (PNI_modified = 0.154), (2) the scale with no more than 20 items ranked first, (PNI_modified = 0.150, and (3) the online format of scale ranked first (PNI_modified = 0.144).
3) The psychometric properties of the 20-item digital empathy scale, on the whole, met the criteria, with content validity from Index of Item Objective Congruence (IOC) ranging from 0.67-1.00, total reliability of 0.922, item information function values ranging from 0.196 to 15.097 at ability (θ) ranging from -2.20 to 1.40, test information function value of 76.384 at ability (θ) -0.40, slope ranging from 0.87 to 7.72, and threshold values β₁(SE) ranging from -3.37 to -0.77 and β₂(SE) ranging from -0.41 to 1.63.

Construction of Basic Scientific Process Skills Test of Grade 1 Students

Natapon Youpensuk, Narumon Laiprasertporn — Sat, 30 Dec 2023 00:00:00 +0700

The purposes of this research were 1) to develop a basic scientific process skills test that was consistent with the indicative behavior of scientific process skills, and 2) to analyze the quality of the basic scientific process skills test, which comprises item difficulty, item discrimination and reliability of the basic science process skills test. The sample comprised 42 grade 1 students of Hiranrat Phakdi Wittaya School in Nonthaburi Province, obtained through purposive sampling. The instrument was a 3-choice basic science process skills test. The data analysis followed the item analysis method according to classical test theories, by using Kuder-Richardson Method (KR20), to find content validity, item difficulty, item discrimination and reliability.
The results were as follows: The 22 items of the basic science process skills test had the index of consistency (IOC) with the indicative behavior of scientific process skills between 0.67 to 1.00, assessed by 3 experts in science education and primary education. Then, the test was tried out with the target group. The tryout yielded the item difficulty ranging from 0.20 to 0.80, item discrimination ranging from 0.20 to 0.60 and the total reliability was 0.78, which was in the high level. So, the test could be used to measure basic science process skills of grade 1 students.

Factor Analysis of Writing Ability of Upper Secondary School Students under Chiang Mai Secondary Education Service Area Office

Nathasakti Siriniyomchai, Sunee Nguenyuang — Sat, 30 Dec 2023 00:00:00 +0700

The purpose of this research was to analyze the factors of writing ability of upper secondary school students under Chiang Mai Secondary Education Service Area Office. The sample consisted of 860 upper secondary school students form 5 schools under Chiang Mai Secondary Education Service Area Office, obtained through Multi-Stage Random Sampling. The research tool used to collect the data was a writing ability test, which was a subjective test. Scoring followed the writing ability assessment criteria in all of the 5 components. The data analysis employed descriptive statistics analysis, Pearson’s Correlation Coefficient and a Confirmatory Factor Analysis using Mplus 7.4 Program.
The results of the research revealed that the writing ability of the upper secondary school students under Chiang Mai Secondary Education Service Area Office consisted of 5 components: (1) content presentation, (2) story composition, (3) vocabulary usage, (4) language usage, and (5) language mechanism. Also, the results of the consistency examination of the model for measuring the writing ability of the upper secondary school students showed that the model was consistent with the empirical data when the Chi-square value () = 66.046 at degree of freedom (df) = 61, Significance level = 0.307, Comparative fit index (CFI) = 0.984, Tucker-Lewis Index (TLI) = 0.980, Root Mean Square Error of Approximation (RMSEA) = 0.010, Standardized Root Mean Square Residual (SRMR) = 0.025. The factor with the highest factor loading was the content presentation (0.828, R²=0.686), followed by the language usage (0.569, R²=0.324), the language mechanism (0.555, R²=0.308), the story composition (0.519, R²=0.269) and the vocabulary usage (0.248, R²=0.062), respectively.

The Development of System and Mechanisms Supporting the Internal Evaluation Implementation for the Administration Practice of Health Promotion Programs for the Specific Populations

Sat, 30 Dec 2023 00:00:00 +0700

Monitoring and evaluation (M&E) is a significant tool in providing effective project management. This action research aimed (1) to develop monitoring and evaluation capacity development of evaluators, project directors, and stakeholders of Health Promotion Programs for specific populations and (2) to develop the system and mechanisms supporting the monitoring and internal evaluation for projects under the Health Promotion Programs for specific populations. The study was divided into three phases. Phase I, pre-training, eleven projects under the Health Promotion Programs for the Specific Populations in the fiscal year B.E. 2563–2564 were selected, a total of 49 participants were recruited, which composed of evaluators, project directors, and stakeholders. Phase II, monitoring and evaluation capacity development trainings, the trainings comprised of four modules. The research instruments used were: (1) trainee satisfaction questionnaire, (2) trainee learning outcomes questionnaire, (3) individual abilities evaluation form, and (4) group abilities evaluation form. Data were analyzed using descriptive statistics. Phase III, post-training, a total of three online focus groups were conducted with 24 participants, where each focus group composed of evaluators and project directors. Focus group interview guides were used and the data were analyzed using content analysis, classifying codes into themes, and interpreting the data. The results showed that trainees’ knowledge scores after received the training in monitoring and evaluation were increased for all contents. The criteria for acceptable good ability were 80% or higher. Thirty-seven trainees (76.40%) had good abilities regarding to individual abilities, and in terms of group abilities, seven projects (63.63%) had good abilities. Moreover, the developed system and mechanisms supporting monitoring and internal evaluation should consist of five mechanisms: (1) recruiting projects and trainees, (2) offering learning resources, (3) creating a group chat, (4) providing coach for each project, and (5) conducting site visits. Focusing in the ability of practitioner evaluators, change in project management, and installing the system of monitoring and internal evaluation can lead to imperative changes in system and mechanisms supporting the monitoring and internal evaluation.

Development of Learning Activities in Biology that Promote a Growth Mindset and Learning Achievement for Grade 10 Students

Nurhidayah Kahong, Tatsirin Sawangboon — Sat, 30 Dec 2023 00:00:00 +0700

This research aimed 1) to develop learning activities in biology that promote a growth mindset and learning achievement for Grade 10 students, 2) to compare the growth mindsets and the learning achievements of students taught with learning activities that promote growth mindset and learning achievement and students who received traditional teaching. The qualitative sample obtained from purposive sampling consisted of 3 growth mindset experts. The quantitative sample consisted of 2 groups of grade 10 students who studied in the academic year 2021 in Cha-uat School, obtained from cluster random sampling. Using simple random sampling, one group of 30 students became the experimental group and the other, with 32 students, was the control group. The experimental group was instructed with the activities that aimed to promote a growth mindset and learning achievement, while the control group received a traditional instruction. The research tools included 1) 5 lesson plans to promote the growth mindset and learning achievement and another 5 lesson plans following traditional instruction; 2) a learning achievement test containing 30 items, having the item discrimination from 0.22 to 0.73 and the total reliability of 0.91; 3) a checklist to measure the growth mindset containing 30 items, having the discrimination from 0.34 to 0.74 and the total reliability of 0.92; The analysis of data employed the mean, standard deviation and Hotelling T².
The results of the study were as follows: 1) the learning activities in biology that promote a growth mindset and learning achievement consisted of 4 steps: ensuring that intelligence is changeable; participatory quest, summarizing and reflection on learning outcomes; 2) the students instructed with learning activities aiming to promote a growth mindset and learning achievement had their growth mindset and learning achievement higher than the students who received traditional instruction, with statistical significance at the .05 level. Therefore, it can be seen that the four-step learning management that had been developed could practically promote students’ growth mindset and learning achievement.

Administrator’s Competencies in the New Normal Affecting Effectiveness of the Schools under the Office of Mukdahan Primary Education Service Area

Phansupa Khonklong, Pataravoot Vatanasapt , Saowanee Sirisooksilp — Sat, 30 Dec 2023 00:00:00 +0700

The objectives of this research were to 1) study the level of administrator’s competencies in the new normal and the level of school effectiveness, 2) study the administrator’s competencies in the new normal affecting school effectiveness, 3) study guidelines for development of administrator’s competencies in the new normal affecting effectiveness of the schools under the Office of Mukdahan Primary Education Service Area. The research design was the mixed methods research: explanatory design. The first phase used a quantitative method. The sample comprised administrators and teachers, totaling 368. The research instrument was a 5-point rating scale questionnaire. Data analysis employed multiple regression analysis. The second phase used a qualitative method. The research instrument was a structured interview. The target group was purposively sampled. Data analysis employed content analysis. The research results were summarized as follows:
1. The administrator’s competencies in the new normal, as a whole, was in the high level. The aspect with the highest mean score was the flexibility and adaptation to the situation Regarding the school effectiveness, it was found that, as a whole, the school effectiveness was in the high level. The aspect with the highest mean score was the school's adaptability.
2. The 2 aspects of administrator’s competencies in the new normal affecting school effectiveness under the Office of Mukdahan Primary Education Service Area were change agent and management, with the multiple correlation coefficient of 0.741 and the regression coefficient or predictive power of 54.90 percent, with statistical significance at the .01 level.
3. The guidelines for development of administrator’s competencies in the new normal affecting school effectiveness under the Office of Mukdahan Primary Education Service Area consisted of 5 aspects: 1) Regarding change agent, the administrator should inspire the colleagues, develop the abilities of the colleagues to a higher level and have greater potential to lead the organization to change; 2) Regarding management, there should be planning for problem-solving. Tasks should be assigned to relevant persons appropriately; 3) Regarding working together with others, good relationships with colleagues should be built and maintained. The administrator should adapt himself to the situation; 4) Regarding flexibility and adaptability to situations, the administrator should be flexible in working and adaptive for the roles and duties; 5) Regarding self-development, the administrator should develop his own knowledge and abilities, open his mind to learning new things and new technologies and keep up with the changing situation.

Exploratory Factor Analysis of Self-Efficacy in English Reading of Tertiary Education Students

Patsawut Sukserm, Chuthaphon Masantiah, Juthamas Saengngam — Sat, 30 Dec 2023 00:00:00 +0700

The purpose of this research was to investigate the exploratory factors of self-efficacy in English reading of tertiary education students. The sample used in this study consisted of 520 first-year tertiary education students of a public university in Bangkok, selected by simple random sampling. The research instrument was a questionnaire on self-efficacy in English reading, with a 25-item rating scale. The index of item congruence (IOC) ranged from 0.67 to 1.00, and the reliability was .897. The data were analyzed using descriptive statistics, exploratory component analysis by principal component analysis (PCA) and orthogonal rotation by Varimax method. The results showed that the self-efficacy in English reading of the tertiary education students consisted of 6 components, namely: 1) recognition of content elements, 2) assessment of content, 3) summary of content, 4) opinion on content, 5) comprehension of content, and 6) reading strategy on content, with an eigenvalue ranging from 1.016 to 7.895. These components could explain the cumulative variance for 60.461%.

The Structural Equation Modeling of Administrator’s Competencies in the New Normal Affecting the Quality of the Schools under the Offices of Secondary Education Service Area of the ROI KAEN SARA SIN Provincial Group

Pornsuda Lakkam, Saowanee Sirisooksilp — Sat, 30 Dec 2023 00:00:00 +0700

The objectives of this research were to 1) study the level of administrator’s competencies in the new normal and quality schools; 2) develop and verify the consistency of the structural equation model of administrators' competencies in the new normal that affect quality schools; and 3) study guidelines on development of administrators' competencies in the new normal that affect quality schools under the Offices of Secondary Education Service Area in the Roi Kaen Sara Sin Provincial Group. The research employed the mixed methods research: explanatory design. Phase 1 used the quantitative method. The sample of 440 school administrators and teachers was obtained through two-stage random sampling. The research tool was a 5-point rating scale questionnaire. Data were analyzed using mean, standard deviation, and the analysis of the structural equation model (SEM). Phase 2 used the qualitative method. The research tool was a structured interview. The target group was purposively sampled. Data were analyzed by using content analysis.
The results of the research revealed that: 1) The performance of the administrators in the new normal, on the whole, was at a high level (M = 4.41, SD = 0.40). The level of the quality schools, on the whole, was at a highest level (M = 4.58, SD = 0.25); 2) 2) The structural equation model of the administrator's competencies in the new normal affecting the quality schools was consistent with the empirical data. The performance of the administrators in the new normal had a positive direct influence on the quality schools. The total effect size was 0.774, with statistical significance at the .01 level. The variables of the administrator's competencies in the new normal could explain the variance of the quality schools for 60.0 percent, and 3) the approaches for developing the administrator's competencies in the new normal that affect the quality schools consist of 5 aspects: 1. Regarding change management, the administrator should lead schools and personnel to be ready for the changes that occur in the new normal; 2) Regarding adaptability and flexibility, the administrator should be adaptable and flexible in managing the organization; 3) On the aspect of building a team that is united in action and spirit, the administrator should promote the creation of diverse teams; 4) Regarding creative communication, the administrator should develop communication and negotiation skills to appropriately reduce conflicts that may arise in the new normal; and 5) Regarding digital technology literacy, the administrator should be a good role model in using digital technology in management.

A Model of Disruptive Leadership Development of School Administrators under Khon Kaen Primary Education Service Area Office 4

Yolradee Yutthasaen, Parnpitcha Kanjug — Sat, 30 Dec 2023 00:00:00 +0700

The purposes of the research were 1) to examine the consistency of the component model of disruptive leadership of school administrators under Khon Kaen Primary Education Service Area Office 4 with empirical data, and 2) to construct and evaluate a model of the disruptive leadership of school administrators under Khon Kaen Primary Education Service Area Office 4, in terms of suitability, possibility, and utility. Utilizing the mixed-methods research, the research was divided into 2 phases. Phase 1 used the quantitative research. The sample comprised 400 school administrators and teachers under Khon Kaen Primary Education Service Area Office 4. The instrument was a 5-point rating scale questionnaire, having the reliability of 0.805. The Mplus7.0 program was used to analyze the data in the confirmatory factor analysis and to examine the consistency between the model and the empirical data. Chi- square () was used to examine the hypothesis. Phase 2 used the qualitative research. The results of the study in Phase 1 were used to build a draft model. Then 5 experts were interviewed in order to examine and confirm the model, and 7 experts evaluated the model.
The research results were as follows: 1) The model for developing disruptive leadership of school administrators under Khon Kaen Primary Education Service Area Office 4, which was developed by the author, was consistent with the empirical data, as = 78.022, df = 64, /df =1.219, P-Value = 0.111, RMSEA = 0.023, SRMR = 0.027, CFI = 0.994, TLI = 0.991. The component with the highest component weight was the adaptability, followed by the digital technology adaptation, and the lowest was the networking and cooperation. 2) The model for developing disruptive leadership of school administrators under Khon Kaen Primary Education Service Area Office 4 was composed of the model’s name, principles and concepts, objectives, goals, and guidelines. The results showed that the suitability, the possibility, and the utility were at the highest level.

Causal Relationship Model Influencing Work Engagement of Teachers in Learning Management in Small-sized Schools in the Northeastern Region

Venus Paknara — Sat, 30 Dec 2023 00:00:00 +0700

The objectives of this research were 1) to study the state of problems in learning management and teachers’ solutions in small-sized schools in the Northeastern Region, 2) to study the teachers’ perception of self-efficacy in learning management, expectations for learning management outcomes, and teachers’ engagement in learning management in small-sized schools in the Northeastern Region, and 3) to develop a causal relationship model influencing work engagement of teachers in learning management and validate it with the empirical data. The sample consisted of 540 teachers in small-sized primary schools in the Northeastern Region, obtained by using multi-stage sampling. The research instruments comprised a questionnaire, having the IOC ranging from 0.80 - 1.00. The research was divided into 4 parts: Part 1— Basic Information, Part 2—State of problems in learning management and solutions, Part 3—Training needs for development towards solving problems, and Part 4—Assessment which consisted of 1) a perception assessment form for self-efficacy in learning management, with r ranging from 0.73 - 0.91 and α = 0.95, 2) an assessment form for expectation of learning management outcomes with, r ranging from 0.68 - 0.89 and α = 0.94, and 3) an assessment form for teachers’ engagement in learning management, with r ranging from 0.73 - 0.96 and α = 0.93. The statistics used in this research were frequency, percentage, mean, and SD, and analysis of causal relationship model.
The findings were as follows:
1. The state of problems in learning management, as a whole, was at the high level (M = 4.35, SD= 0.49). Most teachers solved the problems by using DLTV. And their training needs for development towards solving problems was at the high level (M = 4.27, SD = 0.74).
2. The teachers’ perception of self-efficacy in learning management was at the high level (M = 3.86, SD= 0.69), the expectation for learning management was at the high level (M= 4.13, SD= 0.64), and the teacher’s engagement in learning management was at the high level (M = 4.10, SD= 0.62).
3. The developed causal relationship model was consistent with the empirical data, as = 3.37, df = 3, /df = 1.12, p-value = 0.33, GFI = 0.99, AGFI = 0.97, NFI = 0.99, TLI = 0.99, CFI = 1.00, RMSEA = 0.01, and RMR = 0.01. The perception of self-efficacy in learning management had positive direct and indirect influences on the teacher’s engagement in learning management, transmitted through the expectation for learning management outcomes, that together defined the variance in teacher’s engagement in learning management for 71.20 percent.

Approaches for Enhancing the Utilization of Assessment, Accreditation and Educational Quality Assurance Results to Improve the Educational Quality of Higher Education

Siwaporn Phupan, Boonrat Plangsorn, Jomtup Khwanrat, Wichuda Kijtorntham — Sat, 30 Dec 2023 00:00:00 +0700

The purposes of this study were (1) to study the state of utilization of assessment, accreditation and educational quality assurance results to improve the educational quality of higher education and (2) to study approaches for enhancing the utilization of assessment, accreditation and educational quality assurance results to improve the educational quality of higher education. This study was a mixed-methods research that employed an explanatory sequential design. The study was conducted in two phases. Phase 1 dealt with quantitative study. The research sample comprised 16 universities under the Ministry of Higher Education, Science, Research and Innovation. The research instrument was a questionnaire. Data analysis employed descriptive statistics (i.e. the mean, standard deviation). Phase 2 dealt with qualitative study, the key informants consisted of university/faculty administrators and faculty members responsible for the curriculum, totaling 20. The data were collected by using focus group interview. The qualitative data were analyzed using content analysis and analytic induction.
The research findings were as follows:
1. On the whole, the level of utilization of the internal assessment, accreditation and educational quality assurance results to improve the educational quality of higher education was at the high level (M = 4.03, SD = 0.59). And also, the level of utilization of the external assessment, accreditation and educational quality assurance results to improve the educational quality of higher education as perceived by the university faculty members was at the high level (M = 3.75, SD = 0.69).
2. The approaches for enhancing the utilization of assessment, accreditation and educational quality assurance results to improve the educational quality of higher education comprised 7 approaches which were (1) organizing the system of monitoring and evaluation of quality development based on the university standards, (2) building the quality culture, (3) creating the cognizance of educational quality assessment system for university/faculty administrators and university faculty members, (4) fulfilling the knowledge, experience, and expertise in educational quality assessment system for university/faculty administrators and university faculty members, (5) communicating the evaluation results to stakeholders, (6) developing academic mechanisms for the operation of educational quality assessment, and (7) developing information system for the operation of educational quality assessment.

Developing a Self-learning Model Using Mind Map to Enhance Academic Achievement of Middle-aged and Elderly Undergraduate Students in the Distance Education System of Sukhothai Thammathirat Open University

Somkiat Kaewkohsaba, Sirirut Jumnaksarn — Sat, 30 Dec 2023 00:00:00 +0700

The purpose of this research was to develop and evaluate the learning model experiment by using a mind map to enhance the academic achievement of middle-aged and elderly undergraduate students in the distance education system of Sukhothai Thammathirat Open University. Phase 1 dealt with development of the self-learning model. The sample consisted of 385 students. Data were collected through online surveys. Phase 2 dealt with the experimental research with a sample comprising 70 students. The analysis of data employed descriptive and inference statistics.
The research findings were as follows: 1. The self-learning model’s activities consisted of 6 steps: 1) screening target groups, 2) measuring and evaluating previous knowledge, 3) adding new knowledge, 4) learning and doing, 5) measuring learning development, and 6) learning evaluation. The item content validity index (I-CVI) was in the range of .89 – 1.00 and the scale content validity index (S-CVI) was .97, meaning that the model had suitability for further use. 2. The results of the learning model experiment revealed that 2.1 The students in the experimental group had higher learning achievement and mind mapping ability after the experiment than before the experiment, and higher than the control group, with statistical significance at the .05 level; 2.2 students with different disciplines and learning styles had no differences in learning achievement and mind mapping ability.

An Instructional Model to Enhance Critical Problem-Solving Abilities and Analytical Thinking in Science Course for Grade 6 Students

Supawadee Kanjanakate, Nirat Jantharajit, Phichittra Thongpanit — Sat, 30 Dec 2023 00:00:00 +0700

The purposes of this research were 1) to develop an instructional model to enhance critical problem-solving abilities and analytical thinking of grade 6 students, 2) to try out the prototype instructional model to enhance critical problem-solving abilities and analytical thinking of grade 6 students, based on inquiry-based learning, reasoning approach and the constructivist theory. The research employed the research and development approach, in the contexts of 4 schools under Muang Nakhon Phanom Municipality, Nakhon Phanom Province, in the academic year 2021. The target group consisted of 4 science teachers and 215 grade 6 students. The research process was divided into 2 phases. The first phase dealt with development of the instructional model. In this phase, 4 teachers and 12 grade 6 students were interviewed, and the learning behaviours in science of 4 groups of students, purposively sampled, were observed. And also, the prototype of the instructional model was brought into a group discussion under connoisseurship of 5 experts. The second phase dealt with the tryout of the prototype of the instructional model with 37 students of the target group in Tessaban 4 (Rattanakosin 200 years) School, which was selected by purposive sampling. The research instruments were composed of the prototype of the instructional model, learning management plans, an assessment form for critical problem-solving abilities, and analytical thinking assessment form. Data analysis employed percentage, mean, standard deviation, and descriptive analysis for presentation of qualitative data.
The research results revealed that:
1. The development of the instructional model to enhance critical problem-solving abilities and analytical thinking of grade 6 students, based on contextual information of the needs of teachers, included drafting the prototype of the instructional model, based on inquiry-based learning, reasoning approach and constructivist theory. The instructional model was composed of: 1) principles, concepts and basic theories, 2) objectives of the model, 3) process of learning management, 4) social factors and responsive behavior, 5) supporting factors and learning sources, and 6) evaluation. The assessment results of the quality and appropriateness of the instructional model, on the whole, was at a high level ( = 4.34, S.D.=0.23).
2. The results of the tryout of the prototype of the instructional model revealed that the students in the experimental group had their abilities in critical problem-solving abilities and analytical thinking of 69.98% ( = 31.49, S.D.=1.46) and 66.83% ( = 20.05, S.D.=2.36) respectively.

Factors Affecting Self-discipline of Vocational Certificate Students of Satuk Industrial and Community Education College, Buriram Province

Suvijak Jansamran, Piyatida Panya — Sat, 30 Dec 2023 00:00:00 +0700

The objectives of this research were to 1) study the factors affecting the vocational certificate students' self-discipline; 2) study the relationship between the factors affecting the students' self-discipline; 3) construct predictive equations for the factors affecting the students' self-discipline. The sample consisted of 360 vocational certificate students of Satuk Industrial and Community Education College, obtained through proportional stratified random sampling. The research tool was a questionnaire on students' self-discipline. The statistics used to analyze the data were percentage, mean, standard deviation, Pearson correlation coefficient and multiple regression analysis by stepwise method. The results showed that:
1. The factors affecting the vocational certificate students' self-discipline with the highest effect, which was at a high level, was the teacher's behavior ( = 4.43, S.D. = .58), followed by the relationship between students and teachers ( = 4.42, S.D. = .58), which was at a high level, and the factor affecting the self-discipline least, which was at a high level, was the self-discipline ( = 4.11, S.D. = .58).
2. The relationship between the factors and self-discipline had the values of .456 and .848, which were positively correlated at rather high levels, with statistical significance at the .01 level.
3. The predictive equations for the factors affecting the students' self-discipline are as follows:
The predictive equation in raw score was:
Y' = .258 + .181X₃ + .252X₆ + .129X₂ + .167X₁+ .177X₄
The predictive equation in standard score was:
Z_Y' = .189ZX₃ + .294ZX₆ + .129ZX₂ + .171ZX₁ + .189ZX₄

Needs Assessment for Digital Assessment Literacy of the Elementary School Teachers of Watthatthong School under Vadhana District Office, Bangkok

Oraphin Ketsrirat, Chuthaphon Masantiah, Darunee Tippayakulpairoj — Sat, 30 Dec 2023 00:00:00 +0700

The objectives of this study were to (1) analyze and rank the needs for digital assessment literacy of the elementary school teachers’ of Watthatthong School, under Vadhana District Office, Bangkok, and (2) compare the needs for digital assessment literacy of the teachers of the same school but with different backgrounds. The population consisted of 42 teachers of Watthatthong School under Vadhana District Office, Bangkok. The tool was a 5-point rating scale questionnaire. The statistics employed in the analysis of data were descriptive statistics: frequency, percentage, mean and standard deviation. The modified priority needs index (PNI_modified ) was also used.
The results were as follows:
1. The findings revealed that the needs for digital assessment literacy of the teachers of Watthatthong School under Vadhana District Office, Bangkok, were at the highest level, and the current state of the teachers' collective digital assessment literacy was at the high level. When the teachers' digital assessment literacy needs were classified into 3 steps, they were: (1) basic digital assessment literacy (PNI_modified = 0.33); (2) intermediate digital assessment literacy (PNI_modified = 0.29) and (3) advanced digital assessment literacy (PNI_modified= 0.27)
2. Teachers with different backgrounds needed different digital assessment literacy as follows: (1) The teachers with master's degrees had their priority need index higher than the teachers with Bachelor's degrees or graduate diplomas; and (2) Teachers with 11 years, or more, of experience had their priority need index higher than the teachers with 1-10 years of experience.

Construction of Item Bank in Mathematics for Fourth Grade Students: An Application of One-Parameter Item Response Theory

Aunshisa Daochay, Chuthaphon Masantiah, Darunee Tippayakulpairoj — Sat, 30 Dec 2023 00:00:00 +0700

The objectives of this research were to 1) study the needs of mathematics teachers for constructing an item bank in mathematics, on the topic of decimal, for fourth grade students, and 2) construct an item bank in mathematics, on the topic of decimal, for fourth grade students, classified according to the level of difficulty and level of cognitive domain.
The sample consisted of 18 mathematics teachers and 281 fourth grade students. The research tools were a questionnaire and mathematics tests on decimals for fourth grade students. Data were analyzed by using frequency, percentage, difficulty, item information function, test information function and reliability, using an application of one-parameter item response theory.
The research results were as follows:
1. Regarding the results of the study on needs of mathematics teachers for constructing an item bank in mathematics, on the topic of decimal, for fourth grade students, it was found that what the teachers needed most were 3 tests with 10-20 questions, both objective and subjective. Meanwhile, the cognitive learning behavior most needed was analysis.
2. Regarding the results of constructing the item bank in mathematics, on the topic of decimal, for fourth grade students, there were 3 tests in the item bank. Each test consisted of 30 items. They were both objective and subjective tests. The results of the analysis of the psychometric properties of the test and the questionnaire showed that all of the items passed the difficulty criteria. In terms of item information function and test information function, most of them gave high information when tested on people with moderate to low abilities. The reliability of all the 3 tests were in the range of 0.906 to 0.917. The tests were stored in Google Drive format.

Development of the Performance Evaluation Model for Probation Office, Department of Probation, Ministry of Justice

Asayaporn Suvannagoot, Paisarn Worakham, Piyatida Panya — Sat, 30 Dec 2023 00:00:00 +0700

The objectives of this research were 1) to develop a performance evaluation model and find its quality, for the Probation Office, Department of Probation, Ministry of Justice; 2) to try out the performance evaluation model that had been developed; 3) to evaluate the performance evaluation model. The researcher conducted the research according to the research and development process and applied the EDFR technique to examine the propriety and feasibility of the performance evaluation model. The tools used for data collection were interview forms and questionnaires. Data were analyzed by content analysis, mean, standard deviation, median, inter-quartile range and Pearson’s product-moment correlation coefficient.
The research results were as follows: The performance evaluation model for Probation Office, Department of Probation, Ministry of Justice, had 6 main components; there were 3 evaluation objectives, 10 components of the evaluation-focused aspects, 167 indicators, 7 groups of evaluators, 3 evaluation methods, 4 levels of evaluation criteria, and 3 methods of providing feedback. On the whole, the model had the propriety and feasibility at the highest level ( = 4.56, S.D. = 0.45). The reliability of evaluation results, by switching evaluator groups, the reliability of the test-retest technique was obtained. There was a statistically significant positive correlation at the level of .01. The correlation coefficient was .947. And the results of the performance evaluation model for Probation Office, Department of Probation, Ministry of Justice from the evaluator groups, on the whole, yielded propriety, feasibility, utility and overall accuracy at a high level ( = 4.44, S.D. = 0.85).

Data analysis in Generalizability Theory: An Application of Online R Complier

Sat, 30 Dec 2023 00:00:00 +0700

Generalizability Theory, also known as G-Theory, is a theory used to analyze the reliability of measurement results in various measurement scenarios. It aims to assess the trustworthiness of measurement outcomes when using instruments to evaluate their reliability. The theory can determine the reliability of measurement results in two ways: the relative trustworthiness of scores for making comparative interpretations among individuals, and the absolute trustworthiness of scores by comparing them against standard criteria through G-Study and D-Study. Typically, the analysis is performed offline using specialized
software installed on a computer. Therefore, this article presents an online analysis approach using the Posit Cloud application, an online R compiler. It covers the basics of analysis commands and guidelines for reporting analysis results, which can be helpful for analyzing educational measurement and evaluation outcomes, assessing performance skills, or other related assessments.

Measurement and Evaluation Guidelines to Promote Employee Engagement

Ujsara Prasertsin, Pattama Roopsuwankun, Kamontip Srihaset , Varunya Rumsaeng — Sat, 30 Dec 2023 00:00:00 +0700

Employee engagement is the attitude of the personnel in the organization that expresses thoughts, feelings, perceptions, and learning about a job or organization, which leads to a relationship and satisfaction of the personnel with their organization. Employee engagement theories are psychological and behavioral theories that explain how human behavior is generated as well as the motivations that trigger such behaviors. Employee engagement theories consist of content theories, process theories, and reinforcement theories. Therefore, the promotion of employee’s organizational engagement depends on data measurement of employee engagement in the organization, which can be measured from factors that affect employee engagement, consisting of clear visions and management policies, stable organizational goals and employee participation, appropriate remuneration and welfare to create motivation to work, environmental management or a comfortable working atmosphere, creating stability and career advancement opportunities so that employees feel challenged and eager to accomplish their work. Communication within the organization which creates understanding among employees in the same direction to reduce conflicts, increase flexibility in working, as well as listening to opinions of employees at all levels. Along with adjusting the way of working according to the situation to reduce stress and pressure in the work of employees.