The Development of an Online Course for Training External Assessors to Evaluate Quality Using Expert Judgment Evaluation

Abstract

The objectives of this study were to 1) synthesize an online course for training external assessors to evaluate quality using expert judgment evaluation, (2) develop the online course for training external assessors to evaluate quality using expert judgment evaluation, and (3) design online systems for training external assessors to evaluate quality using expert judgment evaluation. Samples included educational technology experts and development of information systems experts and persons trained in the 4th External Education Quality Evaluation Program in Higher Education by ONESQA. Samples were selected using multi-stage sampling, select 65 samples. Statistics used in the study comprised mean, standard deviation, t-test, f-test, and Least Significant Difference (LSD).

The results showed that the online course for training external assessors consists of 1) input 2) training processes and 3) output, the evaluation by educational technology and course development experts likewise showed that the target groups have a high overall opinion rating. The evaluation from participants of the 4th External Education Quality Evaluation Program in Higher Education showed that the overall satisfaction level of the target groups was high. The results of the data analysis comparing satisfaction towards the course showed that different working experience duration resulted in different levels of satisfaction towards the course in terms of each section according to the statistical significance level of .05. From the Least Significant Difference (LSD), target groups with 5-7 years and more than 10 years of work experience had different levels of satisfaction towards the course in 3 sections, which included the content and objectives of the courses, learning activities organizing, and pre-test and activity evaluation forms. From the evaluation by experts in design and development of information systems, satisfaction level towards the efficiency of the workflow in terms of user interface and database design was high.