Meta-evaluation of Final Evaluation Reports by Save the Children Australia

Abstract

This research aims to evaluate the quality of final project evaluation reports produced by Save the Children Australia using the principles of meta-evaluation. It employs a documentary research approach, assessing 14 final evaluation reports prepared by Save the Children Australia between 2015 and 2023. The primary data collection tool was a meta-evaluation checklist, and the collected data were analyzed using descriptive statistical methods with the software Jamovi. The findings indicate that the 14 final evaluation reports produced by Save the Children Australia were generally designed with a systematic evaluation methodology. Most reports employed a mixed-methods approach and clearly specified the evaluation objectives, indicators, and data analysis procedures. When assessed against Stufflebeam’s meta-evaluation standards, most of the reports demonstrated very good quality in terms of utility, feasibility, and propriety. However, the accuracy standard showed considerable variation in scores, particularly regarding the meta-evaluation component, which was rarely included in the reports. This suggests opportunities for improving the quality and completeness of evaluation reports in the future.