Assessment of performance of monitoring and evaluation systems at CARITA Torit in South Sudan

Abstract

Monitoring and Evaluation of projects is usually one of the ingredients of good project performance. It provides means of accountability, demonstrating transparency to the Stakeholders and facilitates, organizational learning through documenting lessons learned in implementation of the projects and incorporating the same in the subsequent project planning and implementation or through sharing experience with other implementers. The main objective of this thesis was to assess Performance of Monitoring & Evaluation systems at Caritas Torit in South Sudan. The study concentrated on the four parameters: The Tools and Methods used in M&E systems at Caritas Torit,in South Sudan, the management influence on M&E systems at Caritas Torit in South Sudan, the relationship between training of M&E employees and performance and stakeholders involvement. The study focus was concentrated at Torit County, located in Eastern Equatorial State, in southern South Sudan, 150 kilometers drive by road east of the capital city Juba. The target population for the study was 1,464 people living in Torit County. Descriptive Survey design was used with a sample size of 146, where a purposive sampling procedure was applied to select 146 respondents. Primary data was collected using questionnaires interview guides and focus group discussions while secondary data entailed the use of document analysis. Quantitative data was analyzed using descriptive statistics whereas qualitative data was analyzed using content analysis. Qualitative data was transformed into quantitative and analyzed with the helped of SPSS. A Cronbach alpha test was conducted to measure the internal consistency and reliability of the data collection instruments and was found out to be 0.76 meaning the instruments were reliable. Collected data was edited, sorted, cleaned and coded for data analysis. The findings were presented using percentages and frequencies, tables, pie charts and bar graphs. On the basis of findings, the researcher concluded that Caritas Torit used tools to evaluate M & E systems, namely; Cost Benefit and Cost Effectiveness analyses, logical framework approach, Theory-based evaluation, public expenditure tracking and impact evaluation were the tools and methods used to monitor and evaluate Caritas projects. The researcher affirmed that management influenced performance of M & E systems through designing objectives, planning of M & E systems, through allocation of resources. On the basis of findings, the study concluded that log frame matrices were preferred in conducting M & E exercise, with a high preference of 50%, while public expenditure tracking surveys were less common in Caritas Torit. This was later seen as the reason why stakeholders were encouraged to participate in M & E activities (54%) since the tools used in conducting M & E were simplistic, although conclusive evidence showed high stakeholder participation in lower level activities which had less involvement. The researcher also concluded that employees who went through on the job training (OJT) were effective in their work (42%). The management were happy to allocate resource towards M & E activities. The study recommended that Caritas Torit invests on professionally intensive training of their employees on the utilization of M & E tools, allocation of adequate funds for m & e activities and the practice of accountability to ensure there is autonomy and independence in utilization of funds. The study also urged Caritas Torit to involved stakeholders in all stages of M & E process, from planning to expert opinion. Finally, the study recommended to management to be proactive in designing M & E systems and also offer timely guidance to ensure that all project activities were executed and results communicated for timely decision making. The researcher recommended further research using other determinants of evaluation of M & E systems for projects in assessing different thematic areas in other regions within the republic of South Sudan.