17-January-2024
As part of the work in the framework of the Project Cluster Evaluation of the AfDB's Technology for African Agriculture Transformation (TAAT) Program, a team of evaluators, knowledge management officers and communications officers from IDEV conducted a field visit to Ethiopia in September 2022. Andson Nsune, Principal Evaluation Officer and Task Manager of the evaluation, tells us about the relevance of the field work and the challenges to be taken into account to get the most out of it.
Why are field missions important?
Field missions help to triangulate large amounts of data collected from sources such as program monitoring, self-evaluation reports, or previous evaluations. They are very important for the evaluation of program and project spin-off activities, which directly impact beneficiaries.
What did you enjoy most about your mission to Ethiopia for the evaluation of the first phase of the TAAT program?
The mission in Ethiopia was eye-opening and helped put the contribution of TAAT into context. It became clear that the success of the program is largely due to the strategic focus and commitment to achieving wheat self-sufficiency in Ethiopia. It was gratifying to note that, although the scope was small and focused on seeds, the program triggered a wheat revolution in lowland rainfed areas and helped to demonstrate that irrigated wheat was viable in these areas.
Another interesting experience was to see how working with local NGOs and local structures such as Eddir in Maisha Woreda in Hossana led to sustainable interventions for the prevention of land degradation. These were low-cost interventions that addressed critical community needs and were therefore owned by the community.
What are some of the data collection challenges you faced during this field mission?
Ideally, pre- and post-support evaluation of the relative achievements of outcome indicators such as changes in income and food security, would have been necessary, preferably through cross-sectional surveys or other methods such as panel studies at baseline and at the next assessment point. However, given the small scope of the program and that TAAT-I systematically corrected data on productivity, income and other outcome indicators among beneficiaries, this was not undertaken. The evaluation was generally qualitative and sought to validate results through document reviews and interviews with program staff and various stakeholders from government, development partners, NGOs and private sector stakeholders.
There were also challenges due to conflict situations in Ethiopia which prevented the evaluation team from visiting the Afar region at the time. These were mitigated by using communication tools such as chat applications for phone based interviews.
What would be your top advice to a young evaluator going on his or her first field mission?
Be flexible, and keep an open mind when collecting data during field missions, as programms change very frequently and you have to keep adapting to those changes. Secondly, in cases where local consultants demonstrate their ability to carry out data collection according to evaluation norms and standards, it may be wise to extend the period of data collection rather than limiting their intervention to the period when the evaluation team is in-country. Thirdly, as the period of in-country data collection is very short, it is important to have a good understanding of the strategic and policy frameworks of the government, the multilateral development banks, and other donor stakeholders involved in the evaluation. This helps to quickly validate certain policy directions, identify gaps, and prepare interviews and discussions. Finally, strive to build a good relationship with the various stakeholders, especially the institutions and the people in charge of coordinating data collection in the field, not forgetting the support staff assigned to the mission.