End of Project Evaluation OFDA funded Sustained Interventions in a Transitioning Environment (SITE)

WV Somalia

Terms of Reference (ToR) for End of Project Evaluation OFDA funded Sustained Interventions in a Transitioning Environment (SITE)

1. ASSESSMENT SUMMARY

Project Name

Sustained Interventions in a Transitioning Environment (SITE) with primary focus on WASH, Health & Nutrition, Agriculture and Economic Recovery and protection Support

Assessment Type

End of Project Evaluation

Evaluation Purpose

The purpose of the End of Project Evaluation is to assess the progress made towards the achievement of the project objectives and anticipated outcomes on the lives of children, families and communities in Gedo, Bay and Bakool Regions of Somalia. It also tracks the changes against baseline and mid-term evaluation outcomes resulted over the period of the project.**

Project location (Districts and # of villages/ sub-locations)

Gedo Region – Luuq/Boholgaras & Dollow districts

Bay Region – Baidoa, Qansadhere and Burhaakaba districts

Bakool Region- Hudur & Wajid

Implementing Partners

Luuq/Boholgaras – World Vision & MOH

Dollow – World Vison and MOH

Wajid – World Vision & MOH

Baidoa – World Vision and MOH

Hudur – MARDO

Qannsadhere – CeRID

Burhakaba – SRDA

Project Duration

August 30, 2019 – June 30, 2021

Proposed dates of Assessment/ data collection

Within 10 – 12 days after contract is signed.

Anticipated Date of Draft Report Submission

15 days after data collection completed

Anticipated Date of Final Report Submission

30 days after data collection completed

2. PROJECT BACKGROUND

Project Goal

To alleviate immediate human suffering and strengthen the resilience and self-recovery capacity of drought affected communities, including IDPs, hosting communities in South Central Somalia.

Project Objectives/ Outcomes

1. Increase access to food through own production and protection of productive assets

2. Enhance the economic capacity of communities to recover rapidly from the effects of drought and other hazard/shocks.

3. To improve immediate access to safe water, sanitation and hygiene for people in emergency as well as to provide sustained access to sufficient safe water to meet the future challenge

4. Reduce vulnerability of IDPs and host communities to waterborne and vector-transmitted diseases

5. Increased access to primary health care services, particularly for women and girls, with emphasis on disease prevention, treatment, maternal and child health and healthcare system strengthening

6. Reduced suffering of children affected by malnutrition

Sectors

1. Agriculture, Food Security & Livelihoods

2. Economic Recovery and Market Systems;

3. Health

4. Nutrition

5. Water, Sanitation and Hygiene and Non Food Items (NFIS)

6. Protection as a cross cutting

Project Outputs

1. Agriculture and Food Security

Output 1.1. Livestock

Output 1.2. Veterinary Pharmaceuticals and Other Medical Commodities

Output 1.3. Improving Agriculture Production/ Food Security

Output 1.4. Pests and Pesticides

Output 1.5. Irrigation

1. Economic Recovery and Market Systems

Output 2.1. Market System Strengthening

Output 2.2. Financial Services

Output 2.3. Temporary Employment

1. Water, Sanitation and Hygiene (WASH)

Output 3.1. Environmental Health

Output 3.2. Hygiene Promotion

Output 3.3. Water Supply

Output 3.4. Sanitation

Output 3.5. WASH Non-Food Items (NFI)

1. Health

Output 4.1. Health Systems and Clinical Support

Output 4.2. Communicable Diseases

Output 4.3. Reproductive Health

Output 4.4. Non-Communicable Diseases, Injury, and Mental Health

Output 4.5. Community Health Education/Behavior Change

Output 4.6. Pharmaceuticals and other Medical Commodities (PMC)

1. Nutrition

Output 5.1. Infant and young child feeding in Emergencies (IYCF-E)

Output 5.2. Management of Acute Malnutrition

Number of target beneficiaries

165,335 host communities and 104,291 IDPs

Donor

USAID (OFDA)

Length of Program

22 months

Available Project documentation

Project proposal, M&E plan, Detailed Implementation Plan (DIP), mid-term evaluation reports, project quarterly reports, other assessments

3. PURPOSE AND OBJECTIVES OF THE END OF PROJECT EVALUATION

The evaluation is intended to establish the extent to which the project’s objectives (Outcomes and outputs) were achieved, understand the project’s contribution to child wellbeing, facilitate analysis of lessons learnt (what went well and what did not go well), and make recommendations that will influence future interventions in the targeted locations and similar contexts. Largely the evaluation will help in informing all project stakeholders on the extent to which the intended outcome and output objectives were achieved as well as highlight the relevance, appropriateness, effectiveness, sustainability, impact and lessons learnt from the interventions.**

This will be an external assessment which will necessitate, undertaking a complete review and analysis of the program design document (Narrative Proposal) and its annexes including: Budget, Log frame, M&E plan and Indicator performance Table (ITT) together with progress reports (financial, narrative & monitoring) and available strategies (Somalia NDP & WVS National Office Strategy).

Specific objectives include;

§ Assess and determine the up-to date achievements in meeting the anticipated objectives, compared to baseline bench marks and mid-term evaluation results in Agriculture/Food security and Economic recovery, WASH and Health & Nutrition, sectors in the targeted areas (Luuq, Dollow, Baidoa, Wajid, Qansadhere, Burhakaba and Qansadhere Districts).

§ Provide information on health & nutrition; WASH coverage; Agriculture and FS, and Economic recovery and Development with reference to the gaps identified during the baseline and mid-term-evaluation.

§ Assess and determine the progress in the key cross-cutting themes for programming i.e. protection, accountability to affected population, gender, children in emergencies, DRR, and covid19, and others as required.

§ Impact: The evaluator will assess the positive and negative changes produced by OFDA supported interventions, directly or indirectly, intended or unintended

§ Determine lessons learned and document best practices.

Scope

Geographic area and target population

Since the project has been implemented in seven districts, the evaluation will take place in all the project areas. **

Depth of investigation

Since this is the summative evaluation, it will assess the progress of the project towards the project goal and outcome starting August 30, 2019 to June 2021 and delve into the details in Table 1.

Context

The evaluation to be done in relation to the context taking into consideration the changes that took place during the project implementation period (Covid 19, political tension, droughts, flooding, insecurity). The consultant is expected to analyze how the changes in context affected project implementation and impact including effectiveness of adaptation efforts made by the implementing agency, communities and other stakeholders

Community level partners

The evaluation will involve all stakeholders that were involved in the project design and implementation including:

· Community groups and committees involved in project implementation (WASH, H&N and Protection

· Implementing partners (MARDO, SRDA, CeRID, Ministry of Health, Ministry of Gender, Ministry of Water and Mineral Resources, Ministry of Agriculture and Livestock)

· Local Administration offices involved in the project implementation – District Commissioners’ offices

4. METHODOLOGY

4.1. Study design

This will be a cross sectional and will employ a mixed method approach in data collection, triangulation and analysis drawing on quantitative and qualitative data. Both primary and secondary data will be collected, reviewed and analyzed. Household questionnaire survey (HS), focus group discussions (FGDs) and key informant interviews (KIIs) will be used to gather primary data involving both direct beneficiaries & indirect beneficiaries. The study will have three phases intertwined in the evaluation process:

§ Phase one: – will involve a comprehensive review of secondary information based on the existing project information from the proposal, detailed implementation plans, quarterly & annual reports, monitoring reports, and any other relevant reports.

§ Phase two:- quantitative household survey using structured questionnaires

§ Phase three: – qualitative information gathering using observations, FGDs and KIIs

In order to further ensure the quality of evidence, the evaluation will be designed with reference to the Bond Evidence Principles Checklist. Specific reference will be made to the 5 key dimensions of voice and inclusion, appropriateness, triangulation, contribution and transparency.

4.2. Rationale for the choice of mixed methods design.

The mixed design focuses on both quantitative and qualitative approaches in data collection, analysis and presentation[1]. Mixed methods approach has emerged as a practical methodology in conducting assessments and evaluations for projects as it gives greater insight into phenomena through information validation and triangulation. Advantages of the methodology include the following:

§ Data from different sources provides an opportunity to understand changes from different standpoints. One data source may not be enough to give explanations to behaviour, results and practices

§ Peculiarity in data collection leads to greater validity as information omitted by one method can be augmented by another source.

§ This method answers evaluation question from a number of viewpoints. It Ensures that there are no ‘gaps’ to the information collected

§ The method is helpful when one methodology does not provide all the information required.

§ It’s a good methodology for social, health and behavioural studies as it interacts with several stakeholders and utilizes all available from multiple levels and lines of evidence n to reach a conclusion.

To actualize this design, the evaluation will target different stakeholders and population groups using different data collection methods i.e. structured questionnaires and focus group discussions for targeted households (both direct and indirect beneficiaries), key informant interviews for project partners, staffs, government technical units (MoH, Ministry of Water and Energy, Ministry of Agriculture and Livestock), document reviews for secondary data, observations for Food Security & Livelihoods (FSL), WASH and health infrastructure established and oral narratives for selected beneficiaries. All information gathered from these sources will be synthesized and analyzed to answer the evaluation question.

This evaluation will be led by consultant with overall leadership from WV Somalia Quality Assurance and technical support from FSL, WASH, Health & Nutrition and Protection Technical team. The consultant will adopt appropriate tools including interview/discussion guides, household questionnaire, and observation checklist. Upon the finalization of tools (FGD guide, KIIs and household questionnaires), a training will be organized in the targeted districts including all evaluation team members including enumerators, project partners and staff. This training will aim to empower the evaluation team with the project logic model and evaluation criteria, survey scope, instruments, planning and management of the survey.

4.3. Sampling Design

Quantitative Data: While designing the survey tool, the consultant will consider various factors. For this evaluation, quantitative approach will only be employed in gathering information at household level with focus on mothers with under five children and/or household care takers. The sources of indicator vary for different indicators. Items covered in the questionnaire will be framed from project outputs, outcomes and goal. Further in this approach, the evaluation team will adopt best sampling methods with taking into consideration sample size used at baseline/ mid-term. This should be well elaborated in the inception report. With the help of local administration, the household numbers for the target villages will be obtained before commencement of study to facilitate scientific determination of the sample size. This will be based on the household numbers from each village falling within the project scope. Probabilistic methods will then be used to sample the key respondents at household level.

Scientific sampling will guarantee randomness in selection of respondents, validity and reliability of data collected. To generate the sample size from the population, the team will use the online sample calculator (generator) to arrive at the total households to be targeted for the evaluation.

Qualitative Data: Physical observations, Focus Group Discussions (FGDs) and Key Informant Interviews (KIIs) will be carried out with beneficiaries and stakeholders to understand the extent to which the project achieved the intended objectives and addressed community needs. The FGD guides will contain a checklist of questions generated from the main project objectives and activities. The evaluation team working together with project staff will select the participants of the FGDs based on the focus of the study. Mothers with children under five will be purposively included for the FGD.

The focus groups will target key stakeholders including beneficiaries, comprising; FSL targeted community members, Pregnant and lactating Women (PLW), CHWs, WASH Committees, Protection Committees, facility staff, camp leaders, youth clubs and children’s clubs among others. Taking covid19 protocols into consideration, every FGD will have standard 6-10 participants within the project areas. For purposes of plural investigation, the exercise will be conducted with a broad range of representation within the community to enable triangulation of findings and incorporate wide-ranging perspectives.

Key Informant Interviews (KIIs) will be conducted with a wide range of stakeholders including; WV Project staff, Government officials from Ministry of Agriculture, Ministry of Livestock, Forestry and Rangelands, MOH, MoEWR & Min of Gender, Health facility in-charges and other implementing partners working within the project area.

Note: The evaluation team will also consider gathering information on the impacts of COVID-19 as a cross cutting theme by deliberately incorporating key questionnaires related to the pandemic. Key questions will be developed by the evaluation team or provided by WV QA&S team.

4.4. Documents review

The evaluation team will undertake a thorough review of all available project documents as deemed necessary to gather vital information on the project design, implementation and monitoring processes as well as capture significant lessons registered over the lifetime of the project. Of necessity, the evaluation team will review the following literature:

ž Project proposal including logic model, M&E Plan, ITT & DIP

ž World Vision Somalia National Office Strategy 2016-2020/25

ž MOUs signed with line ministries

ž Project progress reports

ž Activity Reports

ž Any Assessment and Monitoring Reports

ž Any other relevant documents by FSNAU, UNICEF, UNOCHA, others as required.

Additionally, the team will look at government strategic documents and reports, SDG targets and WVI child wellbeing outcomes to enable comparisons (where applicable) and validation of the findings.

4.5. Field Processes

Selection and training of enumerators: Enumerators with previous research experience and the ability to speak Somali language will be recruited. WV will identify and hire the enumerators. Key government official from Ministry of health and Water resources and social affairs will be engaged in order to support the process. Depending on sample size, a total of [xxx male, xxx female] enumerators will be engaged for evaluation and these will work hand-in-hand with M&E Officers during data collection. The field team (enumerators & M&E Officers) will be trained in data collection techniques using KOBO platform and mastery of the data collection tools before field data collection exercise. During the training, the field team will also be briefed on the objectives of the evaluation, how to identify the appropriate respondents at various levels and how to fill in the questionnaire appropriately. Emphasis will be put on research ethics, accuracy, and completeness among others

Data collections tools and methods: As indicated, the evaluation will use both quantitative and qualitative tools and methods for data collection, analysis and presentation. Information triangulation (using different methods) will be used to guarantee that the evidence supporting any conclusion drawn is representative of the situation. The evaluation will employ the following data collection methods during the evaluation;

· Household interviews will be conducted using structured questionnaires

· Key Informant interview will be conducted using KII Guide

· Focus group discussions will be conducted using Focus Group Discussion Guide

Research ethical code will be applied throughout the study design, data collection and analysis phases. This will be reinforced during the survey team training.

Field data collection:** The team will use mobile phones configured with KOBO mobile application for data collection (Uses WV server). The interviews and discussions will be conducted mainly in Somali language. Focus group discussions will be conducted by a key researcher using a predetermined focus group guide with relevant themes and sub-themes, while Key informant interviews will be conducted using a predetermined guide with open ended questions for specific informants.

Analytical framework:** The evaluation team will use the project logic model and the evaluation criteria set out below to address the evaluation objectives as attached below. The tools and data collection will be aligned to this framework with emphasis on gender and social inclusion, and other cross cutting issues such as COVID-19 and locust invasion.

Table 1: Evaluation criteria and questions[2]**

Evaluation Objectives

Suggested Key Questions

Rationale for asking Key Questions

Suggested Approach (To explore key question)

Assess the Relevance and appropriateness of the project design to the community needs

· Was the project in line with local needs and priorities, targeting the right areas, people with the right interventions?

· Was the project sensitive to the culture, gender and social inclusion of women, girls, boys and men?

· Were the interventions in line with government National plans/strategies?

· Was the intervention aligned to the child wellbeing outcomes and WVS Strategy (FY2016-2020/25)?

· Was the selection criteria appropriate for identifying and reaching target communities and households?

· What measures were put in place to ensure that the project stakeholders were adequately involved in the project design, interventions and their roles in it?

· To what extent did the key stakeholder groups (desegregated by age/sex and other level of vulnerability) participate in the management and implementation of the food aid project?

· Did the activities contribute to the outcome and the objective of the project? Were there gaps in any sector, if yes, what are they and what more or different could WV Somalia, USAID/OFDA and other stakeholders do to address the problem?

A thorough elaboration on these questions, will enable world Vision and stakeholders;

· Clearly understand whether the project design was based on community priority needs.

· Understand whether the design and implementation took care of cultural sensitivities given that the fragile context.

· Clearly document whether the project was aligned to government plans, CWB targets and WVS strategy for purposes of compliance.

· Understand the beneficiary selection criteria used and whether it conformed to the set standards.

· Establish and properly document the contribution of the project to intended changes in the communities

· Establish and document whether the project management were responsive to community needs

1. Thorough document review should be conducted to establish the set strategies and how they were addressed by the design.

2. A comprehensive household survey will be implemented to measure outcome indicators that were set in the design and any other indicators that are critical for child wellbeing

Assess the efficiency of the project in delivering and achieving project outputs and outcomes.

· Were the outputs and activities appropriate for achieving project outcomes?

· Did the project adopt the most efficient approach in implementation?

· How well did the management structure support/facilitate program implementation? Was project management responsive to changing conditions on the ground?

· Was the project implementation in line with the planned objectives?

· How successful was the project in integrating with other sectors (beyond FSL, WASH, Health, Nutrition and Protection)?

· How the project was efficient in terms of budget spent compared to the number of people who benefited from the project. How efficient is this project compared to other similar interventions either by WV or local partners?

· Was the projected implemented in coordination with other humanitarian agencies? Where there synergies that ensured complementarity with activities implemented by other agencies and minimising overlap

The key questions will enable WV and partners to:

· Clearly understand and document the extent to which outputs were adequate for achievement of outcomes.

· Assess the approaches adopted during implementation, and their appropriateness in delivering results.

· Clearly understand the management structure and its contribution to the success implementation of the project.

·

1. A comprehensive household survey will be implemented to measure outcome indicators that were set in the design and any other indicators that are critical for child wellbeing;

2. Key informant interviews and focus group discussions will include questions on key impact; attribution; enabling factors; unmet needs; etc.

3. Thorough document review should be conducted to establish the set strategies and how they were addressed by the design

Assess project effectiveness (progress of implementation and key outcomes achieved including the contribution on wellbeing of children)

· Did the project achieve the objectives and the targets?

· Were project activities implemented effectively to achieve maximum benefit within the context; including community engagement, trainings, community sensitisation etc.?

· What are the factors that hindered/assisted the effectiveness of the project?

· How did beneficiaries perceive the value of the project compared with other alternatives?

· Have there been any un-intended benefits or negative consequences? How did the project mitigate these consequences?

· How did the project relate with other partners or stakeholder? What were the challenges in working with other partners or stakeholders? How did the project try to address these challenges

· Did WVS put in place adequate and effective systems for ensuring accountability and transparency in the management and implementation of the project? Were these systems adhered to? Why or Why not?

These questions will enable WV and partners to:

· Clearly document the impact of IHA interventions to the communities

· Identify and document any un-intended consequences of interventions (both positive and negative)

· Assess the extent to which any observed impact(s) could be attributed to WV or other partners?

· Analyse the performance of the projects against set targets (projects, critical activities, outputs) and document factors that contributed to meeting/not meeting/exceeding targets

1. A comprehensive household survey will be implemented to measure outcome indicators that were set in the design and any other indicators that are critical for child wellbeing;

2. Key informant interviews and focus group discussions will include questions on key impact; attribution; enabling factors; unmet needs; etc.

3. Thorough document review should be conducted to establish the set strategies and how they were addressed by the design.

4. Key informant interviews and focus group discussions will include questions on key impact; attribution; enabling factors; unmet needs; etc.

Assessing sustainability of key activities, outputs and outcomes that have been initiated by project

· What mechanisms have been put in place in order to sustain the key activities, outputs and outcomes that were initiated by the project activities?

· Who are the key partners WV has worked with? What roles did they play? What motivations /mechanisms exist for partners to continue playing these roles?

· What key behavioural changes have the project facilitated? What is the likelihood of continuity of these changes

· What, if any are the risks facing sustainability of key activities, outputs and outcomes? What can be done to strengthen sustainability during the next phase of the program?

· How did the project contribute towards building the resilience of the targeted population? How does the project contribute towards durable solutions for displaced and crisis affected populations

· Was the project implemented in a way that was sustainable to the environment i.e. environmental protection considerations

Under this objective, WV and partners will be able to:

· Identify key enablers of sustainability that can be strengthened during the next phase

· Identify key risks of sustainability that need to be addressed in order to achieve broader impact and sustainability.

1. Key informant interviews and focus group discussions will explore strengths and weaknesses related to sustainability;

2. Through household survey, document reviews and observation, the survey team will assess the likelihood of continuity of key project outputs (e.g., infrastructure constructed, community groups’ set-up, etc.)

To establish and document key lessons learned during the project implementation

· What key lessons were learnt by staff, management and stakeholders throughout the implementation of the program

· What key challenges were experienced/witnessed by staff and management in the implementation of the program? How were they able to address the challenges

· What possible recommendations do staff and stakeholders put forward for any related future interventions

· What best practices emerged from the project implementation across the different sectors? To what extent can they be scaled up?

· What innovative approaches were used to deliver humanitarian assistance to the beneficiaries?

· What innovations were used in delivering the humanitarian response across the different sectors during COVID-19 pandemics?

· Have COVID-19 preventive and control measures followed during the project implementation in the targeted communities?

· What specific impacts COVID-19 brought out to the targeted community?

This will help WV and Partners;

· Clearly understand the key lessons that were learnt during the program implementation. This would be able to inform future designs.

· Document best practices and innovations for possible scale them up in future projects.

· Assess if the COVID-19 preventive and control measures were well implemented in the project area

· Assess negative impacts of COVID-19 to the targeted community

1. Key informant interviews and focus group discussions will explore strengths and weaknesses related to sustainability.

5. ANALYSIS AND REPORTING:

The household questionnaire will be automated using Kobo collect application and completed questionnaires on Kobo will be uploaded to the server and later exported into Statistical Package for Social Sciences (SPSS) package Vs. 21 for analysis. Descriptive statistics including the frequencies, percentages and proportions will be used in the quantitative analysis based on responses under each question. Cross tabulations will be used to measure variation of information among different groups of respondents and from various administrative units where necessary. Qualitative data will be analyzed using thematic and content analysis by the help of analysis sheets.

Finding and conclusions: Findings and key indicators will be presented in form of text, graphics and tables. The survey lead team will prepare the report in a user-friendly format, following the structure provided at end of the TOR. This section will present findings as statements of fact that are based on analysis of the data. The evaluation findings will be structured around the evaluation criteria and questions so that report users can readily make the connection between what was asked and what was found. Variances between planned and actual results will be explained, as well as factors affecting the achievement of intended results. The assumptions or risks in the project design that subsequently affected implementation will also be discussed. The conclusion section will be comprehensive and balanced; it will highlight the strengths, weaknesses and outcomes of the intervention. The conclusion section will be substantiated by the evidence and logically connected to the evaluation findings. The conclusion will also respond to key evaluation questions and provide insights into the identification of and/or solutions to important problems or issues pertinent to the decision-making.

5.1. Data quality control & Survey Ethics

All data quality control measures will be adhered to during the evaluation including; reviewing of the study tools, translation of the tools into local languages, standardization of the training (pre-testing and ensuring that the enumerators are familiar with local terminology), review of evidences against bond evidence parameters, using GPS functionality in Kobo to geo-reference the data, regular supervision and data cleaning. The administered tools will be checked regularly for correctness, completeness, and consistency. After entry, the data will crosschecked to ensure accuracy of the information obtained from the field then compared and validated. During analysis, validation will be done by comparing the emerging information with secondary data to ensure that any outliers are addressed.

Ethical Consideration: The following ethical considerations will be adhered to during the evaluation process:

§ The rights of privacy of individuals

§ Voluntary nature of participation – and the rights of individuals to withdraw partially or completely from the process

§ Consent and possible deception of participants

§ Maintenance of the confidentiality of data provided by individuals or identifiable participants and their anonymity

§ Reactions of participants to the ways in which researchers seek to collect data.

§ Effects on participants of the way in which data is analyzed and reported.

§ Behavior and objectivity of the evaluator.

6. EVALUATION STUDY LIMITATIONS

Security in most of the targeted districts is volatile with likelihood of disruptions that may restrict enumerators from accessing some field locations, hence affecting the quality of the evaluation. This will be mitigated by working together with our local line ministry staff right from the inception to the end, as this will empower them to adequately supervise the evaluation and update lead evaluators on a daily basis.

7. RESPONSIBILITY AND AUTHORITY

7.1. Consultant Responsibilities during assessment

§ Develop Technical and Budget proposal that includes assessment plan, methodology and appropriate/relevant data collection and analysis tools.

§ Work closely with M&E managers and project staff during the design of the methodology/ tools; agree on the tools that will be used.

§ Presenting the methodologies and tools to WV M&E and Technical Specialists and agree on the final tools.

§ Design data entry and analysis spreadsheets

§ Train enumerators, guide and supervise enumerators during data collection in the field

§ Monitor and verify data collection

§ Make visits to data collection sites and do FGDs and KIIs

§ Incorporate feedback from WV team into tools and reports

§ Approximately one hour PowerPoint presentation of results and discussions to be delivered

§ Do de-briefing on preliminary findings to the field team soon after completion of data collection. The result is expected to be published and the consultant needs to give due attention to the quality of the report.

7.2. WV Responsibilities during assessment

§ Provision of reference documents like project proposal, M&E Plan, IPTT, baseline survey and mid-term evaluation reports and progress reports

§ Do community and stakeholder mobilisations for the assessment

§ Support recruitment of enumerators

§ Source, hire and pay for enumerators

§ Review the assessment plan and tools before use

§ The DME and Project managers will support training of enumerators on the data collection protocols and data collection tools provided by the consultant

§ The project team supports and facilitates household data collection

§ The M&E team conducts internal supervision and data verification during data collection

§ Review the draft report and provide feedback to the consultant

8. DELIVERABLES

· Final Evaluation Report

o Findings should be disaggregated by Sectors and also provide the cumulative results by district and project.

o Recommendations need to be supported by a specific set of findings.

o Evaluation findings should be presented as analysed facts, evidence and data and not based on anecdotes, hearsay or the compilation of people’s opinions.

o Findings should be specific, concise and supported by strong quantitative or qualitative evidence.

o Include recommendations for improved future programming and implementation

o No more than 40 pages (without annexes)

o Includes photos and quotes from key stakeholders such as beneficiaries and project facilities during FGDs & KII

o Including, but not limited to, sections on context, sampling, methodology, findings (including table showing end-results per indicator/ activity

o Disaggregation of beneficiaries – Male/Female, IDPs/Host community levels at minimum.

o Annexes with the following information:

§ List of enumerators

§ All data collection tools and methodologies

§ Findings on the integration of gender, disability, resilience, child protection , COVID-19 and engagement with local administration and religious leaders

9. PROPOSAL CONTENTS

Proposals from Consultants should include the following information (at a minimum)

§ Technical Proposal with clear methodology, including types of data collection tools and analysis

§ CV of key consultant(s) annexed to the technical proposal

§ Proposed budget

§ Proposed timeline

§ The applicants have the right to request for more clarifications.

10. TECHNICAL EVALUATION CRITERIA

Applicants need to clearly articulate on following criteria, but not limited to;

§ Understanding of the TOR (General understanding of the project requirements; coverage of principal components as stipulated in the ToR)

§ Methodology (Adequacy of the proposed approach, methodology and work plan in line with ToR).

§ Experience- consultant’s general experience and record in the field covered by the ToR**

§ Previous experience(s) with similar assignments in a fragile context or in Somalia
Key staff (Experience, composition and records of the staff members to be assigned to the work, a consultant/firm with a combination of Somali Researchers is highly encouraged).**

11. REQUIRED QUALIFICATIONS AND EXPERIENCES OF THE CONSULTANT

§ In-depth knowledge of Somalia and its regions including government and community level service delivery structures

§ Masters/PhD degree in Agriculture, Agricultural Economics, Health and Nutrition, Water Engineering, Development studies, Peace and security, Monitoring and Evaluation and International studies and 5+ years of consultancy experiences

§ A team with combination of staff with Qualifications and Experience in Livelihoods, Health & nutrition and Wash will be more preferred for the assignment

§ Has technically sound experiences in Evaluations, Baseline, Assessment and Studies in Somalia context

§ Has extensive experiences with Resilience Programs and humanitarian works

§ Strong written, communication, and interpersonal skills in English, with substantial experience in training and managing multicultural teams

§ Strong understanding of the local politics, religion, culture and language of the community

§ A firm with Somali National Researchers is highly encouraged

12. LOGISTICS

• WV will hire enumerators, getting on board and sign agreements with them for the assignment (covers costs related to enumerators training and incentives during data collection)
• Consultant trains the enumerators on data collection tools, supervise during data collection
• WV will hire vehicles for data collection
• Ensure printing/copying materials are readily available for the evaluation team
• WV will not cover costs for flights and any cost incurred by the researchers

13. EVALUATION REPORT TEMPLATE

Final Evaluation report will be structured as below:

i. Table of Contents

ii. Glossary/Acronyms and Abbreviations

iii. Introduction

1. Executive Summary

2. Survey Introduction/Background

3. Methodology

4. Limitations

5. Findings

6. Conclusions and Recommendations

7. Lessons Learned from the evaluation Process

8. Appendices

EVALUATION CRITERIA

1. Mandatory Requirements evaluation

a. Provide a certified copy of a certificate of business registration, Certificate of incorporation, business license or similar document (Companies/Organizations)

b. Provide a certified copy of tax registration, tax clearance certificates or similar documents (Companies/Organization)

c. Individual tax registration documents (for individual consultants)

d. Provide information on ownership structure (Name of directors of the company / Owner) (Companies/Organization)

e. Provide last two years of audited financial statements or tax filing, or similar documents (Companies/Organization)

f. Provide references from previous clients for similar works.(At least three)

Note – Applicant who will not meet the above mandatory requirement will not be considered for Technical Evaluation.

2. Technical Evaluation

Qualified and interested parties are asked to submit the following;

§ Letter of interest in submission of a proposal

§ A detailed technical proposal clearly demonstrating a thorough understanding of this ToR and including but not limited to the following;

o Consultant/Company Profile

o Description of the Methodology

o Demonstrated previous and excellent experience in evaluation is required and qualifications outlined in this ToR (with submission of at least TWO most recent evaluation reports as evidence).

o Proposed data management plan (collection, processing and analysis).

o Proposed timeframe detailing activities and a work plan.

Team composition and level of effort of each proposed team member (include CVs of o each team member).

3. Financial Evaluation

1. A financial proposal with a detailed breakdown of costs for the study quoted in United States dollars.

2. Payment Terms

3. Credit Period

Application Process

All interested bidders are requested to submit their Technical Proposals and Financial Proposals in Separate documents as attachments (Bidders who will combine both technical and financial proposals shall be disqualified) via email [email protected] on or before 21^st April 2021.

Bids received after deadline shall not be considered.

Email title should be; – End of Project Evaluation OFDA funded Sustained Interventions in a Transitioning Environment (SITE)

Your financial proposal should have your professional fee and any other related cost well tabulated. Financial proposal should not be part of the technical proposal, it should be a separate document.

Note:

As part of the Consultant selection process, the best candidates will be required to make a presentation of the technical proposal to the Supply Chain and Core Project Technical Team to inform the final decision on the award of the contract. **

[1] Creswell, J. W., & Plano Clark, V. L. (2011). Designing and conducting mixed methods research (2^nd Ed.). Thousand Oaks, CA: Sage Publications, Inc.

[2] All data collection tools should be designed by aligning the research questions with a gender and social inclusion emphasis.