End-line Evaluation for Small Town WASH Activity in Borno, Adamawa and Yobe States At Mercy Corps

Posted on Fri 20th Dec, 2024 - ngojobsite.com --- (0 comments)

DECEMBER 2024

SMALL TOWN WASH ACTIVITY ENDLINE EVALUATION

Assignment Title	Endline Evaluation for Small Town WASH Activity in Borno, Adamawa and Yobe States
Project Location(s):	Borno State: Kwaya town in Kwaya kusar, Wagini Baba Adamu in Shani and Mandara Abdu in Biu, Adamawa State: Vinikilang in Girei, Dumne in Song and Gangarrasso/Sangasumi in Ganye Yobe State: Dikummari in Damaturu, Lailai in Potiskum and Kelluri in Geidam
Proposed Timelines	Estimated 45 Days

BACKGROUND

About Mercy Corps

Mercy Corps is a leading global organization powered by the belief that a better world is possible. In disaster, in hardship, in more than 40 countries around the world, we partner to put bold solutions into action – helping people triumph over adversity and build strong communities from within. Now, and for the future. www.mercycorps.org

With funding from the United States Agency for International Development (USAID), Mercy Corps in partnership with Water Aid, are implementing a five-year Small-Town Water, Sanitation, and Hygiene (STWASH) Activity. The initial phase of the activity covered Adamawa, Yobe, and Borno states in Northeast Nigeria and then the activity received a scale-up in 2022 to include Abia, Imo, and Delta states.

The Activity aims to directly benefit 176,000 individuals/beneficiaries in 29,334 households in the target areas. This target comprises 140,000 individuals across the three states in Borno, Adamawa, and Yobe and 36,000 individuals in the additional states of Abia, Imo, and Delta.

PURPOSE/OBJECTIVES

Using a human-rights-based approach (HRBA), the activity aims to facilitate the recovery of select crisis-affected communities in North-East Nigeria. This will be achieved through two broad components (i) expand access to water and sanitation facilities and (ii) strengthen capacity for small-town governance. The activity is set to achieve this through four main outcomes:

Increased access to improved, reliable, and inclusive water and sanitation services and facilities.
Improved WASH sector policy and governance structures implemented by small-town WASH agencies
Improved management and operational sustainability of water providers (WCAs and other operational providers).
Strengthened locally-led efforts to increase demand for improved WASH infrastructure and services

The activity is seeking the services of a qualified consultancy firm with experience in quantitative and qualitative research to lead the endline evaluation. The purpose of the evaluation is to measure the outcomes of the activity clearly showing the extent to which these have been met and the impact the activity has had in the communities it was implemented in, including documentation of successes, challenges, and lessons learnt. The evaluation will also follow the OECD evaluation criteria to evaluate the activity. The consultancy firm working closely with the STWASH team will be responsible for developing the methodology and will lead the data collection, analysis, and final report writing.

CONSULTANCY OBJECTIVES

The consultancy firm will:

Conduct a desk review of the background documents including past reports and surveys conducted during the implementation of the activity.
Design the endline evaluation methodology focusing on the objective and indicators of the program to be measured.
Develop the necessary evaluation tools that align with the study’s methodology.
Conduct field data collection – conduct interviews with identified/sampled households, and relevant stakeholders. Based on discussions with the activity implementation team, potential target households and stakeholders will be identified for in-depth interviews. The selection method should ensure optimal responses.
Compile the evaluation report that meets the standards required by Mercy Corps, Water Aid, and the funder.

Sampling will be discussed with the ST WASH MEL team. It will be randomized and should represent local diversity. The consultancy firm will lead the field research, including documentation and data entry. The Program Team will support field implementation.

SCOPE OF THE SURVEY

The endline evaluation will cover small towns across 9 LGAs in Borno, Adamawa, and Yobe states in Northeast Nigeria. These are:

Yobe State – Kellori in Geidam LGA, Lai Lai in Potiskum LGA, Dikkummari in Damaturu LGA

Borno State – Mandara Abdu in Biu LGA, Baba Adamu Wagini in Shani LGA, Kwaya town in Kwaya Kusar LGA Adamawa State – Vinikilang in Girei LGA, Gangarasso/Sangasummi in Ganye LGA and Dumne in Song LGA

Evaluation Criteria

The objectives developed for this evaluation will be further explained by the program design, theory of change, and logical framework. In addition to generating learnings like the P2P core approaches, localization, climate change etc , Mercy Corps will be keen to understand the following:

Relevance and Design

Is the program appropriate for the context where it is being implemented? Does the program’s structure enable it to meet the objectives/outcomes?
To what extent has the program considered peoples’ needs according to age, gender, ethnicity, and other social identities? How has it adapted to meet those differing needs?
How has the program ensured that participants’ voices are heard and reflected in both program activities and more broadly, in interaction with government bodies and other stakeholders?
What aspects of the design should be changed to enhance the performance of the program (in terms of implementation and management arrangements)?
To what extent did the project design align with the P2P thematic area and approaches?
Efficiency

How cost-effective is the implementation of the program?
Could the same results have been achieved with fewer resources?
How is the program leveraging insight and new knowledge in the process of implementation? How is this knowledge being shared and contextualized towards efficient project implementation?
How appropriate are the execution and implementation modalities?
How adequate is the support provided by Program Management Teams and PaQ?
How effective are support-cost arrangements with program Implementing partners?
Do stakeholders, particularly the direct participants, participate in the management of the program? If yes, what is the nature and extent of their participation, including by gender?
EffectivenessIs ST WASH as a consortium implementing the program as planned and if not, why not? Has the program caused any particular change in the participant’s lives or the lives of others, whether in terms of physical or social conditions, youth engagement, or other indicators of success? How significant was this change and how did it happen?What component(s) and elements of the program were responsible for the change stated above?How useful are the activities and outputs to the needs of the direct and ultimate participants? Is there a significant gender differentiation in the usefulness of the outputs to direct and ultimate participants?Do the outputs contribute to the achievement of the immediate objectives of the program?What factors affect the implementation of the program?
Impact
Are there early indications of potential success? What observable changes are being manifested currently…?
What are the program’s unintended effects and how have they influenced the outcomes?
How has the program contributed to the development of the capacity of the direct participants to respond and adapt to shocks and stresses)?
Are there signs of the likely impact of the program beyond the direct and ultimate participants/ beneficiaries?
How well did the project address and contribute to the thematic areas in the P2P approach?
Sustainability
Will the changes caused by the program continue beyond the life of the program? Why…?
Has the program resulted in knowledge and insights that can help the intervention to ensure sustainable impact for the participants on a scale?
How has the program worked with stakeholders to increase their capacity sustainably?
What deliberate efforts did the project make to ensure cost recovery and private-public partnerships and what were the immediate outcomes? Was the project designed to ensure full participation of government and communities that will lead to suitable results?
In what ways did the BAY state government show commitment to or acceptance of the cost-share model of the project, and how well did they redeem those commitments, what challenges or supporting factors contributed to this result?
How effective were the strengthening efforts of the project toward the WASH institutions engaged by the project, are they better positioned now to deliver effective WASH services that are sustainable?

In addition to assessing the questions above, the evaluation team will analyse any other pertinent issues that need addressing or which may or should influence future program direction and Mercy Corps engagement in the states and country.

Consultancy firm Deliverables:

The consultancy firm will report progress regularly to the STWASH Interim MEL Advisor. It is also expected that the consultancy firm will submit the following four (4) reports as follows:

Inception report and work plan: the consultancy firm will have a meeting with the activity’s team to understand the program and to access required documents such as the proposal, results framework, and other documents as required by the consultancy firm. The consultancy firm will engage with the activity’s team to come to a consensus on the evaluation’s study methodology, field visit plan, sampling, and so on. The draft inception plan should include a detailed methodology, including a stakeholder map, data collection tools, evaluation framework, quality assurance mechanism of data collected, sampling deliverables, work plan, and division of labor of the team in the consultancy firm.
Brief presentation after fieldwork on preliminary findings: the consultancy firm will present the preliminary findings of the fieldwork to the STWASH team.
Draft Report: the consultancy firm will submit the preliminary report of the endline survey of the data gathered and data/information analysis.
Final Report: the final report, of not more than 30 pages (excluding table of contents and appendix) will be submitted after presenting the results of the study to the STWASH team and incorporating the feedback received during the presentation. The final report should include the complete analytical framework of the study. The review and revision process from the draft report stage to the final report should not exceed two (2) weeks. The final report should include the following:
Acronyms
Executive Summary
Introduction
Limitations of the Study
Findings
Conclusions and Recommendations
Appendix

The consultancy firm will submit both electronic and hard copies of all the reports and data collected. A PowerPoint presentation of the findings will also be expected from the consultancy firm.

Timeframe/Schedule

It is expected that the consultancy firm will work over a 45-day spread (Jan – Feb) as follows:

Document Review and Inception Report (3 days)
Data collection (18 days)
Debriefing after data collection (1 day)
Data Analysis and draft report (9 days)
Review, quality assurance (7 days)
Finalization of the report and evaluation brief (7 days)

The due date for each of these will be set based on the contracting dates.

The consultancy firm will report to:

STWASH Interim MEL Advisor

The consultancy firm will work closely with:

Mercy Corps STWASH Chief of Party, PAQ Director, Country MEL Manager, STWASH MEL Team, STWASH WASH Engineers, and Field Managers.

Required Experience & Skills:

Experience:

Minimum 7 years in research and evaluation with experience in facilitating training, data collection, analysis, and reporting.
Professional experience in water, sanitation, and hygiene (WASH) and/or development.
Strong analytical skills.
Able to work independently with efficiency and competence.
Excellent written and oral skills
Experience evaluating USAID-funded programs
Good interpersonal skills and understanding of cultural sensitivities.
Readiness to travel to northeast Nigeria and conduct direct standard assessment activities and field visits to program sites.
Having a presence in West Africa or Nigeria is desirable but not essential.

Language:

Excellent written and spoken English
Hausa is required

Diversity, Equity & Inclusion

Achieving our mission begins with how we build our team and work together. Through our commitment to enriching our organization with people of different origins, beliefs, backgrounds, and ways of thinking, we are better able to leverage the collective power of our teams and solve the world’s most complex challenges. We strive for a culture of trust and respect, where everyone contributes their perspectives and authentic selves, reaches their potential as individuals and teams, and collaborates to do the best work of their lives. We recognize that diversity and inclusion is a journey, and we are committed to learning, listening, and evolving to become more diverse, equitable, and inclusive than we are today.

Equal Employment Opportunity

We are committed to providing an environment of respect and psychological safety where equal employment opportunities are available to all. We do not engage in or tolerate discrimination on the basis of race, color, gender identity, gender expression, religion, age, sexual orientation, national or ethnic origin, disability (including HIV/AIDS status), marital status, military veteran status or any other protected group in the locations where we work.

Safeguarding & Ethics

Mercy Corps team members are expected to support all efforts toward accountability, specifically to our stakeholders and to international standards guiding international relief and development work, while actively engaging communities as equal partners in the design, monitoring and evaluation of our field projects. Team members are expected to conduct themselves in a professional manner and respect local laws, customs, and MC’s policies, procedures, and values at all times and in all in-country venues.

How to apply

Interested consultancy Firm must complete as follows:

Register on Ariba Supplier Network https://supplier.ariba.com/
Fill and submit Mercy Corps Suppler Information Form (SIF) form Download Supplier Information Form – https://mcnigeria.com/forms/siform.docx
Attach evidence of CAC and Tax Clearance Certificate of at least 3 years
Attach detailed CVs and profile demonstrating experience from previous or similar deliverablesinend-line evaluation, clearly stating their roles.
Attach copy of previous analysis and reports done
Attach Proposed detailed budget (financial proposal) aligned with the consulting firm’s role or roles.
Attach Agreement on company letterhead to accept 100% payment after a successful completion and acceptance of services done and acceptance of 90 days Validity of offer
Attach Methodology

Additional Important Note for Selection

Please group all documents into PDFs.
A signed consultancy agreement and Scope of Work will be the main documentation required in consultancy firm contracting.
Sub-contracting to other entities is not allowed and will not be accepted under this evaluation.
2-3 example reports from similar works are required with a preference for work done in northeast Nigeria or in similar crisis affected context.

S/No	Scoring Basis	Score Assigned (%)
1.	Description of the proposed methodology (attach)	15 %
2	Demonstrated previous experience in similar assignments in water, sanitation, and hygiene (WASH) projects for USAID, UN, EU, or donor agencies in Northeast Nigeria, or a similar crisis-affected context, with proof of at least 7 years’ experience and attach at least 3 copies of either reports or contract.	20 %
3	Capture the proposed data management plan, including data collection, processing, and strong analytical skills in the proposal package (attach proposal)	15 %
4	Proposed timeframe detailing activities and a work plan in the proposal package (attach work plan)	10 %
5	Team composition and level of effort of each proposed team member (At least an advanced degree in Development Studies, Monitoring, and Evaluation, Statistics, International development, or relevant social science degree including CVs) Attach	15 %
6	Consultancy firm must be registered and must attach a CAC and TCC (Tax Clearance Cert) certificate for at least 3 years. Attach	10 %
7	Proposed detailed budget (financial proposal) aligned with the consulting firm’s role or roles. Attach	15%
	Total Score	100 %

Award

Mercy Corps will contact firm(s) that are qualified and are registered on the Ariba Network to send in their financial proposal(s) and make an award based on the proposal which represents the best value to the Activity. Mercy Corps may also exclude an offer from consideration if it determines that the firm is “not responsible”, i.e., that it does not have the management and financial capabilities required to perform the work required.

Evaluation points will not be awarded for cost. The cost will primarily be evaluated for realism and reasonableness. Mercy Corps may award to a higher-priced applicant if a determination is made that the higher technical evaluation of that applicant merits the additional cost/price.

Mercy Corps may award to an applicant without discussions. Therefore, the initial offer must contain the applicant’s best price and technical terms.

Deadline for Submission: 3^rd January 2025

Submit applications to [email protected] Using RFQ 129 Consultancy for Endline Evaluation for STWASH in BAY (Borno, Adamawa and Yobe) States as the subject of the email