SHORT-TERM CONSULTANCY TO CONDUCT FINAL PROJECT EVALUATION AT CHRISTOFFEL BLINDEN MISSION (CBM)

SHORT-TERM CONSULTANCY TO CONDUCT FINAL PROJECT EVALUATION

Christoffel Blinden Mission(CBM)

Christoffel Blinden Mission (CBM) International is an International Christian Development Organization, committed to improving the quality of life of persons with disabilities in the poorest countries of the world. CBM provides grants sourced from private and institutional donors to local partners, who subsequently implement the grants on the basis of contracts signed with CBM detailing implementation, accounting, and reporting standards. In this set-up, CBM Country Offices (CO) perform control and monitoring procedures aimed at partner projects; control reports from implementing partners to CBM, including comparison with original source documents, project contract and cost plans; and ensure compliance with organizational and statutory requirements.

CBM is seeking qualified consultants to carry out a final project evaluation. The Terms of Reference for this evaluation is as stated below;

Terms of Reference

1. Evaluation Summary

Program/Project,

Project Number

P3825

Partner Organisation

CCMHP – Comprehensive Community Mental Health Program

COCIN – Church of Christ in Nations, Community Development Programme

Green Code – Green Concern for Development

JPRM – Justice, Peace and Reconciliation Movement

TAIMAKO – Taimako Development Initiative

Project start and end dates,

Phase of project

September 2018 – April 2022

Ongoing

Evaluation Purpose

To establish the extent to which the project has successfully achieved (and potentially not achieved) the projected impact, results and outputs in the target project locations in line with the project Logframe in an efficient and cost-effective manner. The evaluation will provide the opportunity to generate a reference document, detailing the achievements and challenges of the project by all partners and CBM (with special attention to a possible follow-up project), overall lessons learnt, and value for money offered.

Evaluation Type

(e.g. mid term, end of phase)

Final Project Evaluation

Commissioning organisation/contact person

Christoffel Blinden Mission (CBM) International

Nigeria Country Office Director: Mr Bright Ekweremadu

Evaluation Team members (if known)

External evaluation team (gender balanced and inclusive)

Primary Methodology

Mixed Methods Design, incl. quantitative and qualitative methods.

Proposed Evaluation Start and End Dates

1/02/2022 to 30/02/2022

Anticipated Evaluation Report Release Date

10/03/2022

Recipient of Final Evaluation Report

Christoffel Blinden Mission and partner organisations

1. Background of Project

CBM is an international Christian development organisation, committed to improving the quality of life of persons with disabilities in the poorest countries of the world. Based on its Christian values and over 100 years of professional expertise, CBM addresses poverty as a cause, and a consequence, of disability, and works in partnership to create a society for all. CBM humanitarian activities aim to equally reach and actively involve persons with disabilities, addressing specific needs while promoting and facilitating full inclusion in mainstream services. We work – together with partners – on projects that are context-specific, from preparedness to immediate life-saving needs such as food, shelter and medical work, and longer-term rehabilitation interventions in fields such as education, sanitation, healthcare, livelihood and reconstruction.

The lingering conflict in Nigeria’s North East Zone has been the major cause of widespread population displacement. Over 2 million persons have been forced to leave their areas of residence in search of safety and security in neighbouring Wards and Local Government Areas (LGA) of Borno and Adamawa States. In this context, CBM developed a project aiming to strengthen the resilience of vulnerable communities in North-Eastern Nigeria by building inclusive health services, WASH services and promoting disability inclusion. The project by CBM in collaboration with five local organizations in nine target LGAs in Borno, Adamawa and Yobe States received a 100% funding commitment of 2.3 Mio EUR by the German Federal Ministry of Economic Cooperation and Development (BMZ) between November 2018 and December 2021 (38 months)[1]. Being financed under the title BMZ Transitional Development Assistance, the project responds to the main areas of reconstruction and (re-)integration of refugees and Internally Displaced Persons in the target LGAs. A comprehensive baseline study was conducted in the first project year and the targeted number of direct beneficiaries was 401,149 persons, that of indirect beneficiaries 1.8 million persons across the three States.

The project aimed at achieving 3 specific results:

Result 1:

Vulnerable population/communities including persons with disabilities are provided with quality and inclusive health services. (implementing partners: CCMHP and COCIN)

Result 2:

Households in targeted communities have access to disability-inclusive WASH services. (implementing partners: GreenCode, JPRM and TAIMAKO)

Result 3:

Civil society and political actors implement measures to include people with disabilities. (implementing partners: all five partners)

According to their technical focus, the partners’ project-related work is structured as follows:

• CCMHP: Community Mental Health in Adamawa, Borno and Yobe States
• COCIN: Eye Health in Adamawa, Borno and Yobe States
• GreenCode: WASH in Borno State
• JPRM: WASH in Adamawa State
• TAIMAKO: WASH in Yobe State
• CBM: Disability inclusion in Adamawa, Borno and Yobe States

2. Evaluation Objective, Scope and Intended Use

Towards the end of the project, CBM and project partners intend to conduct an external final project evaluation defining and analysing the achievement made within the project, the stakeholders involved, the prerequisites for a successful transition strategy achievement and outline possible risks or concerns for response action.

Specific Objectives:

1. To evaluate the impact of the project’s affected communities in the context of ongoing insurgency in Borno, Adamawa and Yobe (BAY) States.
2. To create a common understanding of gaps, ongoing or intensified needs for possible future interventions within the project target locations.
3. To identify existing capacities and resources of persons of concern, especially of persons with disabilities, including positive and negative coping mechanisms, as well as partners and governments etc.

The scope of the evaluation will cover activities implemented by all 5 partners (COCIN, CCMHP, GreenCode, Tamaiko and JPRM between November 2018 and date of the evaluation.

2.1. Target audience and intended use

This evaluation is being carried out as part of the programme development requirements. Its outputs will be used by a variety of stakeholders for different purposes:

v Implementing partners will use the findings from this evaluation

ü to understand the impact of the programme on different project stakeholders and beneficiaries

ü to enhance sustainability of the programme

ü lessons learned will be used to inform future planning and design

Government:

v CBM will use the information from this evaluation

ü to inform the way in which CBM can work with government to establish accessible, quality and sustainable services to the communities

ü to guide provision of technical support to future projects.

ü to improve the overall quality and impact of CBM’s work.

The evaluation will make an intentional effort towards ensuring that the project target groups (Government Agencies, sector working groups, implementing partners, community stakeholders, beneficiaries/participants and CBM team) gain access to the evaluation reports for internal/external consumption. It will further reveal the level of project attainment and accountability procedures demonstrated during project implementation to inform better and informed learning that could be used for future planning and project/program designs.

3. Evaluation Questions

**

3.1 Relevance, quality of design and appropriateness:

**

1. To what extent did the objectives and implemented activities meet the needs and priorities of the beneficiaries?
2. Were the strategies used during project intervention the most suitable for achieving intended outcomes?
3. Did the project effectively reach the most vulnerable households with focus on person with disabilities?

3.2 Coherence

· How did government bureaucracy affect the project targets and smooth implementation?

· Are there policies/norms that have hindered the smooth implementation of the project across Borno, Adamawa and Yobe States?

· Were there challenges encountered between implementing partners and other sister organizations as a result of context

· How has the project contributed towards the achievements of the Humanitarian Response Plan?

· Are beneficiary’s/participants capacities built for the sole purpose of sustainability

· What did sister organisations and government agencies benefit from during the project intervention.

3.3 Effectiveness:

1. To what extent were the expected outputs and outcomes achieved?
2. Were activities implemented as planned? If not, reasons for it.
3. Was the project sufficiently adaptable to a fluid and insecure context to deliver outputs in a timely fashion and sufficiently achieve targets?
4. Were the monitoring mechanisms effective in providing timely data to inform programming decisions?
5. What factors contributed to as whether or not activities led to intended outputs and outcomes?

3.4 Efficiency or cost-effectiveness (of planning and of implementation):

1. Are overall costs and resources used for the delivery of the intervention justified or would a different methodology of project delivery have achieved more and better results?
2. Was adequate human, financial and logistical resources applied to delivering project outcomes? Could the project outcomes have been achieved at a lower cost?
3. Were outputs delivered in a timely fashion?

3.4 Impact – Contribution to change:

Impact: what is the project impact to the local community?

1. What changes took place as a result of the project implementation whether positive or negative?
2. Were the project’s intended goals achieved?
3. Were any unintended change (s) achieved (positive or negative)?
4. What factors affected the achievement of intended outcomes or otherwise?

3.5 Sustainability:

It includes an examination of the financial, economic, social, environmental, and institutional capacities of the systems needed to sustain net benefits over time. Involves analyses of resilience, risks and potential trade-offs. Depending on the timing of the evaluation, this may involve analyzing the actual flow of net benefits or estimating the likelihood of net benefits continuing over the medium and long-term.

1. To what extent is it possible to scale up the project beyond the project areas to other communities and states.

2. Identify and propose procedures to ensure that the benefits of disability inclusive awareness and practices continues in the long **

3.6 Gender:

· The study shall consider gender aspects of the project and report on the equal participation of women and men, of boys and girls in the project, how their specific needs have been addressed and how they benefitted from the intervention. Data collected should be disaggregated according to sex, age, and disability.

3.7 Child Safeguarding

The evaluation shall assess what type of safeguarding mechanisms have been put in place and how they were practically implemented – this concerns children, children with disabilities and adults at risk/with disabilities. The report will show how and whether children/adults at risk in the target area were protected from abuse and maltreatment and prevented from practices harmful to their health and development in the course of project implementation.

3.8 Disability Inclusion:**

1. How have target groups been identified and was this appropriate in the fragile and changing environment?
2. To what extent were persons with disability actively engaged in the entire project process and management?
3. How did their involvement or non-involvement affect the achieved outcomes?
4. To what extent were the services accessible to persons with disabilities?
5. To what extent were persons with disabilities empowered and benefitted from the project.

4. Methodology

The consultant will develop the detailed evaluation methodology based on this TOR and a briefing with CBM. Mixed methods shall be applied and the methodology used shall fit the purpose of the evaluation and needs to be documented in detail as annex to the final report.

the consultant is expected to submit a brief inception report detailing methodology for achieving the results of the study. The evaluation must meet the principles of being inclusive, participatory and interactive, involving both male and female members of the community.

As a minimum, the evaluation process should include the following key steps:

· Desk review of relevant documents

· Initial briefing sessions with CBM Country Office.

· Application of specific data collection tools.

· Analysis of findings

· Reporting of findings and recommendations

The data collected are disaggregated according to gender, age and disability.

As regards confidentiality or data protection, the consultant must take all reasonable steps to ensure that the respondent is not adversely affected by taking part in the evaluation. S/he must keep their responses confidential, and must not do anything with their responses that they are not informed about at the time. Also, particular care must be taken with children and teenagers. Permission must be granted from a parent or responsible adult, such as a teacher, for interviews with children aged under 18 and CBM’s child safeguarding policy should be applied in all circumstances. The consultant should create safe spaces for women and other vulnerable groups to participate in group discussions or interviews.

Following data collection and analysis, the consultant will share preliminary findings with CBM CO in Nigeria. This shall be achieved through debrief sessions at CBM CO. The sharing of preliminary findings is an opportunity for the stakeholders to hear what the consultant has found and to be involved in thinking through recommendations. It should include constructive discussions around the key findings identified by the evaluation.

5. Limitations and potential risks

Several factors, particularly the ongoing COVID-19 pandemic and prevailing safety and security risks in North-Eastern Nigeria may affect the initially agreed schedule and possibilities of intervention in the target areas. Security conditions of some project locations remain dynamic, which might limit access to beneficiaries for data collection. E.g (Kaga LGA in Borno State, Gujiba LGA in Yobe State & Garkida in Gombi LGA of Adamawa State)

CBM will carefully evaluate the situation once the evaluation contract is signed and determine whether the evaluation can be carried out as planned.

For infection control, a number of precautionary measures (use of face masks and disinfectants, physical distance etc.) will be taken. In addition, CBM will provide a briefing on the current COVID-19 and security situation and support as much as possible to ensure the health and safety of the evaluation team and other stakeholders who will be involved in the evaluation process, including project partners and beneficiaries.

6. Evaluation Team and Management Responsibilities

6.1. Commissioning responsibility

· CBM will be responsible for monitoring and supervising the evaluation and checking that quality standards are met, ensuring the evaluation conclusions and recommendations are communicated effectively. The evaluation team will be identified and approved by CBM.

6.2. Evaluation Team

Consultant

S/he will be an experienced consultant, who will be responsible for the overall evaluation process and the production of the evaluation report.

Required Expertise

· Advanced degree in public health, humanitarian, development, social science or other relevant fields.

· Minimum of five years’ experience in conducting evaluations and two years’ experience in conducting evaluations in humanitarian settings.

· Understanding of emergency situations, monitoring processes, adaptation and evaluation.

· Analytical skills and ability to clearly synthesise and present findings in a concise and logical sequence.

· Ability to draw practical conclusions and to prepare well‐written reports in a timely manner.

· Awareness and sensitivity to the particular needs of persons with disabilities including psychosocial disability, women and children is desirable

· Knowledge of the culture of the peoples in Borno, Adamawa and Yobe States will be an added advantage.

· Consultants and data collectors must be able to speak and interpret Hausa language to English language

Child Safeguarding Policy: As a condition of entering into a consultancy agreement the evaluators must sign the CBM Child Safeguarding Policy and abide by the terms and conditions thereof.

· The contracted consultant adheres to CBM Code of Conduct and commits to CBM’s Child Safeguarding Policy.

· Related Statements of the above have to be signed together with the contract.

· The consultant also commits to highest standards of data security.

· CBM is an equal opportunities employer, and particularly encourages qualified people living with disability to apply.

6.3. Management of the evaluation and logistics

Responsibilities of the consultant

· The consultant will develop an inception report for review by the CO and Initiatives and approval by CBM CO.

· The draft evaluation report will be shared with CBM for review and feedback. The final evaluation draft will also be sent to CBM for approval and sign off. The final instalment of consultant’s fees will be disbursed following sign off.

· The consultant will be responsible for all logistics arrangements, flight, vehicles, accommodation and disability inclusive venues for interviews and group discussion, as well as for training of data collectors as needed.**

· The consultant will be responsible for the arrangements of all data capturing tools/devices for the data collectors.**

· The consultants will ensure that all data collectors have the basic skills to translate English into local languages used in areas of interventions, for easy understanding of the respondents.**

CBM’s Responsibilities

· Contract the consultant;

· Oversee the implementation and quality of the evaluation;

· Provide project specific documents (Approved Project Narrative & Baseline study Report)

· Review and approve inception report

· Monitor and assess the quality of the evaluation and its process

· Provide guidance and institutional support to the external consultant

· Facilitate access to study areas;

· Participate in research findings workshop

· Review draft feasibility report

· Pay the consultant based on the agreed terms and conditions specified in the expression of interest

· Approve the final report; all products related to the evaluation shall be submitted to CBM Nigeria at the end of the assignment and upon approval of the final report.

Implementing Partner’s Responsibilities

· Facilitate the consultant’s access to key stakeholders and specific information or expertise needed to perform the assessment;

· Ensure that all stakeholders are kept informed;

· Support in research findings workshop;

7. Expected Results

INCEPTION REPORT

The Consultant is expected to submit an inception report latest 2 weeks after receipt of all background documentation. The purpose of this report is to ensure that the consultant covers the most crucial elements of the exercise including the appropriateness and robust methodology to be employed as well as gender and diversity representation and participation of different social groups for inclusive analysis of needs.

The inception report provides the organization and the evaluation team with an opportunity to verify that they share the same understanding about the evaluation and clarify any expectations at the outset. The report should reflect the evaluation team’s review of literature and the gaps that the field work will fill. The report should also reflect opportunities for participation of people with disabilities in the development of methodology, data collection and analysis

Final REPORT

The draft evaluation report (in easy to understand English and in accessible format) with a maximum 30 text pages (+ annexes) must be submitted to CBM Country Office within 3 weeks after completion of the field phase. CBM will provide feedback which has to be incorporated within 2 weeks.

The evaluation report is an exclusive property of CBM and should not be released without prior authorization to any other party. The final report will be available through CBM.

DATA SETS

The Consultant will be expected to submit complete data sets (in Excel) of all the quantitative data as well as the original transcribed qualitative data gathered during the exercise. These data sets (filled consent forms) should be provided at the time of submission of the final report.

SUMMARY FINDINGS

On submission of the final report, the consultant is expected to submit a PowerPoint presentation (maximum 12 slides), summarizing the key findings and main recommendations. This should be submitted together with the final report.

8. Duration and Phasing

Proposed Time Frame **

1/02/2022 to 30/02/2022

Duration of Activities

The duration of the evaluation exercise shall be 30 working days. The evaluation will follow the key phases:

Phase I – Desk study: Review of documentation, elaboration of inception report, and development of evaluation tools

The consultant will review relevant documentation. Based on this review, S/he will produce an inception report which will include an evaluation plan, methodology and sampling strategy of the data collection for evaluation.

Phase II: Field Data Collection

This phase of the evaluation will seek to collect primary data. The evaluation team will use the agreed plan, methodology and sampling strategy from phase 1 to conduct the field work.

Phase III – Data analysis and production of evaluation report

The evaluation team will draw out key issues and produce a comprehensive report. This analysis should draw on the wider issues in the humanitarian sector. A Power Point presentation of the analysis and findings from the evaluation is also envisaged.

The table below summarizes the key activities outlined above

Task

Location

Expected Dates

No of Days

Desk research /literature review

Anywhere

1-2/02/2022

2 day

Submission of Inception Report

CBM Country Office

3/02/2022

1 day

Development of evaluation tools

CBM Country Office

4/02/2022

1 day

Field Visits & data-collection

Project sites

5/02/2022- 20/02/2022

16 days

Presentation of initial findings to CBM

CBM Country Office (via email)

21/02/2022

1 days

Data analysis and preparation of draft report

Anywhere

22/02/2022– 26/02/2022

5 days

Submission of draft report

CBM Country Office (via e-mail)

27/02/2022

1 day

Review of draft report after feedback from CBM and partners

Anywhere

28-29/02/2022

2 days

Submission of final report

CBM Country Office

30/02/2022

1 day

30 days

9. Costs and payments

· Signing Contract: First advance of 10%

· Submission of inception report: Second advance of 30%

· Approval of all deliverables as stated above to CBM

· Final payment following receipt of invoice from consultant (60%).

10. Application

Qualified evaluator should submit via email:

· A cover letter indicating interest

· Curriculum Vitae of the expert/s

· A short summary of your understanding of the TOR

· A technical offer, which must include a detailed suggestion on the evaluation approach/methods, the plan and the timeframe.

· A financial offer, including daily professional fees for each consultant, any other costs related to the evaluation, including travel cost, insurance etc.

· At least two (2) previous evaluation reports

· A statement of availability of all team members during the suggested time frame – CBM may terminate the contract in case the suggested expert is unavailable after signature of the contract and if no adequate consultant with the same expertise can be nominated and agreed with CBM and the partners.

11. Attachments

· Logical framework

· Annual Narrative reports

· Baseline reports

· Project Narrative

Evaluation Standards and Quality Criteria for Consultants

Regarding the selection criteria, the technical and financial proposals will account 70% and 30% respectively. The main evaluation criterions of the technical proposal are: evaluation methodology (20%), team composition/key personnel (20%), professional experience (10%), experience relevant to this evaluation (10%), experience/contribution in the region (5%) and nationality (5%).

Appendix: Stakeholder Analysis for Evaluation.

Stakeholders

What is their interest and contribution in the proposed project?

What is their power and influence in the project (1-5 rating, 1=low, 5=high)

Are these stakeholders going to be involved in the evaluation? How?

Primary Stakeholders

e.g. Women and men with disabilities

They are also beneficiaries of the project and often time they play a major role as community volunteers and project influencers

4

Yes

e.g. Girls and boys with disabilities

They are the main target of the project intervention, considering their vulnerability status, they contributed towards the achievements of the project

4

Yes

Secondary stakeholders

e.g. Mothers, fathers, care givers

They play a vital role to the project, some of them are beneficiaries or community influencers.

5

Yes

e.g. Volunteers

They also provide support to the project either directly or indirectly, their support is immeasurable.

2

Yes

e.g. Local Government

They are good stakeholder and gate keepers of the project locations, they assist in integrating partners and the locals.

4

No

e.g. Board of partner organisation

Administrative support are duly provided by them and sensitive discussions are mostly done with the board.

4

No

e.g. Central Government

They regulate activities of organisations and provide the required support.

3

No

e.g. Community

They took ownership of the project through the provision of support and acceptance of the project

5

Yes

e.g. NGOs

They help in ensuring a good coordination of activities in project location and to mitigate duplications.

2

No

e.g. Project staff

They are saddled with the day to day activities of the project.

5

Yes

e.g. CBM staff

They provide technical support in project implementations

5

Yes

· The consultant commits to adhere to CBM’s Code of Conduct and commits to CBM’s Child Safeguarding Policy.

· The consultant also commits to highest standards of data security.

· Related statements of the above have to be signed together with the contract.

· CBM is an equal opportunities employer, and particularly encourages qualified women and people living with disability to apply.

If you have any questions about the terms of reference, please send your queries to [email protected].

Annex 1: Structure of the Feasibility Report

Feasibility Study in preparation for the Comprehensive and Inclusive Eye Health Project for Jigawa, Nigeria

1. Introduction
2. Purpose, use and methodology of the study
3. Methodology
4. Situation and problem analysis
5. Target group and stakeholder analysis
6. Planned project according to the OECD/DAC criteria
7. Recommendations

Annexes:

• ToR
• Interview list
• Focus group documentation
• Tools (interview questionnaires etc)
• Consulted documents

[1] An official 4-month no-cost extension until 04.2022 was granted by BMZ in 2021. The official project duration subsequently increased to 42 months.

How to apply

Mode and Deadline for submission

1. HARD COPY: The information can be sent via hardcopy to the CBM International Country Office located on No.13 Okemesi Crescent, off Twon Brass Street, Garki 2, Abuja- FCT, Nigeria, in a sealed envelope marked “Statement of Interest: Evaluation Consultant**”.** **

2. SOFT COPY VIA EMAIL: Proposals can also be submitted by email to the following dedicated, controlled, & secure email address: [email protected] using the “Statement of Interest: Evaluation Consultant**”** as the subject of the email.

Deadline for receiving both the hardcopy and soft copy applications is Monday 31^st January 2022 by 5:00pm.

Failure to comply with the mode and deadline for submission would result in automatic disqualification of the proposal.