BACKGROUND
The German NGO Johanniter-Unfall-Hilfe eV (JUH) is a non-profit, non-governmental organization founded in 1952. Its headquarters are in Berlin, Germany, and it operates in the fields of health and social services. In Germany, Johanniter has 30,000 employees, 46,000 volunteers, and approximately 1.2 million sponsoring members.
At the international level, the JUH (Johanniter International Assistance) carries out humanitarian aid and development cooperation projects in 23 countries in Africa, Asia, and Latin America/the Caribbean. Funding comes primarily from the European Union, the German government, and private donations. In the LAC region, development cooperation and humanitarian aid projects are implemented through local partners.
Until the end of April 2025, the JUH Colombia Office is implementing a development cooperation project with the Colombian NGO CIASE (Corporación de Investigación y Acción Social y Económica) and the women’s organization “Red de Mujeres Chaparralunas por la Paz” (Chaparral Women’s Network for Peace) in the Tolima department (Chaparral municipality), entitled: “Collective initiatives for micro-entrepreneurship and promotion of peaceful coexistence of Indigenous peoples and small farmers, Tolima Department (Colombia).” At the end of the project, a team of consultants will be hired to conduct a final external evaluation of the project.
PURPOSE AND SCOPE OF THE FINAL EVALUATION
- Analyze and evaluate the level of achievement of the objectives achieved according to the indicators established in the project’s logical framework, the activities implemented, and the methodology and instruments used to achieve them. In this context, the unmet objectives and unexecuted activities should also be analyzed, identifying the reasons and lessons learned for similar projects.
- Analyze and evaluate the project (and project management) against the OECD/DAC criteria: relevance, effectiveness, efficiency, impact, and sustainability.
- Identify good practices and lessons learned related to the main themes of the project:(1) Promote citizen participation and democratic processes through training measures and the creation of spaces for dialogue.(2) Creation of alternative sources of income through the promotion of 4 productive initiatives and one community tourism initiative.(3) Institutional strengthening of the local partner CIASE and the women’s network “Red de Mujeres Chaparralunas por la Paz” to improve impact and create new sustainable alliances at all levels.
- Describe achievements, difficulties and specific findings in the implementation and lessons learned from the project.
- Describe skills or knowledge acquired by local partners during the implementation of the intervention that can serve them in the long term.
- Develop conclusions and recommendations for future projects.
Final evaluation criteria and questions:
Relevance: The Final Evaluation will assess the level of achievement through the coherence and relevance of the implemented activities, objectives, and results with respect to the needs and challenges of the target group, as identified in the project proposal. The following questions will be analyzed:
- To what extent does the intervention design respond to the needs and priorities of the target group and the intervention area? Do you believe the project contributes to reducing the gaps and addressing the identified challenges?
- Is the project aligned with Colombia’s public strategies/policies (national, municipal), as well as Johanniter’s global/regional strategy?
- To what extent have beneficiaries participated in decision-making regarding their own development? Analyze participation and decision-making, disaggregating it by gender, age, and ethnicity.
Efficiency: The Final Evaluation will assess the results achieved by component compared to the resources used (human resources, finances, materials, assets, etc.). The following questions will be analyzed:
- Were the resources used in the project used economically and in a timely manner in relation to the activities carried out and the results obtained?
- Have the local partner’s project management mechanisms worked, taking into account the following: (1) decision-making, (2) articulation and coordination between the work team, (3) supervision and internal control, (4) monitoring and evaluation.
- What contribution did the target group or third parties make to the implementation of the activities and the objectives achieved?
Effectiveness: The Final Evaluation will analyze and assess the degree of achievement of objectives and results, as well as the causes that influenced this level of achievement. The following questions will be analyzed:
- To what extent were the objectives achieved according to the project’s logical framework?
- What factors influenced the achievement or failure of the objectives? Please conduct a SWOT analysis!
- Are unexpected results or objectives appearing?
Impact: The Final Evaluation will identify the impacts generated by the intervention, whether positive or negative, expected or unexpected, direct or indirect, and induced or collateral. The following questions will be analyzed:
- What were the positive or negative, expected or unexpected, direct or indirect, induced or collateral, and unintended impacts of the project? Please describe and evaluate them!
- Has the project, through its strategies, managed to build meaningful spaces for dialogue and citizen participation?
- Has the project had an impact on public policy at the national and/or local level?
Sustainability: The Final Evaluation will analyze and assess the project’s economic, structural, social, and ecological sustainability. The following questions will be addressed:
- Were the measures implemented able to guarantee the economic, structural, social, and ecological sustainability of the intervention project? Please provide specific examples!
- What alliances and synergies (e.g. cooperation between private and state actors, transregional cooperation, etc.) were created or strengthened by the project?
- Are there commitments from the target group or other key stakeholders?
Additional questions:
Gender and intersectionality
- Has the project taken into account the differences between women and men, girls and boys, in terms of their relative distribution of resources, opportunities, constraints, and power in a given context?
- Has the project been developed in a way that contributes to women’s equality and/or the empowerment of women and girls, the reduction of gender discrimination or inequalities, or the meeting of gender-specific needs?
Suspension of intervention in the Vichada Department
- Analyze the cause of the suspension of project execution in the Vichada Department, verifying the factors that contributed to it (e.g., unforeseen challenges, technical capacity and/or resource limitations, changes in the social, political, and security environment in the intervention area).
- Identify the key knowledge gained and lessons learned, and the strategies, tools, and/or methodologies applied in the second phase of the project and/or similar projects.
- Share specific examples of how you’ve implemented changes in project coordination and management, risk management, or team collaboration to mitigate the risks that led to previous errors.
- Provide additional recommendations to avoid similar problems in future projects.
FINAL EVALUATION SCOPE, ACTORS INVOLVED AND WORK METHODOLOGY
Temporal Scope
Regarding the timeframe, all project components will be evaluated from November 1, 2022, to April 30, 2025.
Geographical Scope
The geographic scope of the final evaluation includes the department of Tolima, the municipality of Chaparral with the following villages: (1) El Limón, (2) Cañón de las Hermosas, (3) Calarma and (4) La Marina. The direct target group was composed of approximately 1,105 people (912 women/193 men).
Actors involved
The target group will play a key role during the Final Evaluation, as they will be the primary informants in the analysis of quantitative and qualitative changes in their living conditions and other aspects related to the project. Other stakeholders who will play a key role in the Final Evaluation are listed below:
- Direct and indirect target group, in particular the organization “Red de Mujeres Chaparralunas por la Paz”
- Technical/administrative team of the CIASE partner
- JUH Colombia Office Team
- Other relevant actors (private/state)
Working methodology
Evaluation planning phase:
- Conduct a kick-off meeting between the consulting team, CIASE partner project staff, and JUH Colombia office staff to provide the consulting team with essential information and documents, as well as important contacts (target group, other relevant stakeholders), agree on deadlines, and clarify any questions or ambiguities.
- Document review of the project.
- Develop and present the work plan, including the methodology to be used, work schedule, methodological instruments, and planned sources of information.
Evaluation execution phase:
- Gathering qualitative and quantitative information using a participatory approach that considers the social, political, economic, and institutional context, as well as cross-cutting and intersectional aspects.
- Recommended methods, among others, are: (1) Document review/review of secondary information, (2) Surveys and interviews, (3) Participatory workshops, (4) Focus groups, (5) Meetings with key stakeholders, (6) Field visits.
- At least one participatory workshop with the technical teams of the CIASE project and JUH Colombia Office on the preliminary results of the evaluation.
- Observations.
- Analyze and process the information collected, answering the questions mentioned in the “Purpose and Scope of the Final Evaluation” section of the TOR.
Report preparation and delivery phase:
- Write and present the draft of the final report to the technical team of CIASE and JUH Colombia Office.
- Submit the final report, which will include an executive summary not exceeding 15 pages.
Results feedback phase (accountability):
The consultants responsible for conducting the final evaluation will organize a virtual workshop to share the evaluation results with the key stakeholders (implementing partners and project partners).
During the Final Evaluation, periodic coordination and follow-up meetings will be held between the consultants, CIASE, and JUH Colombia Office to ensure a timely and targeted analysis.
PRODUCTS TO BE DELIVERED
- Work plan, which includes a review of existing project management documentation, methodology (tools for collecting, analyzing, and processing information), schedule, planned activities, and a proposed report table of contents.
- Preliminary Report of the Final Evaluation.
- Final Evaluation Report of a maximum of 30 pages (with an executive summary of a maximum of 15 pages). Furthermore, the Final Evaluation Report will be prepared using the BMZ structure (annex “BMZ Final Report Structure”), which must contain:
- Clear statements on the criteria and issues according to the TOR of the Final Evaluation.
- Concrete recommendations for similar future projects.
- Annexes (all tools developed, list of participants in each workshop or meeting, sources of information, among others).
ESTIMATED DURATION OF THE FINAL EVALUATION
The Final Evaluation, feedback phase, and final report submission are estimated to take up to 30 days from the date of contract signing. After JUH completes the consultant team selection process, the evaluation will begin no later than April 28, 2025.
REQUIRED QUALIFICATIONS AND EXPERIENCE OF THE CONSULTING TEAM
We are looking for a team of consultants with the following profile:
- Professional(s) in social sciences, politics and/or human rights or related fields are required.
- Demonstrated complementary training and professional experience of at least three (3) years in the evaluation of development cooperation projects and similar thematic approaches in Colombia and/or the Latin American region.
- Demonstrable experience working with participatory methods, using both quantitative and qualitative techniques.
- Desirable: knowledge of the intervention area.
- Availability for temporary travel to the intervention area (Chaparral, Tolima).
Skills:
- Ease of verbal and written expression.
- Sensitivity and commitment to cultural diversity.
- Ease of communicating with people from different backgrounds and educational levels.
- Responsible and proactive.
TERMS AND CONDITIONS
Contract: Provision of Services – Consulting
Execution date: possibly last week of April 2025
Duration: 30 days
Regional scope: Bogotá and Chaparral municipality (Department of Tolima) in four (4) villages La Marina, El Limón, Las Hermosas and Calarma.
SELECTION CRITERIA
Only technical and financial offers that meet the call deadline and the requirements of the Terms of Reference will be evaluated, taking into account the following:
- Training and professional experience: 30%
- Professional experience in implementing final evaluations: 30%
- Economic offer: 30%
- Interview results (if applicable): 10%
How to apply
SUBMISSION AND RECEIPT OF OFFERS
Interested parties can send their technical and financial offers to the following email address: [email protected], with the subject line “Final Evaluation Consultant COL0106.” Deadline: April 23, 2025, (6:00 p.m.).
The offer must be accompanied by:
- Cover and motivation letter (max. 1 page).
- Technical offer, including work plan and methodology (max. 2-3 pages).
- CV (consultant/consulting team, each CV max. 2 pages).
- Economic offer (max. 1 page).
- Copy of personal identification document and RUT.
Note: Johanniter has established policies and principles (including a code of conduct, safeguards, and PSEAH) that govern our ethical, social, and legal conduct. These standards and principles apply to all employees, service providers, and volunteers who work with us. We strive for inclusion, diversity, and gender equality in all our work.
