Deadline Date ‎2022-‎05-‎31# Details:
Consultancy Title : MoFA Lux Project - Application for Endline Evaluation
Consultancy
Project Title : Improving access to essential Reproductive, Maternal, and
Neonatal healthcare services for post-war vulnerable populations in West
Mosul, Nineveh Governorate, Iraq.
Project Location : West Mosul (Al-Batool Maternity Hospital)
Consultancy Start date : June ‎5, ‎2022
Consultancy End date : June ‎30, ‎2022
Consultancy Duration : ‎20 days
Reporting To : Health Project Manager and MEAL Coordinator at CARE
International in Iraq.

Project Description

With funding support from the Ministry of Foreign Affairs, the Government of
Luxembourg (MoFA Lux), CARE implemented a twelve-month project from 1st of
July to 30th of June ‎2022. With the intervention, the project aimed to improve
Reproductive, Maternal, and Neonatal Healthcare and protection services for
the increased number of new arrivals due to camp closure and vulnerable
population affected by the conflict in Mosul, Nineveh Governorate, while
enhancing medical capacities and service provision of the selected hospitals
to respond to the increasing number of needs.
Overall, the project was aiming to address the medical infrastructure and
staff capacity deficiencies for Al-Batool hospital while building its
capacities to save maternal and neonatal lives. Outreach activities enhanced
community appreciation of reproductive health issues, prevented the spread of
COVID-‎19 per the WHO guidelines while disseminating information on services
available at the health facility, awareness on protection, and how to access
protection services to increase utilization.
The overall project outcomes are: ‎1) access to specialized Sexual,
Reproductive, and Maternal Health services is improved through the provision
of essential medical equipment, kits, and consumables in Al-Batool Hospital,
west Mosul. ‎2) capacity of health staff enhanced and community awareness on
Sexual, Reproductive, and Maternal health and COVID-‎19 related topics are
increased and ‎3) psychosocial wellbeing of communities is enhanced through
gender and protection mainstreaming across the project activities.
The project targeted vulnerable and conflict-affected populations, internally
displaced, returnees and host communities in West Mosul and those who have
been affected due to the recent camp closures in the Southern part of Nineveh
Governorate, Iraq. The main service recipients of the SRMH services were
mainly women and girls of child-bearing ages. Men and boys were also targeted
to ensure gender mainstreaming and equality in service provision.
Awareness-raising sessions by the gender and protection team targeted all
community members. On the other hand, life skills sessions had their own
criteria, such as dedication to the completion of the curriculum and
endeavoring to ensure the participation of ‎15% of women and girls with
disabilities. On the other hand, the gender and protection mainstreaming
trainings targeted DoH staff and CARE’s own staff on the ground.

Purpose of the Endline Evaluation:

The purpose of the endline evaluation will be to assess the results of the
project in relation to its intended outcomes. It will assess the impact and
progress made by the project’s post-intervention in the targeted area against
indicators mentioned in the donor-approved project document. The endline
evaluation will help CARE measure the intervention's effectiveness and
efficiency of the planned outcomes by comparing the baseline values with the
endline results.
It will also consider criteria such as coverage, appropriateness, coordination
to evaluate the quality of the intervention, document the lessons learned, and
inform donor, beneficiaries and any other relevant stakeholders about the
results and findings.
Evaluation objectives
Specific evaluation objectives are indicated below:
‎1. To assess the results of the project at the outcome and impact level;
‎2. To generate key lessons and identify promising practices for learning;
‎3. To assess how CARE has been accountable to stakeholders with a focus on accountability to affected persons.
The evaluation team shall specifically document effectiveness, efficiency,
impact, sustainability, accountability and coordination and lessons learning.

Scope of the Evaluation

The evaluation is expected to cover all the thematic areas of the project,
that is to say, health and protection. In addition to key stakeholders, all
beneficiary categories will be sampled, including men, women, boys and girls.
Timeframe: this evaluation needs to cover the entire project duration i.e.,
from 1st of July to 30th of June ‎2022.
Geographic Coverage: West Mosul (Al-Batool Maternity Hospital)
The evaluation should cover the implementation period from the start of the
activity to June ‎2022. The geographical scope of the evaluation is mentioned
above. While the main emphasis should be on measuring outcomes/impact and
sustainability, the evaluation should also cover the project concept and
design, implementation, results, and outputs.
Evaluation Questions
Key criteria and questions to be answered by this evaluation include the
following:
Evaluation Criteria
|
Evaluation question

---|---

Effectiveness
|
§ Assess the extent to which the project met the expected targets for outcome
indicators, including targets on gender and protection. Where targets were not
met, explain the challenges faced.
§ Assess the performance of the project in terms of effectiveness, efficiency,
and timeliness of producing the expected outputs.

Impact
|
§ Assess accessibility to improved Reproductive, Maternal, and Neonatal
Healthcare services through a gender lens (i.e., ensuring that people of all
ages, genders and abilities, have equitable access to services).
§ Assess the extent to which the project met SRMH and protection needs, and
identify issues to be taken into consideration for future projects, including
gaps and improvements needed in SRMH and protection services.
§ To what extent have the community’s knowledge, attitude, practice, and
beliefs regarding sexual reproductive health and gender evolved since the
beginning of the project? What are the barriers in the uptake of key health
and gender practices, if any?
§ How did the project contribute to Gender and protection mainstreaming across
the project activities? Please provide any lessons learned. In your
description, please provide sex and age disaggregated data.

Sustainability
|
How are the positive changes going to be sustained after the project ends?

Accountability and coordination
|
§ Are CARE’s community feedback and complaints mechanisms functional? Do they
ensure equitable access and meaningful participation for community members of
all ages, gender and abilities?
§ What are the most common channels used to provide feedback and complaints by
target communities?
§ What are community members’ perceptions on using CARE’s feedback and
complaints mechanism.
§ How is feedback collected from communities integrated into project design,
implementation and continual improvement in the quality service provision?

Knowledge gained / lessons learned
|
§ How are lessons learned applied from the previous project and how will they
be applied in future projects or programs?
§ Based on the experiences or challenges that came up, what should the
organization do the same or differently in future similar projects?
§ What lessons can be learned to improve gender-sensitive approaches in future
projects?

Methodology
The national evaluation consultant is expected to articulate a robust and
suitable evaluation methodology in line with the scope, objectives and
evaluation questions and should adopt a mixed-methods approach integrating
quantitative and qualitative methods. It is expected that the consultant, in
consultation with the CARE MEAL Coordinator, will combine a desk-based review
of project data with Household survey in-depth interviews, focus-group
discussions, observation and key informant interviews. The methodology will be
agreed upon between the evaluator(s) and CARE and synthesized within the
Evaluation Framework.
Quantitative data collection tools:
A quantitative questionnaire should be used to interview the targeted
beneficiaries of the project. The questionnaires should consist of both open-
ended and closed-ended questions, which should provide essential quantitative
data related to project indicators and outcomes.
Observation tools:
In order to have a quality survey, quantitative sampling should be
complemented with observation tools. Observation tools should be used by the
data collection team during the interview. The observations should be made
regarding the SRMH, COVID-‎19, and gender practices. Observation tools should
be developed and used along with the survey.
Qualitative Data Collection tools (Focused Group Discussions Guidelines)
Focused Group Discussion guidelines should be developed, which will contain
essential qualitative questions to understand the causes of the problem and
the project’s contributions. The questions should be based on findings from
the quantitative study and should focus on substantiating the quantitative
results with the qualitative aspects.
Key informant interview
Key informant interviews should also be organized with the relevant key
stakeholder of the project, such as DoH, hospital management, protection
actors, and other relevant stakeholders; the objective of key informant
interviews should be to get the stakeholder perspectives on the project
quality, implementation, relevance, sustainability, and future needs, etc.
* FGDs (male & female project participants)
* Key informant interviews (DoH, Al-Batool maternity hospital management, female SH doctors, protection actors, and CARE staff)
* Other Humanitarian Actors within the Health cluster – UN agencies and INGOs.
Please note that in alignment with CARE’s ethical guidelines and survivor-
centred approach, the evaluation should not require participants to disclose
information about experiences of sexual and gender-based violence. However, as
interviews may lead to disclosures on SGBV, Assessment Team Lead must develop
list of services for signposting survivors prior to commencing the evaluation,
as well as organisational reporting mechanisms and safeguarding team contacts.
In addition, to ensure that participants feel comfortable, women and men
respondents must be matched with interviewers and enumerators of the same sex.
Sample Size
The consultant will be responsible for defining the sample size and
methodology for sampling in discussion with the CARE Iraq team. It is
recommended that the applicant propose a sampling strategy. The sampling
strategy should include the sampling method and the sample size calculation
values.
Priority will be given to individuals that were interviewed during the
Baseline survey; in case of absence or refusal of encountered HH, the
household will be replaced with alternative beneficiaries within the same
location.
In order to ensure that the HH survey is representative of all project
participants, the sample should include men, women, and children aged ‎12-‎17.
The Data Collection team should ensure that all survey respondents respond to
these questions without being influenced by any other member of the HH.
All primary data collected during the study must facilitate disaggregation by
gender, age, location or remoteness, and vulnerability status. CARE will
review and, where possible, provide more guidance on tools and classification
schemes for this minimum dataset.
A range of project documentation will be made available to the study team that
provides information about the design and changes made in the course of the
implementation, implementation and operation of the project].
The study team is required to adhere to the CARE’s Child Safeguarding;
Protection from Sexual Exploitation and Abuse; Anti-Harassment, Intimidation
and Bullying; and Data Protection and Privacy policies throughout all the
evaluation activities.
Timing of consultancy
Since the project location is only at Al-Batool maternity hospital in West
Mosul, therefore, it will be easier for access for the consultant to conduct
his/her tasks on time. Based on the experience of CARE, the total duration of
the evaluation will be (‎20) working days for inception, data collection, data
analysis and reporting phases.
The consultancy is planned to start on June ‎5, ‎2022 with the following
indicated total and breakdown of days: however, CARE is expecting the
consultant to submit the timeframe and detailed planning of endline
evaluation.
Duration of Contract (working days) including travel
|
Inception report, desk review, design of data collection tools and finalizing
sampling and evaluation methodology.
|
‎5

---|---|---

Fieldwork (i.e., training of enumerators, KIIs and supervision of data
collection, working days excluding weekends.
|
‎10

Data cleaning, validation, analysis and reporting.
|
‎5

Total
|
‎20

Roles & Responsibilities

Responsibility of CARE:

• CARE will ensure effective administrative support for the evaluation and provide inputs into the assignment process, as determined by the agreed methodology.


• CARE will make available preparatory documentation on the project.


• CARE will assist in recruiting data collection enumerators, as appropriate.


• Share information on CARE’s gender-sensitive and survivor centred approaches, e.g. Gender and Protection Audit, disclosure and sign-posting, risk of retraumatisation, risk of SGBV.


• Avail pertinent program and organizational documents to the consultant.


• Facilitate coordination support, including linkages with the potential partner, organizing meeting appointments with selected interview respondents


• Review draft data collection tools and provide feedback.


• Provide tablets for data collection for all project locations.


• Set a schedule and organize regular calls with the consultant during the assignment.


• Support data validation and authentication process as appropriate.


• Provide consolidated feedback on the draft of the endline evaluation report.


• Approve and disseminate the report


• Administer the contract and issue payments based on the agreed schedule.
  The Consultant will be responsible to:


• Conduct desk review (Project document, Implementation work plan, interim project reports, reports on project activities, relevant national policy documents from the cluster, baseline, previous project endline, etc.)


• Prepare inception report and tools (Questionnaires for the survey, the guideline for the survey, observations tools, FGD tools, and guidelines, etc., building upon tools from the baseline review)


• Designing the endline evaluation methodology.


• Ensure Gender mainstreaming into the whole evaluation.


• Implement the agreed methodology in consultation with all relevant stakeholders, ensuring the integration of gender-sensitive and survivor-centered approaches.


• Communicate with CARE’s focal point for updates and clarifications as necessary while highlighting challenges that CARE may be able to assist in resolving.


• Provide technical guidance and training on the data collection processes to the data collection team through the CARE Health and Gender & Protection Manager as appropriate


• Supervise data collection and enumerators on the project site.


• Conduct interviews with CARE and other stated stockholders.


• Analyze data sets (Data review, cleaning, and analysis – choose appropriate software for data analysis).


• Write the endline evaluation report – draft and revise based on feedback from CARE.


• Presentation of preliminary evaluation results to CARE and selected key project stakeholders.


• Submit the final report incorporating all feedback received in soft cop
  Deliverables
  The consultant should provide a debriefing before submitting the final report
  in line with the above-stated objectives and detailed scope. The output of the
  mission will be the End line Evaluation Report in English, using Microsoft
  Word (A4 paper, font size ‎11 and font “Fira sans condensed”) with findings
  including lessons learned and best practices sections and consolidated
  qualitative and quantitative information that support the implementation of
  the project.
  The structure and content of the report should meet the requirements of the
  CARE Monitoring and Evaluation Policy. The intended users of the report are
  the CARE team, the donor agency, and other key stakeholders involved in
  project implementation. The consultant should provide a draft of the Endline
  Evaluation report in English to CARE International in Iraq with the following
  structure:


• Executive Summary that summarizes understanding of the TOR (introduction, study background and rationale, methodology, key findings, and program implications).


• Section One: (to include: Study Background and Rationale, Description of program interventions, methodology, evaluation limitations),


• Section Two: Evaluation (findings for components provided under the scope of the endline survey)


• Section Three: (Specific conclusions and actionable recommendations for Project strategies and activities to enhance project impact).


• Annexes (questionnaire and qualitative tools, including sampling frames; etc. – This should not exceed the ‎25 pages report)


• Final recommendations for project interventions with the above structure and content meet the CARE Monitoring and Evaluation guideline requirements.


• Raw data set for quantitative and qualitative data collected
  The presentation of data in the findings section should be in the form of
  tables and graphs for easy use. To use any images, the consultant must ensure
  that appropriate consent has been obtained and observe appropriate ethical
  requirements for such studies. Endline evaluation survey protocol and data
  collection tools should include and are not limited to proxy data, statistics
  on regional/state level, HH questionnaire, FGD checklists, KII and women and
  adolescent girls’ panels, and observations that will be shared with the CARE
  technical team for review before adoption.

Required Qualification

• Advanced degree in relevant field MEAL (statistics, social science)


• Extensive experience in undertaking studies and assignments, preferably related to Health and protection research.


• Previous experience in reviewing gender mainstreaming in project stages (Identification, Design, Implementation, Evaluation / Monitoring).


• Proven experience in undertaking KAP surveys/project evaluation


• Solid knowledge and experience in assessing the evidence of benefits for women and changes in gender relations


• Knowledge of the relevant thematic area in the humanitarian context is required


• English essential; Arabic skills would be helpfulIf you are interested in this role, the applicant must submit the following
  documentation in the English language (including):


• Lead consultant CV


• Cover letter: the lead consultant is expected to highlight relevant experience in undertaking similar assignments in a cover letter


• A Technical and Financial proposal detailing how the consultant meets the requirements above; including, cost quotation, description of sampling design/strategy, potential risks, research policy and ethical standards the consultant is dedicated to following and a detailed timeline (using the broad timelines provided in the TOR), understands and interprets the purpose and objectives of the evaluation; proposed approach and methodology; the consultant’s unique added-value or comparative advantage; and a summary of past assignments of relevance.
  Applicants meeting the above criteria are invited to submit their application
  to CARE procurement team ( [email protected] ) no later than May ‎31, ‎2022.
  with the Subject: “ _ _MoFA Lux Project - Application for Endline Evaluation
  Consultancy__ ” in the subject of your email.
  Note that the cost quotation should include the consultant’s daily rate as
  well as any materials and travel costs required for the consultant to complete
  the analysis outlined above.