External M&E Consultancy

1. Introduction

1.1 Background

The humanitarian impact of the Syria crisis remains deep and far-reaching. More than eight years since the war’s outbreak, Syrian refugees in Jordan have used up most of their resources and the host communities are increasingly strained, while donor fatigue has made the establishment of new projects and continuation of existing programming increasingly difficult.

The Jordan Response Plan (JRP), while only 38% funded in 2018, has a strong emphasis on education. The goal is to ensure sustained access to quality and inclusive education for Syrian refugees and vulnerable Jordanians through the following main pillars: (i) increasing access to inclusive education opportunities; (ii) improving the quality of education delivered to all children affected by the crisis; and (iii) strengthening the government’s capacity to plan and manage the education system in light of the extra pressures on the system.

The JRP outlines several needs in the support of the educational system, including:

• Extension, rehabilitation and maintenance of existing educational infrastructure
• Support for families with financial vulnerabilities with increased access to transportation and learning materials
• Enhanced social cohesion between Jordanian and Syrian children at school and community level
• Provision of learning support services for children in school to ensure retention
• Support increased access to Early Childhood Education (ECE)

In order to improve the educational situation for children from the refugee and host communities, Vision Hope International (VHI), in cooperation with two Jordanian Project Partner NGOs, has already successfully conducted a program initiating two family centers in the Karak and Mafraq governorates. These family centers focused on psycho-social and educational support, and in each location provided a kindergarten and a learning support program for vulnerable families. The program ran from November 2016 – August 2019.

The current project builds off the experience of VHI and its Project Partners, adopting a strategy to address the educational needs outlined in the JRP and focusing specifically on the following two outcomes:

1. Improved educational services for vulnerable Syrian and Jordanian Children through improved educational access
2. Improved integration through extracurricular activities for marginalized Syrian and Jordanian children living in decentralized areas

1.2 Program Design

To achieve the desired outcomes, VHI and its partners developed the following program activities:

• Outcome 1: Improved educational services for vulnerable Syrian and Jordanian Children through improved educational access (at least 30% Syrian)
  • 1.1 Continuation of the Family Centers in Mafraq and Karak. The Family Centers will include a kindergarten and a learning support program that have a main focus to help disadvantaged children succeed in school. The learning support program provides homework help and extracurricular activities while the kindergartens has a focus on learning through play and integration of Syrian children.
  • 1.2 Establishment of Home Study Groups (HSG): The program will establish local study groups as a form of educational support accessible to students from remote areas or with limited access to transportation. The groups will be made up of similar aged peers and conducted by a trained volunteer to ensure the provision of support necessary to succeed in school.
  • 1.3 Maintenance of KG2s and Maintenance Awareness: Four KG2s in public schools were preselected in coordination with the MoE during the needs assessment and will undergo maintenance works as part of the project. All selected KG2s meet the BMZ requirement of at least 30% Syrian refugees. The children of these 4 KGs and the 2 KGs at the family centers (section 1.1) will receive school maintenance sessions.
  • 1.4 Training in Educational Methods: Trainings, peer coaching, feedback will be provided for 24 education staff and volunteer
• Outcome 2: Improved integration through extracurricular activities for marginalized Syrian and Jordanian children living in decentralized areas (at least 50% Syrian)
  • 2.1 Establishment of the Mobile Extracurricular Activities Teams (ECT): One Mobile team in Karak and one in Mafraq will visit mosques, churches, clubs or organizations on a regular schedule and conduct extracurricular activities with groups of Syrian and Jordanian children such as sports or arts activities. The visits will be planned in coordination with these entities with the goal of increasing integration between Syrian and Jordanian children
  • 2.2 Optimized Integration through Employee and Volunteer Training: Trainings, peer coaching, feedback will be provided for 14 staff and volunteers

1.3 Summary of Program Information

Implementer: Branches of Mercy (BOM) in Thaniya, Karak and Jamaiyya Bani Hassan (MBH) in Manshia, Mafraq

Donor:

1. Vision Hope International (VHI) – Germany
2. Federal Ministry for Economic Cooperation and Development (BMZ) – Germany

Project Timeline: September 1st, 2019 – December 31^st , 2021

Active Regions: Thaniya, Karak and Manshia, Mafraq

2. Purpose and Expected Outcomes of Third-Party Monitoring

VHI on behalf of the local partners is seeking a Jordanian national Consultant to design its external evaluation process, conduct the baseline survey, and collaborate with program staff on the project’s internal monitoring methodology. This will mean:

1. Reviewing the monitoring plan and providing critical input on indicators, data collection, and overall methodology
2. Designing a comprehensive external M&E framework / impact assessment using a joint data management framework
3. Conducting the baseline survey

Upon selection, the Consultant will work closely with program staff to review and improve the internal monitoring methodology, including the data collection and analysis procedures for use in internal monitoring and the baseline evaluation.

The Consultant is also tasked with designing a baseline methodology for the impact assessment, validating quantitative baseline data collected by the partners, and collecting qualitative and quantitative data from relevant program stakeholders. The baseline methodology is to be developed by the Consultant in close collaboration with program staff.

The baseline study will take place in January 2020, during the first complete month of project activities. The final baseline report should be submitted within one month of evaluation, before the final deadline of February 29^th, 2020.

3. Evaluation Design and Methodology

3.1 Evaluation Overview

The Consultant will take the primary responsibility for the design of the evaluation methodology. This will comprise the process of determining appropriate quantitative data to be gathered by the partners as well as developing the quantitative and qualitative data to be gathered by the Consultant, including the sampling methodology, sample size as well site selection, development of the evaluation tool(s), and scheduling detailed time table for information collection, analysis and reporting.

The external assessment will use a participatory approach by which the Consultant will work closely with project staff, partners, and stakeholders. In addition to survey results, s/he will use qualitative methods involving key informant interviews, focus group discussions and site visits, to be designed by the consultant with approval from program staff. The Consultant will ensure that relevant partners and stakeholders actively participate to ensure high quality, credibility and effectiveness of the exercise.

Collection methods must include a combination of primary sources from interviewing beneficiaries, partners and stakeholders, general observations, and gathering information from secondary sources including the program’s monitoring and reporting system. In the preparation of the baseline, midterm, and final report, the Consultant is expected to provide the reader with accurate sources of its information and conclusions. All evaluation statements must be backed by existing data and information. When this is not the case, the Consultant is required to state its rationale for its observations and conclusions.

3.2 Potential Data Sources Required for the Review

In addition to data gathered by the Consultant, the following data will be provided to the consultant upon request:

• Project documents
• Project budget
• Agreement between VHI, Partners, and BMZ
• All submitted donor reports, including annexes
• Partner reports submitted to VHI
• Internal monitoring data
• Financial reports
• Policies of VHI and Partners
• Access to original documentation regarding procurement, salaries, timesheets, contracts, and accounting records
• All reports, research, publications, and survey data, developed as part of the project.

3.3 Potential Participants

Potential participants include:

• VHI Staff
• Program management staff
• Direct beneficiaries from all components (see 1.2)
• Teaching Staff from all components (see 1.2)
• Ministry of Education and the Ministry of Social Development Staff All interview/meeting types are to be determined by the consultant in consultation with program staff

4. Deliverables and Reporting Requirements

After sending in the Impact Assessment / M&E Framework Proposal and Proposed Fees in the initial application, the selected Consultant will be invited to attend a meeting of one day with the staff by the 22^nd of December in order to have more details about the program and the purpose of the evaluation mission. Within 5 working days, the Consultant should submit an Impact Assessment Methodology / M&E Plan.

The Impact Assessment Methodology / M&E Plan will include:

1. A detailed methodology design for the entire program duration, including a clear outline for the baseline evaluation
2. Draft questionnaires and other data collection instruments (KII and FGD) or their main features for the baseline stage with preliminary versions for the midterm and final evaluation to be updated according to the baseline findings
3. The list of potential interviewees and sites to be visited and proposed selection criteria and/or sampling plan (must include calculations and a justification of sample size, plans as to how the sampling frame will be developed, and the sampling methodology)
4. Known limitations to the evaluation design
5. The list of further collaborators if needed, delineated by roles and responsibilities

Once the Consultant receives the approval on the Evaluation Design from program staff, s/he is expected to start Data Collection and Analysis for the Baseline Report in close collaboration with program staff staff who will be responsible in the coordination with the different stakeholders and the preparative of the logistical needs. In addition, s/he is expected to begin collaborating with staff on the appraisal and modification of the internal monitoring plan.

Once the initial Baseline Report is submitted, program staff will send comments and feedback to the Consultant after five days of receiving the draft report. The Consultant will be asked to take no more than three business days to respond/incorporate the final comments from program staff and submit the Final Baseline Report before February 29^th as a deadline.

All project data and records (detailed work plan, evaluation interview tools for FGD and key informant interviews, draft final evaluation report, final evaluation report) will be shared with program staff in an easily accessible cloud-based data framework, organized and documented for use by those not fully familiar with the intervention or evaluation.

All project data and records, deliverable documents, and reports should be in submitted in English.

5. Timeline

Tasks with (number of days):

1. Meeting of External Consultant with VHI staff in Amman (1)
2. Preparation and submission of the Evaluation Design (5)
3. Consultancy with program staff on internal monitoring methodology (3)
4. Baseline Data Collection (10)
5. Baseline Data Analysis (4)
6. Baseline Draft Report Writing (5)
7. Incorporate program staff comments and prepare Baseline Report (2)

Total Working Days for Consultant: 30

Deadline for final Baseline Report: February 29th 2020

6. Application Information

5.1 External Evaluator Profile Requirements

The Consultant will be hired with a consultancy contract of a duration of 30 working days. The Consultant is expected to be a Jordanian national possessing the following profile:

• A strong education with a university or master’s degree in law or management or in other relevant fields
• A good evaluation experience including evaluation design, management and implementation
• A good experience in development programs
• An experience in education programing is recommended
• Arabic and English language fluency is required