Request for Proposals for implementation of Endline Survey
Assessing the impact of a mobile information platform on the protection and well-being of women.
About ActionAid and ActionAid Arab Region
ActionAid is a global movement of people fighting for women’s rights, social justice and an end to poverty. ActionAid Arab Region (AA-AR) has a regional remit and works across the region on multi country programmes. ActionAid prioritises the leadership of women and young people, especially those living in poverty and exclusion, in our efforts to achieve social justice, gender equality and poverty eradication.
AA-AR is currently implementing a Women-Led Community-Based Protection (WLCBP) program in Mafraq and Zarqa. As a result of implementing this program anecdotal evidence pointed towards a generalised lack of awareness of services for women and girls’ protection and empowerment. On further investigation, it became clear that there remains insufficient data on the type, occurrence and frequency of protection and safety issues for women living in Jordan’s urban spaces.
AA-AR has secured funds to undertake a pilot project to design, test and rollout an information platform delivered via mobile and to undertake research on its impact. The platform’s target beneficiaries are Jordanian and refugee women from host communities and displaced communities in Mafraq and Zarqa governorates. The overall research objective behind the pilot is to assess: ‘the extent to which a women-led and designed mobile platform can enhance women’s protection and empowerment through the provision of information on rights and access to services for women in Jordan’. The research will track how women users will interact with the platform and how it will impact on attitudes, perceptions and experiences of its users in order to explore how best women and girls can learn about, access, or even impact empowerment and protection services in Zarqa and Mafraq. This research will also provide valuable data to advocate to government to prioritise gender responsive public services; to the MNOs to address financial and service level barriers to mobile inclusion.
The deliverables for this consultancy pertain to the impact assessment phase of the pilot research. The primary purpose of the impact assessment is to measure the efficacy of the mobile platform on key women’s protection outcomes. The impact assessment is taking place within the framework of a randomised controlled trial (RCT), whereby AA promotes and facilitates the access of a randomly-allocated treatment group to the mobile platform and measures differences in the outcomes of interest between this treatment group and a control group whose access to the platform is not facilitated.
The baseline assessment portion of the impact assessment was successfully carried out from July-October 2020, involving a survey of 661 women in Mafraq and Zarqa across treatment and control groups. Following the completion of the baseline assessment, in Q4 2020 the mobile platform was rolled out and promoted among the treatment group and the wider beneficiary target group.
Scope of work
AA-AR is seeking the services of a consultancy with extensive research and evaluation consultancy to deliver the endline assessment of the randomised controlled trial outlined above.
Training of research assistants and application of ActionAid’s research standards.
Organise transportation and remuneration of research assistants.
Support to survey tool adaptation process and translation from English to Arabic of any changes from the pre-existing baseline survey tool (please see note below)
Management and supervision of the data collection process involving treatment and control groups (n = 661) in Mafraq and Zarqa governorates:
· Logistical coordination and preparation in advance of data collection process
· Administration of individual questionnaire (approximately 25 minutes in duration) covering:
§ Awareness of rights related to women and girls’ protection
§ Awareness of public and private services related to women and girls’ protection
§ Perceptions and mapping of safety and security in Zarqa and Mafraq
§ Access and routes to protection services.
§ Digital behaviours, trust in mobile platforms, ICT experience and mobile technical skills.
§ Personal safety on mobile and online platforms.
§ Experience of using the mobile platform
§ Satisfaction with platform design, content and functionality (treatment group only)
§ Willingness to continue to utilise platform and recommend it to others (treatment group only)
· Detailed and continuous monitoring of research assistants, regular review, and back checking, to ensure the quality, accuracy, and completeness of the data collected, and strict compliance with ActionAid’s research and evaluation protocols including evaluation standards (see box below), ethical data collection procedures and safeguards
· Continual communication with ActionAid to keep them updated with progress in the data collection process
Analysis of endline survey data including:
· Progress against outcomes with respect to baseline data, across treatment and control groups, generating a reliable estimate of the average treatment effect (ATE) of the mobile platform
· Disaggregation against key demographic and response variables in line with research questions
· Methodological challenges and limitations including any attrition of treatment/control group or spillover from control group into treatment group Visualisation of key findings and trends
Production of 30-page report (not including annexes), including overview of methodology used, challenges/limitations, key findings, recommendations and lessons learned. Data annexes to be submitted along with the main report include data collection tools used, schedule of field visits and meetings, bibliography of key documents consulted and ToR for the assessment.
Submission of primary data tables in CSV format in Arabic
Production of a Powerpoint presentation summarising key findings and recommendations that can be used to disseminate findings within ActionAid and with external stakeholders, and an AA evaluation summary (template will be provided).
Co-facilitation of validation and learning workshop with project communities and key stakeholders;
Please note that ActionAid will lead the process whereby the baseline survey tool is reviewed and updated for the endline survey. Review and finalisation of the survey tool (the key data collection instrument) is therefore not an expected deliverable of this consultancy. However, the contracted consultants will provide technical support to the survey tool review process and will be required to translate any revisions from English to Arabic. It is expected that the endline survey tool will be based in large part on the baseline survey tool due to the need to directly compare answers at baseline and endline, but also that some minor revisions will be made. The existing baseline survey will be made available to the contracted consultants both in the original English and the Arabic translation.
Given ongoing uncertainty related to the Covid-19 pandemic and associated government restrictions on freedom of movement and association in Jordan, it is expected that the survey will be administered to respondents remotely, via telephone. However, in the event that ActionAid determines that government restrictions allow for safe face-to-face data collection, the contracted consultants will be expected to administer the survey in person. In either instance, access to the treatment and control group women will be facilitated by ActionAid.
Complying with the ActionAid Evaluation Standards
ActionAid expects all evaluations to be carried out in line with our Evaluation Standards. These Standards will be shared on request, but in practical terms require the evaluation and evaluator to consider:
Community voice and representation: it is essential that the evaluation reflects the voices of women and men involved in the project. People should be consulted as part of the evaluation, and their voices included in the evaluation report as direct quotes and case studies. In line with ActionAid’s mandate, the evaluation should prioritise people living in poverty and exclusion, especially women.
Feedback: as a minimum the evaluators should commit to feeding key findings and recommendations back to the communities engaged in the evaluation.
Transparency and ethical standards: the evaluators should explain clearly to communities engaged in the evaluation what the purpose of the exercise is, and how their information will be used. ActionAid’s ethical standards for research and data collection should be followed, including a risk assessment covering security risks to communities. As a minimum the evaluation should ‘do no harm’.
Women’s rights: Women’s rights must be respected in all evaluations. All evaluations should seek to explore how women have been affected by an intervention and the effect on gender relations. It is essential that women’s voices are heard clearly in the evaluation. The timing and location of evaluation activities and the composition of the evaluation team should be designed to maximise women’s ability to participate in the evaluation.
Transparency about methodology: The evaluation should include a detailed and transparent discussion of the methodology used and key decisions taken in designing and implementing the evaluation. This should include information about the sampling (approach to sampling, numbers of people/communities covered, how representative), what tools were used and why, methodological limitations and gaps.
Disaggregated data: data must be disaggregated in as much detail as possible. As a minimum this means disaggregation by age and sex. Where possible data should also be disaggregated by other relevant factors such as disability.
Eligibility and minimum requirements
ActionAid is looking for individuals or consultancies that:
1.Are registered in Jordan/consultants with licence to conduct research in Jordan.
2.Possess demonstrable experience and expertise in:
- · Implementation of large-scale quantitative surveys in urban contexts within context of wider research and/or evaluation process;
- · Implementation of surveys with women respondents and adherence to sectoral best practice on safeguarding and gender-sensitive data collection;
- · Remote implementation of surveys (e.g. by telephone);
- · Gender issues, women’s rights and/or women’s protection;
- · Measuring the individual and social impacts of technological innovations;
- Statistical and econometric analysis of quantitative survey results in line with client’s requirements;
3.Possess excellent spoken English and Arabic
4.Are available to implement as per the specified timeline with good value for money (at a minimum under the budget ceiling specified below).
Duration and key dates
[INSERT TIMELINE ONCE FINALISED]
How to apply
- A description of the organisation’s experience and qualifications to carry out the proposed scope of work, in line with the eligibility and minimum requirements specified above;
- A work plan describing how the partner will complete the scope of work outlined above, a description of personnel roles and project management structure, duty of care policies and procedures in place, and risk identification and mitigation plans;
- All-inclusive financial proposal including daily rates of enumerators for data collection and analysis.
- Estimated timeline for the completion of main activities, as well as a breakdown of the costs as per format provided.
How to apply
Please submit all proposals to :[email protected] no later than 24th ,Dec, 2020