Save the Children is a leading non-profit, non-political, non-religious humanitarian organization working in Nigeria in the areas of Health, Education, Nutrition, Protection, Advocacy and Emergency response. Save the Children has been working in Nigeria since 2001. The early focus was on getting children actively involved in shaping the decisions that affect their lives. Today, SC is working in several states; including Katsina, Zamfara, Yobe, Jigawa, Lagos, Plateau, Sokoto, Kano, Gombe, Maiduguri, Calabar, Lagos, Kebbi, Bauchi, Kaduna and others – focusing on child survival, humanitarian relief, and education and protecting children. Globally, Save the Children has a larger portfolio of development programmes across 120 countries in the world.
The Lifesteps Project is a Global Affairs Canada [GAC] funded project with the overall goal of giving boys and girls opportunities to achieve their full potential by addressing their developmental needs through gender-transformative approaches, using a three pillar model of participation, protection and empowerment. It is a two and a half year project being implemented in 9 LGAs across 18 communities in three states; Zamfara, Jigawa and Katsina. The project is managed by Save the Children and implemented by 6 indigenous Civil Society Organisations. The Lifesteps Project uses a proven community-based approach and builds the capacity of the indigenous organizations to enhance effective service delivery across all communities.
The project is expected to have a total direct reach of 46,720 and an indirect reach of 96,274 boys, girls, men and women through a variety of activities including school enrolment, child friendly safe spaces, vocational skills training, provision of birth certificates, community sensitization and awareness campaigns on education and child protection.
Purpose of the End of Project Evaluation:
The main purpose of the End of Project Evaluation is to ascertain the project impact on the targeted beneficiaries by examining the achievements and outcomes in the three states; determining project implementation effectiveness, and sustainability plans; and documenting best practices, lessons learnt and recommendations for similar project design. This would be achieved through a critical comparison with the baseline survey conducted at the project start-up phase. The End of Project Evaluation will use a gender equality approach to ensure representation of all critical stakeholders but also to specifically look at the gender equality impacts of the Life Steps project.
Specific Objectives of the End of Project Evaluation:
- Assess the extent to which the project has achieved its objectives and the expected changes realized in beneficiaries’ lives
- Assess whether the project objectives and strategies were relevant in addressing the identified problem(s).
- Evaluate the effectiveness and efficiency of the different approaches used to implement the project, as well as program delivery relevance and sustainability
- Establish the extent to which the results of the project are sustainable
- Generate learning (positive and negative) and good practices in implementing the project that could be applied in future programming
Save the Children will engage a Lead Consultant to collect data across 3 states in Northern Nigeria and at the national level. The Lead Consultant will develop the evaluation methodology in collaboration with the Save the Children Head of Child Protection and MEAL Advisor. The Lead Consultant is expected to write an inception report following a review of literature, gaps and propose an evaluation methodology. Such a methodology should define an appropriate sample size and specify mechanisms that will be adopted to avoid selection bias. The evaluation should meet the principles of participation involving boys, girls, men and women in the data collection. As a minimum, the evaluation process will include the following key steps:
- Secondary data review: Review of baseline assessment report, project annual reports from project inception, baseline data collection tools and other relevant secondary documents.
- Review of relevant literature on child early and forced marriage
- Application of data collection tools (e.g. household surveys, Focus Group Discussion (FGD) guides, Key Informant Interview (KII) guides) for Interviews and discussions with stakeholders and beneficiaries including Save the Children staff.
- Qualitative methods will be used (Including FGDs and KIIs) with appropriate groups/individuals including beneficiaries, media and government officials at LGA, States and national level.
- Ensure that all outcome indicators in the project log frame are assessed
The End of Project Evaluation sample framework must cover all three States and be representative to allow for comparative analysis. The sample must include the following beneficiaries:
- a Household Survey with adults (both men and women);
- a Household Survey with children (aged 9- 14 and 15-18, disaggregated by sex);
- FGDs with men and women (disaggregated by sex)
- FGDs with children (aged 9- 14 and 15-18, disaggregated by sex);
- KIIs with traditional leaders, religious leaders, and women leaders;
- KIIs with institutional stakeholders, including government officials (Ministry of Health, Ministry of Women’s Affairs), civil society organizations, NGOs.
End of Project Evaluation Responsibilities and Work Deliverables:
Responsibilities and work deliverables for this End of Project Evaluation will be divided between the Lead Consultant, and Save the Children.
- The Lead Consultant will be responsible for the data collection phase of the End of Project Evaluation which includes hiring and training the data collectors; organizing the daily logistical schedule for the data collectors; supervising the work of the data collectors to ensure consistency and quality of data collected; hiring and training data entry clerks; entering the data into a database; conducting FGDs and KIIs; cleaning and validating the household survey data and preparing analysis tables; preparing and translating into English FGD and KII transcripts.
- Save the Children Nigeria will be responsible for recruiting and hiring the Lead Consultant to lead the data collection phase; working with the Lead Consultant in organizing the logistics for the data collection phase, including identifying the households to be surveyed; identifying the FGD participants and organizing the FGDs; identifying and scheduling the KII interviews; trouble-shooting any logistical problems that might arise in the field.
Lead Consultant Responsibilities and Deliverables:
The Lead Consultant will be responsible for recruiting and hiring skilled data collectors, interviewers, FGD facilitators, supervisors, and data entry clerks. A gender balance among the data collectors, interviewers, FGD facilitators, supervisors and data entry clerks is required to make sure that data collection is gender-sensitive and to enable women and girls to engage with the data collectors.
NOTE: Save the Children will provide the Lead Consultant with all of the data collection tools – Household Surveys for adults and children; FGD guides and KIIs questionnaires. These are the same tools that were used for the Baseline Survey.
The Lead Consultant will be responsible for conducting a training workshop for the data collectors, interviewers, FGD facilitators and supervisors on the survey methodology, data collection tools and techniques and other skills needed to conduct high quality household surveys, focus groups, etc. All interviews conducted with women and girls should be conducted by female interviewers in gender-sensitive and safe spaces to enable women and girls to engage with the interviewers. The training of data collectors should include a detailed review of all questions, instructions and filters in the questionnaire prior to the commencement of data collection, as well as training on Save the Children’s Guidelines for Gender-Sensitive Data Collection. A pilot test of the household survey must be conducted to ensure that the data collectors clearly understand and have mastered the data collection tool.
The Lead Consultant will be responsible for developing and overseeing the in-field logistics plan and sampling procedures for the data collection, including determining how the individual households will be selected; who will be interviewed – positions as well as actual individuals; how the FGD participants will be selected; organizing the accommodation and travel requirements for the data collection team; organizing the daily work schedule for the data collection teams (who goes where, does what, etc.). Given that the scope of the End of Project Evaluation has to cover three (3) states, decisions will need to be made on how many data collection teams will be hired and trained to collect data.
The Lead Consultant will be responsible for making sure that the household surveys are complete and accurate prior to starting data entry and data processing. Data entry clerks, managed by the supervisors, will accompany the data collection teams into the field and enter data on a daily basis. Supervisors will monitor the work of the data entry clerks by doing random spot checks, and ensuring that all data is entered by the end of the data collection process. Any information provided on the HH survey beyond the code lists (e.g. answers to “other” options written in the local language) must be entered in English. Consequently, the data entry clerks must have a rudimentary understanding of English. Ideally, two data entry clerks should be hired per data collection team.
The Lead Consultant will be responsible for designing an SPSS database for the Household Survey data. The Lead Consultant will be responsible for ensuring that they have the appropriate SPSS software. Save the Children will provide guidance and recommendations for developing the relevant analysis tables for all of the questions in the HHS.
Timeline for Proposed Work:
The work should commence by the second week of August 2017 and is expected to be completed by the third week of September 2017. The consultant is expected to submit the final database on 18th of September, 2017. The table below summaries the assessment schedule.