Terms of Reference for the evaluation of Changing the River’s Flow for Young People (CTRF4YP) administered by SAfAIDS
Date: 24 May 2017
SAfAIDS is a regional non-governmental organization established in 1994. Through advocacy, communication and social mobilization, the organization aims to be the centre of excellence that promotes effective and ethical development responses to sexual reproductive health and rights (SRHR), HIV and TB and influence changes in policy and social practices. SAfAIDS works to address gender equality and the rights of women, girls and key population groups, to access sexual reproductive health services and rights by confronting complex issues like culture, human rights and stigma. In the past 10 years, SAfAIDS has complemented national programmes in HIV/TB Prevention, uptake of testing and HIV treatment, reduction of gender-based violence (GBV), and linking HIV and SRHR.
The intervention to be evaluated, Changing the rivers Flow for Young People (CTRF4YP) programme, is a 2-year programme which started on the 1st of July 2015 ending on the 30th of June 2017. The programme targets young people 10-24 years as primary beneficiaries while adults and community leaders 25+ are the secondary targets. The programme aims to transform gender relations to promote equality through critical reflections and questioning of institutional practices and broader social norms found in Zimbabwe. The community dialogue model based on the SAfAIDS Changing the River’s Flow methodology is being applied within communities to change the attitudes of parents and leaders and support them to redress some negative gender norms that fuel gender inequality. Community activities include school based gender transformation clubs for young people and community driven initiatives like fatherhood clubs and community health clubs as a follow up to the dialogues. The program is directed towards four districts in Zimbabwe, namely Hwange, Chiredzi, Seke and Nyanga.
The contribution is a partnership between SAfAIDS and Sonke Gender Justice. Sonke is a South African based organization, founded in 2006, which works across Africa to strengthen government, civil society and citizen capacity to support men and boys in taking action to promote gender equality, prevent domestic and sexual violence, and reduce the spread and impact of HIV and AIDS.
The programme sought to attain the following results:
Outcome 1.1: Institutions and organizations integrate and/or undertake gender transformative work that engages both women, girls, men and boys in addressing GBV and HIV, and promoting SRHR in the programme communities by 2017.
Outcome 2.1: Increased gender equality norms, better attitudes and practices demonstrated and self-reported by young people (10-24 years) both boys and girls within programme communities by 2017.
Outcome 3.1: Improved participation and commitment by community leaders and parents in addressing harmful traditional practices & social norms for improved gender equality in programme communities by 2017.
Outcome 4.1: Strengthened policies and strategies that address SRHR, HIV and GBV needs of young men and boys.
Outcome 5.1: Increased learning and sharing of high quality gender transformation and SRHR interventions among SAfAIDS and its partners throughout programme life until 2017.
Both SAfAIDS and Sonke have been supported by the Embassy of Sweden in Lusaka. An assessment of the support shows that both organisations are carrying out work of good quality and that the collaboration with the Embassy in Lusaka has been well functioning.
2. Evaluation purpose
- Provide SAfAIDS and the Embassy of Sweden with a measure of project performance with regard of effectiveness, cost efficiency, impact, relevance and sustainability with a strong focus on assessing the results, outcomes and programme goals;
- Provide the Embassy of Sweden and SAfAIDS with key lessons learnt that can be used in policy work or when designing programs and projects, and identify promising practices for learning;
- Generate recommendations for programme scale up and advocacy, and to inform future resource investment in gender norms transformation and SRHR interventions;
- The evaluation shall assess whether SAfAIDS has competence, capacity and routines to achieve its goals;
3. Organization, Management and Stakeholders
The review process will be facilitated by SAfAIDS with the support of the Embassy of Sweden, Harare. SAfAIDS is tasked to provide the consultant with all the relevant documentation programme documents, reports audits, contracts of the key stakeholders and beneficiaries of the programme, and any other relevant documents that relates to the programme, while the Embassy is tasked to provide the consultant with documents related to the bilateral strategy, agreements, assessments memos on the programme, Swedish development policies and relevant manuals.
The consultant will set up his or hers own meetings and conduct the methodology upon the approval of the methodology submitted in the inception report.
The Consultant will be accountable for An Inception Report: The inception report should be prepared by the consultant before embarking on a fully fledged review exercise. The inception report will detail the consultant’s understanding of what is being evaluated and why, as well as proposed methods, sources of data and data collection procedures intended to answer each review question. The inception report should also include a proposed schedule of tasks, activities, timeline, deliverables and key issues. The draft inception report will be shared with the Embassy and SAfAIDS to ensure that all have the same understanding about the review. The inception report shall not exceed 5 pages.
A Draft review Report: the consultant will deliver a draft review report with the indicative structure which is based on the guidelines in ‘Looking back, moving forward’, Sida Review Manual 2004. The draft report should not exceed 30 pages.
A Final Report: once feedbacks have been provided by SAfAIDS and the Embassy on the draft report, the consultant will be expected to revise adequately and provide a final report of maximum 30 pages.
4. Evaluation questions
The evaluation objectives have been translated into relevant and specific evaluation questions in order to provide SAfAIDS and the Embassy of Sweden with the effectiveness, efficiency and impact of the project as well as with key lessons learnt.
- To what extent has the project’s objectives and the major results been achieved? What impact has the project had on individual level, community level, and among youth, parents and/or fathers and community leaders?
- What could be done to make the intervention more effective? Could the project have been implemented with fewer resources without reducing the quality and quantity of the results? Was the program design the most efficient and effective way of achieving the stated results?
- Is the program adequately addressing or contributing to the challenges in the access to SRHR services and increasing gender equality goals?
- Are the lessons for this project integrated in any other SAfAIDS project?
- What other donors work with SAfAIDS in this area and how are they coordinated?
5. Approach and method
The consultant should employ a combination of selected methods, using both probability and non-probability sampling designs to arrive at the sample. This way, the evaluation will ensure geographical, intervention scope and beneficiaries sample representativeness for enhanced evaluation validity.
It is recommended that the consultant adopts a mixed method approach using both qualitative and quantitative tools and holistically examines all aspects related to the programme in a comprehensive manner. In addition, it is recommended to use participatory evaluation techniques to gather both quantitative and qualitative data, and primary and secondary data and information that would adequately provide answers to all the questions and issues raised. The combination of the two approaches makes it possible to triangulate data.
The consultant will work in close collaboration with the Embassy of Sweden and SAfAIDS, especially in regard to where field work will be conducted.
6. Time Schedule, Reporting and Communication
The following are the key deliverables for this assignment;
- Inception report detailing methodology, data collection methods, data analysis plan, sample size, costed work-plan & exact timelines and data collection tools by 1st of June 2017
- Draft report by 12th of July 2017
- Final report by 7th of August 2017
The consultants shall produce a written report of maximum 30 pages, 2 page summary and appendixes not included. The report shall be written in English and the draft shall be presented to the Embassy and SAfAIDS not later than the 7th of August. Format and outline of the report shall follow the guidelines in ‘Looking back, moving forward’, Sida Review Manual 2nd revised edition 2007, which can be down loaded from: http://www.sida.se/publications.
The consultants shall present and discuss the findings with the Embassy and SAfAIDS at a convenient date.
7. Evaluation Team Qualification
The consultant should have at minimum a Master’s Degree in Public Health or Social Sciences or/and Economics. In addition, the consultant should possess the following;
- At least 7 years demonstrated knowledge and experience in conducting and facilitating development programme monitoring and programme review processes with NGOs.
- Knowledge and experience in using participatory approaches and innovative facilitation techniques especially with young people
- Well versed with SRH, HIV prevention and GBV programme.
- Excellent analytical and report writing skills.
- Strong understanding of the development context in Southern Africa.
- Clearly stated references for works previously performed.
The budget shall include fees and reimbursable costs.
9. How to apply
The inception report should detail the following:
- Understanding of the ToRs
- A capacity statement including demonstrated ability to handle the assignment
- A detailed plan of conducting the exercise, with clear description of the methodology and sampling procedure
- Budget breakdown detailing consultancy and data collection costs
- Matrix detailing data collection methodology and tools
- A list of three recent organizations where similar services of the consultant have been utilized including contact details and title of assignment.