YOUTH EMPOWERMENT - National ...
←
→
Page content transcription
If your browser does not render page correctly, please read the page content below
YOUTH EMPOWERMENT THROUGH AGRICULTURE (YETA) F I N A L E VA L UAT I O N R E P O R T 2015–2019 C O N D U C T E D BY: U L I N Z I I N N OVAT I O N S CO N S U LT L I M I T E D P LOT 2 6 1 , B LO C K 2 3 0 , C A N H E R I TAG E R I S E K I R E K A- N A M U G O N G O R D. P.O. B OX 3 6 0 5 0 , KA M PA L A E M A I L : U L I N Z I . I N N OV @ G M A I L .CO M TEL:+256 4 1 4 6 9 6 9 6 6 /07 7 24 3 4 1 9 0/07 7 2 5 5 24 37
TABLE OF CONTENTS 6 AC K N OW L E D G E M E N T S 7 E X E C U T I V E S U M M A RY S U M M A RY TA B L E O F Y E TA P R OJ E C T AC H I E V E M E N T 16 I N T R O D U C T I O N A N D B AC KG R O U N D 16 INTRODUCTION 12 B AC KG R O U N D O B J E C T I V E O F T H E P R OJ E C T 16 T H E O RY O F C H A N G E P U R P O S E A N D O B J E C T I V E S O F T H E F I N A L E VA L UAT I O N SCOPE OF THE ASSIGNMENT 20 A P P R OAC H A N D M E T H O D O LO GY 20 G E N E R A L A P P R OAC H 20 S T U DY D E S I G N 20 S A M P L E S I Z E D E T E R M I N AT I O N Q UA L I TAT I V E DATA CO L L E C T I O N M E T H O D S 23 E VA LUAT I O N F I N D I N G S 23 H O U S E H O L D D E M O G R A P H I C I N F O R M AT I O N 25 R E L E VA N C E O F T H E Y E TA P R OJ E C T A L I G N M E N T TO N AT I O N A L P R I O R I T I E S , P L A N S , P O L I C I E S CO N F O R M I T Y W I T H D E V E LO P M E N T G OA L S A N D S T R AT E G I E S O F M A S T E R C A R D F O U N DAT I O N A N D N C B A C L U S A A L I G N M E N T TO G LO B A L P R I O R I T I E S A N D M A N DAT E S CO N S I S T E N C E W I T H R E G I O N A L P R I O R I T I E S A N D C O M M I T M E N T S A L I G N M E N T TO PA R T I C I PA N T N E E D S A N D P R I O R I T I E S A P P R O P R I AT E N E S S O F T H E Y E TA YO U T H E M P OW E R M E N T M O D E L 27 EFFECTIVENESS 27 R E S U LT A R E A 1 : F O R M A N D S T R E N G T H E N YO U T H A S S O C I AT I O N S F O R M AT I O N O F YO U T H A S S O C I AT I O N S S T R E N G T H E N I N G YO U T H A S S O C I AT I O N S 34 R E S U LT A R E A 2 : I M P R OV E W E L L- B E I N G A N D CO N F I D E N C E T H R O U G H E N H A N C E D F O U N DAT I O N A L S K I L L S YO U T H I N VO LV E D I N R I S KY B E H AV I O R YO U T H E M P OW E R E D W I T H K N OW L E D G E O N S R H A N D FA M I LY P L A N N I N G TO M A N AG E B E H AV I O R A L O U TC O M E S F I N A L E VA L U A T I O N R E P O R T 1
YO U T H ACC E S S TO S R H A N D FA M I LY P L A N N I N G S E R V I C E S 43 R E S U LT A R E A 3 : I N C R E A S E ACC E S S TO F I N A N C I A L S E R V I C E S YO U T H ACC E S S TO I N F O R M AT I O N F R O M F I N A N C I A L S E R V I C E P R OV I D E R S F O R M A L A N D I N F O R M A L S AV I N G M E C H A N I S M S F O R YO U T H 48 R E S U LT A R E A 4 : D E V E LO P T H E T E C H N I C A L A N D E N T R E P R E N E U R I A L S K I L L S TO S TA R T A N D M A I N TA I N B U S I N E S S E S F O R M A L A N D I N F O R M A L S AV I N G M E C H A N I S M S F O R YO U T H E N G AG E M E N T I N AG R I C U LT U R A L E N T E R P R I S E AC T I V I T I E S AS A S O U R C E O F I N CO M E FO R YO U T H E S TA B L I S H M E N T O F YO U T H AG R I C U LT U R A L E N T E R P R I S E S I N C R E A S E AG R I C U LT U R A L E N T E R P R I S E S O R E M P LOY M E N T A S S O U R C E O F I N C O M E S I N C R E A S I N G Y I E L D S F R O M AG R I C U LT U R A L E N T E R P R I S E S YO U T H S AT I S FAC T I O N W I T H T H E I R E M P LOY M E N T [ S E L F - E M P LOY E D A N D E M P LOY E D] T H E M A S T E R C A R D F O U N DAT I O N L I V E L I H O O D S I N D I C ATO R S A S S E T S OW N E R S H I P BY YO U T H ACC E S S TO A N D OW N E R S H I P O F L A N D 61 E F F I C I E N C Y O F N C B A C L U S A-Y E TA A P P R OAC H A N D D E L I V E RY 66 S U S TA I N A B I L I T Y A S S E S S M E N T O F YO U T H C U R R E N T A N D F U T U R E B U S I N E S S S TA B I L I T Y A N D V I A B I L I T Y T H R E AT S TO S U S TA I N A B I L I T Y 70 S U CC E S S S TO R I E S A N D C A S E S T U D I E S 74 LESSONS LEARNED AND KEY CHALLENGES 75 CO N C L U S I O N S A N D R E C O M M E N DAT I O N S 7 8 A N N E X E S 7 8 A N N E X 1 A : S A M P L E S I Z E C A L U C L AT I O N 80 ANNEX 1B: SAMPLE SIZE DISTRIBUTION 8 0 A N N E X 2 : L I S T O F D O C U M E N T S R E V I E W E D 8 2 ANNEX 3: LIST OF KII RESPONDENTS F G D PA R T I C I PA N T S PEER LEADERS 91 A N N E X 4 : N C B A C L U S A Y E TA P R OJ E C T O R G A N O G R A M 9 2 OV E R A L L AT TA I N M E N T O F Y E TA P R OJ E C T TA R G E T S 2 Y O U T H E M P O W E R M E N T T H R O U G H A G R I C U LT U R E
LIST OF FIGURES 24 FIGURE 1: Distribution of Respondents 28 FIGURE 2: Parameters for Formation and Strengthening of YAs 31 FIGURE 3: Funding from Government Programs to Youth Associations 31 FIGURE 4: Youth Involved in Risky Behavior 37 FIGURE 5: Risky Behaviors Among Youth 38 FIGURE 6: Occurrence of Multiple Sex Partners by Sex of Respondent 39 FIGURE 7: Youth Empowered with Knowledge on SRH and FP 40 FIGURE 8: Youth Access to SRH and Family Planning Services 40 FIGURE 9: Benefits Accrued From Mentorship to Youth 42 FIGURE 10: Sense of Confidence Among Youth 44 FIGURE 11: Youth Access to Information from Financial Service Providers 45 FIGURE 12: Formal and Informal Saving Mechanisms for Youth 46 FIGURE 13: Sources of Agricultural Loans for Youth 49 FIGURE 14: Performance in Youth Gaining Knowledge and Skills by Age and Districts 49 FIGURE 15: Areas of Training in Agro Enterprise 50 FIGURE 16: Service Provision by Value Chain 51 FIGURE 17: Details of CBSP Services by Value Chain 52 FIGURE 18: Youth Engagement in Agricultural Enterprises as a Source of Income 53 FIGURE 19: Youth Engagement by Type of Employment 54 FIGURE 20: Establishment of Youth Agricultural Enterprises by Category 54 FIGURE 21: Youth Engagement in Agricultural Enterprises or Employment as Source of Income 55 FIGURE 22: Youth Approaches to Marketing 56 FIGURE 23: Crop Yields for Common Staples in Uganda 56 FIGURE 24: Increasing Yields from Agricultural Enterprises 57 FIGURE 25: Youth Satisfaction with Their Employment 58 FIGURE 26: Perception of Youth Towards Wage Pay 59 FIGURE 27: Asset Ownership by Youth 60 FIGURE 28: Type of Assets Owned by Youths 66 FIGURE 29: Youth Business Survival F I N A L E VA L U A T I O N R E P O R T 3
L I S T O F TA B L E S 29 TA B L E 1 : Summary of Outcome Attainment 29 TA B L E 2 : Summary of Result 1 Performance: Youth Association are Formed and Strengthened 35 TA B L E 3 : Summary of Indicators in Result Area 2 43 TA B L E 4 : Summary of Indicators in Result Area 3 48 TA B L E 5 : Summary of Indicators in Result Area 4 53 TA B L E 6 : Gross Margin Analyses for Supported Enterprises 59 TA B L E 7 : The Mastercard Foundation Livelihood Indicators 63 TA B L E 8 : Value for Money Assessment 65 TA B L E 9 : Summary of Budget and Expenditure 4 Y O U T H E M P O W E R M E N T T H R O U G H A G R I C U LT U R E
L I S T O F AC R O N Y M S PWDs People with Disabilities ASSP Agriculture Sector Strategic Plan R AC Regional Advisory Committee AYC African Youth Centre RFP Request for Proposal CBSP Community Based Solutions Provider SDIP Social Development Sector Investment Plan CV Curriculum Vitae SPSS Statistical Package for Social Sciences FA s Farmer Association SRH Sexual Reproductive Health FA L Functional Adult Literacy SSU Secondary Sampling Unit FGDs Focus Group Discussion STI Sexual Transmitted Infection FP Family Planning To R Terms of Reference GAP Good Agronomic Practices UWEP Uganda Women GEM Global Entrepreneurship Monitor Entrepreneurship Program GMR Global Multi Poverty Indicator VS L A Village Savings and Loans Association IMO Indigenous Micro Organisms YA Youth Association KII Key Informant Interview Y E TA Youth Empowerment Through Agriculture MAAIF Ministry of Agriculture, Animal Industries and Fisheries YLP Youth Livelihood Program MGLSD Ministry of Gender, Labour and Social Development M o LG Ministry of Local Government NCBA National Cooperative Business CLUSA Association CLUSA International NDP National Development Plan NGO Non-Governmental Organization NUSAF Northern Uganda Social Action Fund OWC Operation Wealth Creation PHH Post-Harvest Handling PO Parent Organization PSN Persons with Special Needs PSU Primary Sampling Unit F I N A L E VA L U A T I O N R E P O R T 5
ACKNOWLEDGEMENTS The completion of this final evaluation would not have been possible without the efforts of a cross section of people. The Evaluation Team would like to express sincere gratitude to all participants in this evaluation from the districts of Kiryandongo, Masindi, Kole and Dokolo, including KII respondents and FGD participants who gave their valuable contribution and time to the Evaluation Team. Special thanks go to YETA field staff and NCBA CLUSA Kampala office staff: Naphtal Etyang (Chief of Party), Kasingye Africano (Director, M&E), Tegegn Yayeh (Director, Finance & Administration), Dominic Munduga (Logistics and Procurement Officer), Patrick Odur (M&E Officer), Allan Dickson Otim (DMS), Moses Nyipir (Regional Coordinator), Julius Anguzu (YEA), Christine Kimuli (YEA), Francis Otit (YEA), Betty Achan (M&E Officer), Gilbert Engulu (Regional Coordinator) and Cyprian Okello (YEA) for their unflinching technical support and guidance during inception and execution of the assignment. The Evaluation Team is further indebted to local government officials and private sector stakeholders, as well as NCBA CLUSA partners who provided important information on the parameters of the evaluation. Lastly, I wish to acknowledge the support and contribution from the entire Evaluation Team that comprised of Fredrick Luzze, Obedy Niwagaba and Charles Kashungwa, as well as the Data Analysts and Research Assistants from the respective districts: Jennifer Alwoch, Simon Ocam, Scovia Akwang, Genite Anito, John Olwee, Jesca Arach, Nancy Ayot, Kromel Labeja and Joseph Lusenjula. R O B E R T A D U PA L E A D CO N S U LTA N T U L I N Z I I N N OVAT I O N S C O N S U LT LT D. 6 Y O U T H E M P O W E R M E N T T H R O U G H A G R I C U LT U R E
EXECUTIVE SUMMARY N C B A C LU S A’ S P R E S E N C E I N U G A N DA KO L E K I RYA N D O N G O D O KO LO D I S T R I C T S W H E R E N C B A C L U S A H A S WO R K E D MASINDI Y E TA P R OJ E C T D I S T R I C T S NO NCBA CLUSA PRESENCE U G A N D A F I N A L E VA L UAT I O N OV E RV I E W youth associations (YAs), bolster the wellbeing and confidence of YA members through foundational In partnership with the Mastercard Foundation, skills, increase member access to financial services, NCBA CLUSA implemented the five-year Youth and instill the technical and entrepreneurial Empowerment Through Agriculture (YETA) project proficiency critical to launching a business. in the districts of Masindi, Kiryandongo, Kole and Dokolo. YETA empowered youth ages 15-24 in these F I N A L E VA LUAT I O N P U R P O S E A N D four districts to develop sustainable commercial SPECIFIC OBJECTIVES enterprises through on- and off-farm agricultural businesses. During the project, NCBA CLUSA The purpose of the final evaluation is to provide worked with a consortium of several partners an independent assessment and analysis of the including Reproductive Health Uganda (RHU), Youth overall relevance, effectiveness, sustainability Alive Uganda, Aflatoun, Making Cents International and the degree to which YETA has accomplished and a number of local financial partners. NCBA its objectives and goals as outlined in the results CLUSA also coordinated closely with the Youth framework. The specific objectives of the final Forward Learning Partnership, which included evaluation are to: 1.) assess the effectiveness of the Overseas Development Institute (ODI) and the project’s performance in meeting the end of Development Research and Training (DRT). project activity and results targets; 2.) assess the relevance of project activities to the needs of the P R OJ E C T O B J E C T I V E S target population; 3.) assess the sustainability of the project by reviewing the capacity of youth, The goal of YETA was to develop sustainable YAs and their enterprises to continue sustaining commercial agriculture enterprises led by youth their profitably; and 4.) assess youth’s current and in North and Mid-Western Uganda. It aimed to future business stability as well as their businesses’ create income-generating enterprises for 26,250 viability and quality of market connections and youth ages 15-24 within five years. Specifically, document best practices and lessons learned. YETA’s objectives were to establish and strengthen F I N A L E VA L U A T I O N R E P O R T 7
E VA LUAT I O N M E T H O D O LO GY district extension staff, local leaders such as Local Council 1 (LC1, LCIII, LCV), staff from relevant central The final evaluation adopted a mixed method government agencies and ministries, private sector approach using both quantitative and qualitative partners, cooperatives enterprises, agro-dealers and data to address the key parameters of the input suppliers, agribusinesses, financial institutions evaluation as stated in the terms of reference (TOR). and health facilities. Participants for FDGs on the The evaluation was conducted in the districts of other hand were drawn from Youth Association Masindi, Kiryandongo, Kole and Dokolo and the membership and other key stakeholders including target population comprised of parent associations, Youth Monitoring, Evaluation and Learning Leaders financial institutions, the private sector, district (YMELs) and Peer Leaders (PLs). technical education and Community Development Departments and other extension staff, local In addition, a total of eight success stories were government leaders, religious and cultural institutions, collected across the four districts. These were central and local government officials including intended to enable the Evaluation Team to develop MAAIF, MGLSD, Ministry of Trade, Ministry of Local a deeper understanding of issues regarding the Government (MoLG) and the Ministry of Health. benefits of the project to participants as well as triangulate information derived from other sources. The quantitative aspect of the evaluation entailed A total of 82 KIIs and 37 FGDs were conducted, and a survey questionnaire that was administered to the success stories collected were disaggregated by a sample size of 760 respondents. The sample district. The breakdown of number of participants was selected from the sampling frame of 26,250 in each of the FGDs and KII is provided in Annex 4. targeted youth project participants using the statistically and widely acceptable sample size FINDINGS estimation technique by Krejcie and Morgan sample size estimation model.1 The sample size R E L E VA N C E was distributed over the operational area in the The YETA Project was well aligned with the country’s four districts based on the participant numbers national priority efforts aimed at addressing youth by district, cohort, and sub-county. The sample unemployment through skill building and economic frame for the survey was the lists of participants empowerment as stipulated in Uganda’s National supported by the project in the target districts Development Plan (NPDII) 2015/16-2019/20— of Masindi, Kiryandongo, Kole and Dokolo. Each particularly the Youth Livelihood Program (YLP) and district was taken as a stratum and results were the Uganda Women Entrepreneurship Programme analyzed separately, while allowing for comparison (UWEP), the National Strategy for Youth Employment across the stratum. A four-stage stratified random in Agriculture (2017), the National Agriculture Policy sampling was adopted with the first strata or (2013), the Agriculture Sector Strategic Plan (ASSP Primary Sampling Unit (PSU) being the sub- 2015-2020), and the National Strategy for Youth county followed by the cohorts as the Secondary Employment in Agriculture (2017). In addition, the Sampling Unit (SSU) to ensure that youth from all project was consistent with the Public-Private cohorts were surveyed. The Tertiary Sampling Unit Partnership Framework Policy (2010) and the (TSU) was the Youth Associations and finally the National Public-Private Partnership Act; the Uganda individual youth participant. Micro, Small and Medium Enterprise Policy (2015); the Social Development Sector Investment Plan Qualitative methods employed included key (SDIP) II; the Youth Council and the National Youth informant interviews (KIIs), focus group discussions Policy (2001); the Northern Uganda Social Action (FGDs) and observation, as well as collection of case Fund Youth Opportunities Program; the National studies and success stories. Respondents for KIIs Health Policy; and the Adolescent Health Standards were drawn from NCBA CLUSA’s staff, staff from and Guidelines. The project also contributed to partner organizations, relevant district technical staff, the attainment of the Skilling Uganda Strategic Plan (2012-2022), which provides a framework 1 The Krejcie and Morgan model is a formula used to calculate for youth engagement and employment. the acceptable sample size of a statistical survey. 8 0 Y O U T H E M P O W E R M E N T T H R O U G H A G R I C U LT U R E
EFFECTIVENESS and 68% of males). In addition, 37% reported Evaluation findings indicate that a majority of indulgence in unprotected sex. project objectives and targets were attained. In some cases targets were surpassed. Below are YETA R E S U LT 3 : I N C R E A S E AC C E S S TO results summarized by each result area: F I N A N C I A L S E RV I C E S Significant achievements were attained with regard to R E S U LT 1 : F O R M A N D S T R E N G T H E N YO U T H youth gaining increased access to information from Overall, the percentage of YA A S S O C I AT I O N S financial service providers about available products leaders with the knowledge and capacity to manage and services—this rose from 9.9% to 67% by the end YAs rose from 6% to 86% by the end of the program; of the program (although this was below the target 97% of YA leaders received training in governance of 92%); the amount of youth saving in a formal or and leadership compared to 6% at baseline. Based informal financial mechanism reached 124% of the on the final evaluation, 97% of youth reported target; the percentage of youth saving in VSLAs rose knowing about the governance structure of from 5.6% to 64%; and by the end of the program their YAs and many youth had gained sufficient a high proportion of youth (72%) that felt they had confidence to take on new roles and responsibilities learned how to plan their finances. However, only beyond their groups—28% of YA members took up 10% of youth saved with formal banking institutions; leadership positions in community and government and 46% reported low satisfaction with current structures. About 95% of YAs had established financial services provided via the YETA project. constitutions and all were registered with local authorities; YA members and leadership reported R E S U LT 4 : D E V E LO P T E C H N I C A L A N D high satisfaction (84%), a greater ability to resolve E N T R E P R E N E U R I A L S K I L L S TO S TA R T A N D conflicts in their YAs (84%), and better handling M A I N TA I N B U S I N E S S E S of YA finances transparently (81%). A majority The project attained a number of achievements (87%) of youth reported agricultural enterprises or such as a high proportion of youth (98%) who activities as their main source of income compared had acquired knowledge and skills to start and to the baseline value at 54.9%. Comparatively, less maintain sustainable agricultural enterprises progress was noted in terms of relatively fewer YAs compared to 8.8% at baseline; a high proportion of accessing land for agricultural production (55%) youth (94%) reported engaging in an established under Result Area 1. agricultural enterprise; among these youth businesses, a solid majority achieved a reasonable R E S U LT 2 : I M P R OV E W E L L- B E I N G A N D rate of business survival2 (85%), which was above CO N F I D E N C E T H R O U G H E N H A N C E D the program’s target (50%); roughly 51% of youth F O U N DAT I O N A L S K I L L S reported increased income from their agricultural Notable achievements include a reduction of risky enterprises established or employment compared behaviors from 34.4% to 24% of youth; reduced to 11.5% at baseline; the percentage of youth youth engagement in early sex, sex with multiple reporting increased yields rose from 16.3% to 50%; partners or cross generational sex from 34% to 20% the portion of youth satisfied with their current of youth; 77% of youth were provided knowledge engagement in agricultural enterprises, business and trained on SRH and family planning in line with or employment increased from 8.8% to 38%; and a the target of 76%; 83% of youth were provided majority of the youth (92%) expressed a willingness education and counselling on the prevention of STIs to continue with their current employment over or family planning services compared to the target the next 3-5 years and beyond. Youth mentorship of 76%; 87% of youth accessed mentoring services played a critical role in building the entrepreneurial while 52% agreed that their level of confidence skills of the youth and achieving these results, as had increased. The role of youth Peer Leaders in will be explained further below. Notably, there was achieving these results was quite important, as will be illustrated below. However, youth stated a high 2 Business survival is calculated as the proportion of youth who undertook the same agricultural undertakings for the frequency of indulgence in sex with someone who last 2 years. The NCBA CLUSA Monitoring guide however was not regular partner or spouse (71% of females had defined business survival as being endurance over three months. F I N A L E VA L U A T I O N R E P O R T 9
limited achievement in the portion of youth selling youth products such as the ‘Dembe’ youth accounts, via their groups (11%). now adopted by other financial service providers and projects (e.g. Profira interventions); and 3.) risk With regard to the Mastercard Foundation reduction through the agricultural insurance support Livelihood Indicators, significant achievements were from GoU. No policies were developed, passed or noted. The percentage of youth with increased reviewed as a result of YETA. asset ownership rose from 8.7% to 45%, among other successful results. EFFICIENCY Overall, the project was implemented in an It is also worth noting that YETA contributed to efficient manner as exemplified by achieving and three improvements in the enabling environment exceeding major targets by year four; flexibility for youth employment. These include the following: in project implementation as exemplified by a 1.) the pronouncement by the Ministry of Health to number of modifications made in response to institute a youth health corner to be managed by lessons learned and experiences during the course youth medical workers, where possible; 2.) increased of project implementation; the provision of the youth confidence to plan, seek and manage necessary technical support in the form of regular agricultural credit from commercial banks and supervision and monitoring, guidance and general microfinance institutions (MFIs) that develop special backstopping by NCBA CLUSA staff at the project products for youth. This resulted in the creation of and management levels; low per capita participant S U M M A RY TA B L E O F Y E TA P R OJ E C T AC H I E V E M E N T BASELINE TARGET % OF R E S U LT A R E A I N D I C ATO R ATTAINMENT (2016) (2019 ) TARGET Result Area 1: Youth 27,130 Association are formed # of youths mobilized to form YAs (>30% females) 0 26,250 103 (43% women) and strengthened # of YAs formed and strengthened 0 750 813 108 % YA leaders with knowledge and capacity to manage YAs 6.0% na 86% na Result Area 2: Youth % of youth involved in risky behavior 34.4% 8% 24% 39% Associations members have improved well- % of youth empowered with knowledge on SRH and being and confidence 89.3% 76% 77% 101 family planning to manage behavioral outcomes through enhanced foundational skills % of youth with access to SRH family planning information 42.7% 76% 83% 109 and services Result Area 3: Youth Association members % of youth who received information from a financial 9.9% 92% 67% 73 have increased access service provider about available products and services to financial information and services % of youth saving in a formal or informal mechanism na 15,000 18,663 124 Result Area 4: Youth % of youths with knowledge and skills to start and Association members 8.8% 86% 98% 114 maintain sustainable agricultural enterprises develop the technical and entrepreneurial % of youths reporting agricultural enterprises as a source skills to start and 54.9% 75% 87% 116 of income maintain their businesses % of youths with an established agricultural enterprise 34.1 % 75% 94% 125 Youth business survival rate as at end of project NA 50% 85% 170 % of youth with increased incomes from their agricultural 11.5% 50% 51% 102 enterprises or employment % of youth with increased yields from their agricultural 16.3% 60% 50% 83 enterprises 100 Y O U T H E M P O W E R M E N T T H R O U G H A G R I C U LT U R E
project investment for the YETA project established establishing several coordination mechanisms to be UGX 1,524,498, which is lower compared to and collaboration with the Central Government similar projects in Northern Uganda; implementation (IYET), regional level (RAC), district and sub-county of the project through close collaboration with local governments, and the private sector; linkages the national government, district and sub-county between youth and financial institutions; linkages local governments and the private sector (resulting and contracts between youth and buyers; youth significant in-kind contributions e.g. trainings, adopting techniques (e.g. conservation farming), equipment, seeds and other resources toward the technologies (e.g. mobile money) and youth picking program); working through a consortium of local up health-seeking behaviors. The evaluation, partners including Youth Alive Uganda (YAU) and however, revealed some threats to sustainability Reproductive Health Uganda (RHU); excellent overall that include: vulnerability to climatic variations, resource utilization as exemplified by a burn rate of pests and diseases; and market price fluctuations approximately 95.62% of the budget by November impacting youth enterprises. The routine turnover 2019; and use of standard financial control measures in government staff, who committed to supporting to guide project implementation. youth associations, and the loss of institutional memory among District officials are additional S U S TA I N A B I L I T Y threats to sustainability. The project has potential for sustainability. Among the sustainability mechanisms noted include: T H E M A S T E R C A R D F O U N DAT I O N L I V E L I H O O D I N D I C ATO R S 3 BASELINE TARGET % OF I N D I C ATO R ATTAINMENT (2016) (2019 ) TARGET The Mastercard % of youth with increased assets 8.7% na 45% 417 Foundation 14 a) % of youth that own at least five or more productive assets such as; land, mobile phone, shop, bicycle, cattle, 11.9% na 26% 118 goats, chicken, m/cycle... b) % of youth that have saved at least UGX 100,000 5.6% na 64% 1043 (US$30) with a Bank/MFI, SACCO/VSLA/etc. c) # of youths with access to land to start & maintain Na 300 15,147 >100 agricultural enterprises The Mastercard % of youth with increased incomes from their agricultural 11.5% 50% 51% 102 Foundation 2 enterprises or employment The Mastercard Number of youth reached disaggregated by age, gender, Foundation 3 education level, 0 26,250 27,130 103 The Mastercard Number of youth who completed program 26,250 27,018 103 Foundation 4 The Mastercard Number of youths who have transitioned to other Foundation 5 opportunities (other than agriculture) as a result of YETA na na 30% 30 project The Mastercard Youth satisfaction with their [quality of] employment 8.8% 60% 38% 63 Foundation 6 [employed and self-employed] The Mastercard Number of Institutions engaged in the YETA project 8 na 16 200 Foundation 8 The Mastercard Improved enabling environment for youth employment Foundation 9 [in agricultural related enterprises] – Namely agriculture na na 3 100 insurance, access to micro finance and youth access to health services. The Mastercard Policies developed, passed or reviewed as result of YETA 0 0 0 0 Foundation 10 project awareness, intervention and evidence 3 Some the Mastercard Foundation indicators doubled as project indicators and so were not repeated here 4 Where no targets were set, performance was against baseline values F I N A L E VA L U A T I O N R E P O R T 11
LESSONS LEARNED AND KEY CHALLENGES: LESSONS LEARNED participants and program partners in youth communities (e.g. parent mentors) for 1. Youth associations are important entry support to avoid high failure and dropout points for youth empowerment; they allow rate. Youth profiling should therefore youth to test their ideas and learn important precede program interventions. business skills through agricultural related enterprises and more readily benefit from 6. Mentoring is critical to ensure requisite non-agricultural interventions such as sexual support, trust and encouragement for reproductive health. youth empowerment. The project expanded mentorship to include other actors such as the 2. Group cohesiveness can be effectively attained peer leaders, YMEL, project staff and district if members are organized around common and sub-county level technical staff. However, objectives and aspirations. In the case of YETA, it is imperative that mentors retreat to the the common objective was improving lives background at a certain point during the through agricultural business interventions. empowerment process to enable the youth to The fact that YA members were all out of become principal actors in this process. school/school dropouts, lived in the same community and faced similar challenges also 7. Training young people in business enterprise enhanced group cohesiveness. However, development requires tailoring to their drawing YA membership from different villages needs and focusing on improving skills and and communities takes some time to attain competencies. Organizing training in phases cohesiveness for effective performance. allows for reflection and review by both the trainers and trainees as well as maintaining 3. Youth empowerment is a process that requires harmony with other on-going commitments systematic, incremental interventions that focus at individual and group levels. on meaningful participation and engagement rather than “quick fixes”. Active participation in 8. The incorporation of community based youth empowerment program enabled them to voluntary services in the project demonstrated develop problem-solving skills and gain a sense that youth are an important source of skills, of ownership, independence and self-efficacy. energy, and creativity for local communities. The engagement of young people in local 4. Youth empowerment is a multi-level construct development efforts is an important aspect consisting of practical life approaches of community economic development and is and applications, social action processes, mutually beneficial to both the youth and the individual as well as collective outcomes. community. The YETA project demonstrated that in addition to focusing on individual youth, it is 9. Project incubation kits were provided to youth also important to engage other entities and groups in order to enhance their businesses structures that enhance youth knowledge and and are a vital project contribution. However, skills. These include parents, local leaders and a few inconsistencies in their management extension staff. and access were observed. Therefore, it is important to establish a clear but simple 5. The design of youth empowerment programs reporting, handling cases and feedback should entail careful selection of the target mechanisms for immediate amicable 12 Y O U T H E M P O W E R M E N T T H R O U G H A G R I C U LT U R E
resolution. In many cases, such group assets in agricultural enterprises had to rent land could be used as group collateral to access at high costs, which effected the extent to additional resources when required. Making which land improvements could be done and youth group assets known to stakeholders this effected yields and limiting expansion provides additional security besides opportunities. There was competition for land increasing their utility and leverage. access, especially in Masindi District due to the increased demand within the sugarcane 10. Provision of youth-friendly services enhances industry. For example, on average, youth had to access to SRH services and positive health- pay UGX 146,000 per acre per season. seeking behavior among youth, especially where it is integrated into the government P R I C E F L U C T UAT I O N S : The wide changes in and private sector health service delivery farm gate prices for some crop such as maize, systems for sustainability. soybean and sunflower left the youth uncertain regarding farm profits. For instance, price of 11. Incorporation of foundation skills into youth maize during the last season to the evaluation empowerment programs, especially for ranged from UGX 600 - 1,000 in the project area. school dropouts, is pertinent to bridging the gap between formal and informal Adverse A DV E R S E W E AT H E R C O N D I T I O N S : life skills development. By developing a weather conditions including prolonged structured foundations skills guide, the droughts, heavy rains and flooding in some areas project addressed the needs, which were not lead to crop failure, higher disease incidences adequately provided in formal settings and and post-harvest losses. The adverse weather in the wider society. also limited access during supervision of project activities by project staff, especially during heavy 12. The transition from informal to formal rains given that each region had only one vehicle banking status requires systematic and motorcycles for field work. graduation to allow for learning, confidence and trust building and should not be rushed. Poor road conditions, P O O R AC C E S S R OA D S : especially in hard to reach areas in Masindi, 13. Strengthening coordination mechanisms affected both input supply and marketing of is important for enhancing synergy, youth agricultural produce resulting in higher information sharing and collaboration operational costs. among stakeholders. The project supported establishment of IYET and RAC, which were Limited L AC K O F R E L I A B L E M A R K E T S : instrumental in ensuring buy-in from the marketing coordination of agricultural produce local government, CSO and private sector. for horticultural crops discouraged youth from profitably engaging in such enterprises. KEY CHALLENGES I N A D E Q UAT E AC C E S S TO AG R I C U LT U R A L Largely, the YETA project implementation FINANCE: Although youth received training advanced well, however, the evaluation team in financial literacy and business skills, access noted the following key challenges which to finance remained a challenge due to limited accounted for some of the observed shortfalls in capacity of youth to meet borrowing terms achievement of intended results: and conditions from banks. The key alternative sources of finance such as VSLAs and SACCOs L I M I T E D ACC E S S TO L A N D F O R YA s A N D could not adequately meet the financial needs of MEMBERS: Most YAs and members engaged YAs and members. F I N A L E VA L U A T I O N R E P O R T 13
R E CO M M E N DAT I O N S R E S U LT A R E A 1 : YO U T H A S S O C I AT I O N S A R E 2. NCBA CLUSA needs to strengthen VSLAs FORMED AND STRENGTHENED and support their federation into strong and vibrant SACCOs to enable them to 1. There is a need to strengthen advocacy monitor and supervise youth associations skills among YA members to enable them to and support them in value addition. meaningfully and directly engage relevant Support can also be provided in the form of government agencies and other actors on infrastructure such as warehouses and other issues related to agricultural enterprise vital equipment to leverage their income and development. collateral base. 2. Mechanisms should be established for R E S U LT A R E A 4 : T E C H N I C A L A N D replication of YETA’s innovative technologies E N T R E P R E N E U R I A L S K I L L S TO L AU N C H and practices such as the foundation skills YO U T H A S S O C I AT I O N M E M B E R S ’ and the IMO piggery management models B U S I N E S S E S D E V E LO P E D both within and beyond the current districts. 1. Youth should be supported to acquire 3. In the future, project design should review either a Workers Practically Acquired Skills age grouping to ensure narrower age (PAS) (for all trainees who did not have any ranges. For example, instead of groups with academic qualification and yet satisfy the ages 15-25, trainings should consider three course requirements) or a DIT Certificate for groups such as ages 15-17 and ages 18-24 to those who join with the requisite academic address the specific needs of different age requirements and were able to satisfactorily brackets and to allow for better engagement, pass the test. With the Workers PAS, trainee cohesion and participation. graduates are able to obtain employment in and outside Uganda. R E S U LT A R E A 2 : I M P R OV E D W E L L- B E I N G AND CONFIDENCE THROUGH ENHANCED 2. NCBA CLUSA should further support YAs F O U N DAT I O N A L S K I L L S in understanding agricultural insurance in order to address the challenges associated Youth associations have provided a unique with climate change such as floods, entry point for adolescent SRH programming. droughts, pests and diseases. The YETA project integrated adolescent SRH services into livelihood improvement programs 3. There is a need to coordinate and and this practice should be scaled up by strengthen production and marketing respective districts. of youth agricultural produce through ensuring adequate production of quality R E S U LT A R E A 3 : I N C R E A S E D AC C E S S produce, postharvest handling, processing, O F YO U T H A S S O C I AT I O N M E M B E R S and storage. TO F I N A N C I A L S E R V I C E S 4. Expand the range of skills provided to youth 1. A transition from informal to formal banking to include apiary, bakery, hairdressing, status should be systematically graduated carpentry, and others to complement to allow for learning, confidence and trust agricultural enterprises and enhance building rather than rushed. interdependence. 14 Y O U T H E M P O W E R M E N T T H R O U G H A G R I C U LT U R E
5. Build capacity of youth by engaging in a 2. In future, NCBA CLUSA should unpack complementary enterprise mix to enhance the Theory of Change and simplify it for mutual and symbiotic businesses, which feed easy interpretation and understanding into each other and thus build synergies that by stakeholders for holistic uptake by all reduce cost and enhance profits. Examples stakeholders. include livestock and poultry waste output that would feed into biogas production, the 3. The coordination mechanisms for slurry provides manure for vegetable and enhancing synergy, information sharing and other crops. collaboration among stakeholders (IYET and RAC, which were instrumental in ensuring G E N E R A L R E C O M M E N DAT I O N S buy-in from local government, CSO and the private sector) should be maintained and P R OJ E C T D E S I G N strengthened. Project staffing structures need to be designed to ensure management can make effective 4. Cascade advocacy observed at IYET down decisions, respond to the needs of field staff, to the YA level for the articulation of policy and support monitoring and reporting. In and feedback to the government on youth regard to policy advocacy it is recommended related issues in agriculture. At the higher that both direct engagement (DRT/ODI level, an emphasis on fostering policy and approach) and grassroots (bottom-up) advocacy program developments on a sustainable go alongside, but with specific budgets to basis is also recommended. support the advocacy process along the whole continuum, especially where specific project 5. The Evaluation Team recommends that interests are not funded. the YETA project scale up the project to cover broader geographical areas as well as Regarding the challenges with access land, deepen vertical integration, which should NCBA CLUSA should conduct desk-based and include supporting more YAs in forming field validation studies to better understand the primary cooperatives and subsequently factors influencing youth land access and into area cooperatives and SACCOs that determinants to inform future programming. would engage in higher level value chain Supporting youth enterprises that are less development activities. land-based such as apiary, repair of agriculture 6. Regarding the challenges with access tools and equipment, mushroom production, land, NCBA CLUSA should conduct desk- marketing, among others, would also help to based and field validation studies to reduce dependency on land access. better understand the factors influencing youth land access and determinants to P R OJ E C T I M P L E M E N TAT I O N inform future programming. Supporting youth enterprises that are less land-based 1. NCBA CLUSA should develop strategies for such as apiary, repair of agriculture tools sharing experiences on applying the Learn, and equipment, mushroom production, Engage and Develop youth empowerment marketing, among others, would also help model with other like-minded organizations to reduce dependency on land access. involved in youth empowerment programs. For example, a national symposium on the model can be organized as part of the phase-out strategy. F I N A L E VA L U A T I O N R E P O R T 15
INTRODUCTION AND BACKGROUND INTRODUCTION Uganda, Aflatoun, Making Cents International and a number of local financial partners. NCBA This report is the result of a successful competitive CLUSA also coordinated closely with the Youth bid awarded by the National Cooperative Forward Learning Partnership, which included Business Association CLUSA International (NCBA the Overseas Development Institute (ODI) and CLUSA) to conduct a final evaluation of the Youth Development Research and Training (DRT). The Empowerment Through Agriculture (YETA) project. YETA consortium brought together the unique The report provides the methodological approach skills, assets and experience of partners, combining to the assignment, findings and analyses and extensive expertise in agriculture and agribusiness, recommendations for improvements of similar conservation farming, youth development, youth future interventions or scaling up. skills training, financial services access, reproductive health, and community mobilization in order to B AC KG R O U N D engage and work with youth associations to build sustainable agricultural enterprises. It is against this The National Cooperative Business Association background that NCBA CLUSA—in partnership with CLUSA International (NCBA CLUSA) is the oldest the Mastercard Foundation—sought and identified trade association for cooperative businesses in the the services of ULINZI Innovations Consult to United States and an international development conduct the final evaluation of the YETA project. organization. NCBA CLUSA provides cross-sector education, technical assistance, and advocacy that O B J E C T I V E S O F T H E P R OJ E C T help cooperatives to thrive. For more than 100 years, NCBA CLUSA has sought to develop, advance The four key objectives of the YETA project were to: and protect cooperative enterprises, highlighting the impact that cooperatives have in improving n Form and strengthen Youth Associations the lives of individuals and families. In the last n Improve well-being and confidence through 70 years, NCBA CLUSA has worked in over 100 enhanced foundational skills countries in the areas of food security, agricultural n Increase access to financial services development, strengthening of communities and n Develop technical and entrepreneurial skills to farmer organizations, community-based health, start and maintain businesses natural resources management, and empowerment of smallholder farmers, women and youth. T H E O RY O F C H A N G E In partnership with the Mastercard Foundation, Prior to participating in the YETA program, a NCBA CLUSA implemented the five-year Youth majority of youth in YETA intervention areas worked Empowerment Through Agriculture (YETA) project on small pieces of land provided by their parents or for youth ages 15-24 in the districts of Masindi, elders in their communities, without the necessary Kiryandongo, Kole and Dokolo. The goal of YETA skills or finance to farm productively. With limited was to facilitate youth in the four districts to knowledge to effectively manage the little income develop sustainable commercial enterprises generated, youth often did not know how to through on- and off-farm agricultural businesses. best invest their time and limited assets. Other During the project, NCBA CLUSA worked with challenges youth faced in agriculture included: low a consortium of several partners including levels of productivity, lack of access to resources, Reproductive Health Uganda (RHU), Youth Alive and limited skills. These challenges were addressed 16 Y O U T H E M P O W E R M E N T T H R O U G H A G R I C U LT U R E
by facilitating the creation of a network of youth land, information, and concessionary loans – associations and cooperatives. provided by government or other NGOs than it was for individuals. YETA’s youth associations acted as a vehicle to address these obstacles by providing access to A P P R O P R I AT E N E S S O F T H E Y E TA YO U T H formal training and mentorship so that young E M P OW E R M E N T M O D E L 34 people had the skills to produce more and invest better. YETA’s core trainings covered governance, The Learn, Engage and Build (LEB) model financial literacy, foundational skills and enshrined in YETA’s Theory of Change aligns with agriculture enterprise. Foundational skills trainings the adaptive learning approach that enables incorporated Sexual Reproductive Health (SRH) adjustments as a learner progresses through the and family planning (FP). These trainings – along various steps in the learning process. Adoption of with others - were carried out over a six-month this incremental approach to youth empowerment period and then followed by an incubation phase provides opportunities for learning and reflection, that included intensive youth mentorship for maximizes resource allocation and optimizes another 6 months by YETA staff, community elders project implementation. and parents, private sector, and local government. The groups were encouraged to choose a mentor Using the LEB model, youth were trained in specific to support their group endeavors and form a concepts that they could practice in everyday village savings and loans association (VSLA) to life (Learn), including agricultural enterprise save for their individual goals and group projects. selection, start-up and management; training YA Groups functioned as a means for empowering members in entrepreneurship and contractual youth who have low levels of self-esteem and for agreements; training in advanced agricultural demonstrating that change and better livelihoods production techniques and marketing skills; and are possible (i.e. diversified livelihoods). It was the establishment of Community Based Solution easier for groups to access resources – including Providers (CBSP), among others. Youth were 3 4 F I N A L E VA L U A T I O N R E P O R T 17
Y E TA - T H E O RY O F C H A N G E OBJECTIVE 1 OBJECTIVE 2 OBJECTIVE 3 OBJECTIVE 4 SUSTAINABLE SUSTAINABLE SUSTAINABLE SUSTAINABLE SUPPORT SUPPORT SUPPORT SUPPORT Y O U T H I N N O R T H E R U G A N D A D E V E L O P S U S TA I N A B L E C O M M E R C I A L E N T E R P R I S E S NUMERANCY AND ENTREPRENEURSHIP L EAR N LITERACY TRAINING FINANCIAL TRAINING GOVERNANCE LACK OF: SKILLS, ACCESS TO FINANCE, AND ENTREPRENEURSHIP LITERACY TRAINING LIFE SKILLS/ TRAINING TECHNICAL SKILLS REPRODUCTIVE HEALTH O P P O R T U N I T I E S F O R N O R T H E R N U G A N DA N YO U T H YO U T H TRAINING ENGAGE BUSINESS INCUBATOR MENTORSHIP VSLA (PARENT PEER MENTORING ESTABLISH AND MENTORSHIP FROM ASSOCIATION) STRENGTHEN PRIVTE SECTOR AND ACADEMIC G OA L : USE OF LITERACY AND NUMERACY BUILD YOUTH YOUTH BUILD BUSINESS DESIGN ASSOCIATION SAVINGS AND USE OF LIFE SKILLS (YA) TAKE LOANS BUSINESS SETUP FAMILY PLANNING PAR T NE RS CDOs/LOCAL FINCA PRIVATE SECTOR: MUKWANO, BALTON SACCO ACADEMIC: NARO PRODUCER ASSOCIATIONS FTB VA LU E CHAIN INTEGRATION 18 Y O U T H E M P O W E R M E N T T H R O U G H A G R I C U LT U R E
mentored in the application of these concepts quality of market connections under close supervision (Engage), and then n Document best practices and lessons learned empowered to try the concept on their own (Build) through the supported incubation component, S CO P E O F T H E A S S I G N M E N T business registration and business and other social mentorship—all in a sequenced manner with The assignment focused on youth ages 15-24, community resource persons, CDO, private sector and the study population comprised of parents and producer organizations involved at each stage associations, financial institutions, the private to create a sustainable support system. sector, district technical education and Community Development Departments and other extension Evaluation findings indicated that this model staff, local government leaders, religious and enabled the participants to apply knowledge cultural institutions, central and local government and skills gained more quickly. The theoretical officials including MAAIF, MGLSD, Ministry of content of the training was quickly translated Trade, Ministry of Local Government (MoLG) and into action in the form of agricultural enterprises the Ministry of Health. In addition, the evaluation of the participants’ choice under guidance and parameters included goal achievement, relevance, support from mentors and peer leaders. By effectiveness, efficiency, sustainability and impact, integrating foundational skills with technical skills as well as lessons learnt and best practices. in agriculture, business, entrepreneurship and management, the model addressed the needs The study population comprised of project of youth in a holistic and sustainable manner— participants, partners and stakeholders from all especially given the fact that these needs are four districts of operation, namely: Masindi and inter-linked and multi-faceted. This package Kiryandongo districts (Bunyoro sub region) in Mid- of interventions was a winning combination to Western Uganda and Kole and Dokolo districts engage youth comprehensively. (Lango sub region) in Northern Uganda. Each sub region was taken as the stratum. PURPOSE AND OBJECTIVES OF THE FINAL E VA L UAT I O N All views and opinions expressed in this report are those of the authors, who took the final decision The purpose of the end of project evaluation is to on content, and do not necessarily represent the provide an independent assessment and analysis position or policy of the Mastercard Foundation, of the overall relevance, effectiveness, sustainability, its Board of Directors, or its partners. This report and the degree to which YETA has accomplished does not represent a systematic investigation its objectives and results as outlined in the results contributing to generalized knowledge, as such. framework. The specific objectives of the final Rather, it is a project-specific study assessing YETA evaluation are to: in its context and surveyed YETA participants and key stakeholders. n Assess the relevance of the project activities to the needs of the target population and alignment with national, regional and global priorities n Assess effectiveness in terms of project performance in meeting the end of project activity and results targets n Assess the sustainability of the project by reviewing the capacity of youth, YAs, and their enterprises to continue sustaining their profitably n Assess youth’s current and future business stability as well as their businesses’ viability and F I N A L E VA L U A T I O N R E P O R T 19
APPROACH AND METHODOLOGY G E N E R A L A P P R OAC H K R E J C I E A N D M O R G A N ( 1 97 0 ) S A M P L E S I Z E E S T I M AT I O N M O D E L WA S D E V E LO P E D U S I N G The evaluation was conducted with full engagement T H E F O L LOW I N G F O R M U L A : and collaboration of NCBA CLUSA, other partners involved in the project, project participants and key S= Z2NP (1-P) stakeholders. This was intended to instill a sense of Z2P (1-P) + d2 (N-1) ownership of the evaluation outcomes. Where: S T U DY D E S I G N n = required sample size Z 2= the table value of chi-square for one degree The final evaluation was descriptive and cross- of freedom at the desired confidence level sectional in design, involving both quantitative and N = the population size qualitative methods where the primary sources P = the population proportion (assumed of information were a participant survey, focus to be .50 since this would provide group discussions, key informant interviews and the maximum sample size) success stories, along with secondary data sources d = the degree of accuracy (relative desired that included a review of relevant literature precision) expressed as a proportion and project documents, reports and reviews (0.05) (for simple/systematic random provided by the client. This design allowed for a sampling, use 5% precision in normal combination of methods including triangulation situations, 10% in some cases) of findings; complementarity and clarification of the results from various methods; and discovery In order to account for differences in practices of contradictions and inconsistencies in the and ethnic origins in the project area, within a evaluation findings in comparison to the baseline, site population (these differences were between annual project reports and other similar or relevant communities with and thus different etc.), the reports. The design also facilitated in-depth insight sample size was doubled. Similarly, a non-response about the processes that led to project outcomes, rate of 10% was applied in order to increase the as well as explained the linkages or mechanisms sample size to accommodate participants who that contributed to cause changes in the lives of the could not be found or refused to respond. target participants.5678 Using the above sample size determination formula, S A M P L E S I Z E D E T E R M I N AT I O N and based on the target population of 26,250 direct participants, a sample size of 7589 respondents Once the target number of participants from was determined as sufficient to assess the extent each of the four districts had been established, to which intended and unintended project results a statistically significant sample of respondents were achieved with a 95% level of confidence and was selected using the Krejcie and Morgan (1970) 0.05 margin of error. sample size estimation model. This sample estimation model is illustrated at right: The sample size of 760 was distributed over the operational area in the four districts based on the 5 6 prorated participant distribution as shown in Annex 7 5 https://www.calculator.net/sample-size-calculator. 8 html?type=1&cl=95&ci=3&pp=50&ps=26750&x=64&y=22 20 Y O U T H E M P O W E R M E N T T H R O U G H A G R I C U LT U R E
1 a. The sample size was further segregated by target districts of Masindi, Kiryandongo, Kole and cohort and sub-county to guide implementation Dokolo. Each district was taken as a stratum and and adherence to the above sample distribution. results were analyzed separately, but allowed for (Annex 1 b and c). comparison across the stratum. The consultants ensured that households surveyed were selected D E S I G N O F DATA CO L L E C T I O N TO O L S randomly with equal chance of selection. A four- The Evaluation Team adapted the baseline stage stratified random sampling was adopted evaluation data collection tools as agreed upon with the first strata or Primary Sampling Unit (PSU) with additions of the end line OECD/DAC evaluation being the sub-county followed by the cohorts as criteria to capture the final performance domains the Secondary Sampling Unit (SSU) in order to that offered relevant answers to the evaluation ensure that youth from all cohorts were surveyed. objectives and key questions as required by the The Tertiary Sampling Unit (TSU) was the farmer TOR. This allowed for close comparison of all Youth Associations and finally the individual youth important indicator results as laid out in the YETA participant. The distribution of the sample size project log frame. While the questionnaire was in between and within districts was prorated on the English, the research assistants were fluent in both basis of participant size as provided by the client. English and the local languages of the participants, The youth surveyed were selected beforehand using and read aloud the questions to the respondents at random numbers applied to the official participant their homes. list provided. This allowed for an equal probability for each household to be selected for the survey, in DOCUMENTS REVIEW a completely independent way. The Evaluation Team reviewed and analyzed documents relevant to the YETA project, in addition to In order to arrive at a more accurate and other relevant government policies and regulations. representative sample, the Primary Sampling They also reviewed special studies carried out by other Unit (sub counties) was segmented into two relevant agencies with the aim of gaining a better dichotomies: high and low (referring to the level of understanding of the assignment and gaining insight responsiveness of youth in the sub counties to the into the context in which the project was implemented. four core project result areas). High responsiveness The documents reviewed are listed in Annex 2. was defined as counties that scored 70% and above in the aggregate result areas while the low-medium RECRUITMENT AND TRAINING OF response sub counties scored less than 70% in the R E S E A R C H A S S I S TA N T S aggregated result areas. These distinctions were The consultants recruited from its pool of addressed during the sampling process in order to experienced enumerator base twelve enumerators arrive at a more representative overall result. from both Lango and Bunyoro sub regions and provided them with a two-day refresher training Sampling for participating sub counties was on principles and procedures of data collection also conducted in accordance with the above focusing on the youth considerations and information. Furthermore, sampling took into technicalities of the project components. The consideration the rural and urban balance. On the content of the training included background other hand, the sample for FGDs and KIIs were information (purpose, objectives and expected selected using purposeful sampling techniques as outcomes), data collection techniques, research proposed in the TOR but with refinements based on ethics and rapport building, review of the contents discussions with the NCBA CLUSA team. of data collection tools, and terms and conditions of engagement. This was followed by field testing and Q UA L I TAT I V E DATA CO L L E C T I O N M E T H O D S final adjustments to the data collection tools. Qualitative methods included key informant SAMPLING PROCEDURE interviews (KIIs), focus group discussions (FGDs) and The sample frame for the survey was the list observation, as well as the collection of case studies of participants supported by the project in the and success stories as described below: F I N A L E VA L U A T I O N R E P O R T 21
You can also read