Handicap International, China Programme
Terms of Reference (ToR)
For the Final Evaluation of the Directorate General of Belgian Development Cooperation (DGD)Funded Projects
Project Title:
1.People with disabilities and their family members in Yunnan better enjoy their rights trough increased participation and/or self-determination
2.Improving access to quality rehabilitation services for people with disabilities in Yunnan provinces, China
Time and duration:
Project starting date: January 1st, 2014
Foreseen end date: December 31st, 2016
Type of projects:
Rehabilitation; Community Based Rehabilitation (CBR) and Institutional Rehabilitation (READ)
Location:
Beijing and Project site Yunnan Province of China including Kunming city, Shizong County (Qujign prefecture); Chengjiang County (Yuxi Prefecture).
Donors:
Directorate General of Belgian Development cooperation (DGD) -80%
Local co-funding by; French Embassy, New Zealand Embassy, Australian Embassy
Submission of Application
Applications should be sent by email to:
Jane Lujuan
Project Manager
Handicap International, China Programme
Email: and cc to
Please indicate “Application for DGD - Evaluation” in the email’s subject.
Deadline for applications: September 18th, 2016
Contents
1.Background Information
2.Project Summary
2.1 General description of the project
2.2 Project objective and results
3.Description of the Assignment
3.1Overall objective of the final evaluation
3.2 Specific Objectives of the mission
4.Evaluation criteria
4.1Relevance and quality of project design
4.2Efficiency: Sound management and value for money
4.3 Effectiveness: Achievement of purpose
4.3Impact and Sustainability
4.4 Other general questions:
5.Methodology
6.Profile of the Consultant
7.Reporting and feedback
8.Calendar
9.Formalities
List of acronyms
CBR / Community Based RehabilitationCP / Cerebral Palsy
CRRC / China Rehabilitation Research Centre
CDPF / China Disabled Persons’ Federation
DGD / Directorate General of Belgian Development cooperation (DGD)
DPF / Disabled Persons’ Federation
HI / Handicap International
MoU / Memorandum of Understanding
NGO / Non-Government Organization
TAR / Tibet Autonomous Region
TDPF / Tibet Disabled Persons’ Federation
UNCRPD / United Nations Convention for the Rights of People with Disabilities
YDPF / Yunnan Disabled Persons’ Federation
YRC / Yunnan Rehabilitation Centre
- Background Information
The People’s Republic of China (PRC) is a rapidly developing country, averaging more than 8-9 % per annum economic growth between 2001 and 2011. However, the benefits of the last three decades of growth have not been evenly distributed and the gaps between the relatively rich eastern coastal zone and the poor central and western regions remain significant, as well as those between rural and urban areas. China has acknowledged there are still over 128 million people living below the poverty line, which amounts to 13.4% of the rural population.[1]Relative to the size of China’s economy and the overall government budget, expenditure on the social sector remains low by international standards.
The most recent China National Sample Survey on Disability (CDPF, 2006) estimates 83 million people with disabilities in China, 75% of which are living in rural areas. Only 1/3 of people with disabilities in need of rehabilitation have access to adequate services and only 1/5 of them have access to assistive devices. In China, disability has long been considered as an individual problem to be addressed only from a medical or charitable viewpoint. This medical perspective is still the approach used by services providers, both at institutional and community levels.
Furthermore, people with disabilities are facing difficulties to access mainstream and specialized services. The main obstacles to access rehabilitation services are linked to the services’ quality, quantity and geographical distribution. Institutional rehabilitation professionals are also lack understanding of the social model of disability and the Community-Based Rehabilitation (CBR)concept, and therefore cannot properly support CBR services related to physical and functional rehabilitation. On the other hand, CBR service providers often lack knowledge about existing specialized and mainstream services, as well as disability policies and laws that could support people with disabilities’ social integration and autonomy (rehabilitation services, inclusive education, livelihoods, disabled persons organizations, social protection).
In 2008, the United Nations Convention on the Rights of Persons with Disabilities (UNCRPD) was brought into force. In the wake of UNCRP, China has launched an ambitious overhaul of its central-level policies related to people with disabilities. New, largely sound policies[2] have been issued at the central level and the Government is investing significantly in their implementation primarily through the Disabled Persons’ Federation (DPF) system. Meanwhile, the CDPF set ambitious target “access to rehabilitation services for all”, that supposed to be achieved by the end of 2015.
This DGD funded project planned to implement in Tibet Autonomous (TAR) Region and Yunnan. TAR and Yunnan are respectively located in the western and south-western areas of China; they are among the 5 poorest regions in the country- OECD, 2009. The main income source of the two selected counties of Yunnan (Chengjiang, Shizong) are agriculture (including herbal-medicine and tobacco), tourism (especially in Chengjiang), and coal mining (for Shizong).
Partners: At provincial levelYunnan Disabled Persons’ Federation (YDPF) focusing on coordination of CBR and READ projects; Yunnan Rehabilitation Centre (YRC) focusing on implementation of READproject;
and Shizong Disabled Persons’ Federation (SJDPF) and Chengjiang Disabled Persons’ Federation at county level (CJDPF)focusing on the implementation of CBR and Rehab projects
HI has strategic partnership with China Disabled Persons’ Federation (CDPF), signed formal Memorandum of Understanding (MOU). CDPF is the semi-governmental and pyramidal structure, responsible for: represent the common interests and safeguard the rights of people with disabilities; provide comprehensive services to people with disabilities; and, as commissioned by the central government, supervise the administration of disability-related affairs.YDPF is the local branch of CDPF and YRC is rehabilitation unit of YDPF. YRC is currently providing rehabilitation services mainly for children with disabilities, especially children with Cerebral Palsy (CP).Shizong DPF and Chengjiang DPF are branched of the DPF system at county level.
Budget: 555, 182 EURO for CBR project and 462, 526 EURO for READ project
- Project Summary
2.1 General description of the projects
Since 2006, Handicap International (HI) has implemented several CBR and Social Inclusion pilot projects in China, in the Tibet Autonomous Region, as well as in Sichuan, and Guangxi Provinces. Building on the lessons learned from these initial projects, HI has developed and documented its best practices and trained its local staff. From the beginning of 2011, one thematic CBR project (2011-2013) with two project areas (Yunnan and Tibet) has been implemented to ensure people with disabilities in the operation area have better access and participation to their social life. Based on the achievement of the CBR project 2011-2013 and further needs assessment, the second phase CBR project (2014-2016) at same areas and the READ project (2014-2016) has been planned to strengthen the linkage between CBR & Institutional Based Rehabilitation (IBR).
While in the middle of 2015, we have to withdraw from Tibet, therefore the projects have been revised that more pilot project areas and activities in Yunnan have been planned to compensate the withdrawal of Tibet. For this mission, we will only evaluate the CBR and READ projects in Yunnan.
Yunnan belongs to China's poorest provinces and is also noted for a very high level of ethnic diversity. It has the highest number of ethnic groups among all provinces and autonomous regions in China. Among the country's fifty-six recognized ethnic groups, twenty-five are found in Yunnan. Some 38% of the province's populations are members of minorities, including the Yi, Bai, Tai, Dai, Miao, Hui and Tibetan. Lastly, Yunnan faces great social issues linked with poverty, migration, drug trafficking and HIV/AIDS.
In November 2011, a survey was designed and implemented jointly with people with disabilities and DPF to measure community knowledge on disability, and community attitudes and practices towards people with disabilities. According to results, community based activities were designed and implemented. In November 2013, a similar survey was carried out in the same areas and both survey’s outcomes compared.
According to the comparison report, the community environment is more inclusive compared to the survey done in 2011. To be specify,
- There are more accesses to information on disability, understanding of disability has changed from superficial and discriminatory perspective to a more rational and comprehensive way.
- People with disabilities are more confident and have a more positive self-awareness.Community members are more inclusive towards people with disabilities on community activities and are more likely to support people with disability
- The appellation of people with disabilities has been improved obviously. People with disabilities are more economically independent and their participation to community activities is more visible.
While still there are needs: to strengthen publicity and advocacy of the social model of disability relying on the community integration projects; Reinforce training to persons with disabilities and staff working with persons with disabilities; Encourage activities at community level to promote communication between people with and without disabilities; Strengthen the establishment of accessibility facilities and activities settings for people with disabilities; Promote the establishment of persons with disabilities’ self-help groups and family organizations of people with disabilities.
Based on the recommendations of final evaluation in 2013, participation of people with disabilities in the project management cycle should be increased; integrate more resources from local stakeholders, like women’s federation, youth league; strengthen the capacity building of township level DPF; strengthen the linkage between CBR & IBR; identify local trainers and building their training skills.
2.2 Project objective and results
The amended project objectives and expected result of Community Based Rehabilitation (CBR) (2014-2016), and Institutional Rehabilitation (READ) (2014-2016) projects are,
CBR: People with Disabilities and their family members in Yunnan and TARbetter enjoy their rights through increased participation and/or self-determination
READ: The quality of and access to functional rehabilitation services in Yunnan is improved, addressing the needs of People with disabilities
Expect Results:
CBR
- People with disabilities and their families in Yunnan are better informed and able to make informed decisions in order to identify and realize their personal project
- Community agents, have the capacities and resources to accompany people with disabilities and their families in the development of their personal projects.
- Conditions are fulfilled for communities to become more accessible and more inclusive for people with disabilities and their families
- The regional/provincial CBR guidance, functional unit, with the support of the national DPF & its affiliates and the national informal CBR network, have the capacity to provide technical and monitoring support to lower level DPFs for better CBR management and inclusive community development in existing and new target areas.
READ
- Health and rehabilitation professionals in Yunnan improve their competences and abilities to provide appropriate services to People with disabilities and access to the sustainable technical support resources
- Access to and quality of functional rehabilitation (mainstream, specific and/or support services) is improved in Tibet and Yunnan
- A support system is organized at community level in Yunnan and Tibet
- The experience and tools developed during the project implementation are consolidated, shared, and adaptable to new contexts
*Relevant project documents (projects log framework and annual projects action plans)will be made available for detail information about the projects.
- Description of the Assignment
- Overall objective of the final evaluation
An assessment of overall achievement and limitation of the projects, to provide the project partners and project donors with a global understanding and vision of the relevance, effectiveness, efficiency, sustainability, and impact of the project approaches and quality of activities implemented in the project and to share lessons learned.
The realisation of the external evaluation is an integral activity of the project. It shall provide the donor with the relevant information to appreciate the execution of the project. At the same time it provides the project partners with a critical analysis of the implemented activities and possible adaptations to the context. The evaluation shall provide specific orientations for future initiatives and the sustainability of projects. The evaluation’s results are in a wider sense a tool for advocacy and mobilization for the project partners and relevant actors for the continuation or duplication of the action. Finally the evaluation will provide the project partners with sufficient information regarding project results, partnership analysis and overall recommendations in order to further develop similar activities.
3.2 Specific Objectives of the mission
To conduct a final evaluation of the projects, including
- An analysis of the level of achievement of the indicators at objectives, results and activities level as defined in the logical framework, as well as according to the set criteria: relevance, effectiveness, efficiency, impact and sustainability.
- An analysis of the partnership relationship with HI; partnership with CDPF, CRRC, YDPF, YRC, Shizong DPF and Chengjiang DPF.
- Identify key lessons learned and good practices in the projects.
- An analysis of management capacity of YDPF and YRC respectively to implement CBR and institutional rehabilitation programme; based on the findings draft exist strategy for HI in the scenario the project will be extended till December 2017.
- Evaluation criteria
- Relevance and quality of project design
The extent to which the objectives of the projects are consistent with beneficiaries’ requirements, the country needs and the priorities of the projects partners, for functional rehabilitation and social inclusion of people with disabilities.
-Did the project meets the demands and needs of beneficiaries and helps achieve the priorities of other stakeholders (authorities, partners, donors, etc.).
-How do the current partnerships and collaborators contribute to achieving the specific objective, the results and the sustainability of our action?
-The extent to which the project facilitated partnerships and collaborations(DPF and YRC). What are their strengths and weaknesses?
-How relevant was the project strategy in the Chinese context? What were the strong and weak points of this strategy?
-Appropriateness of the Objectively Verifiable Indicators (OVIs) of achievement as in the logical framework
-Realism in the choice of quantity of inputs – financial, human and administrative resources (notably, was the allocated original budget relevant with regard to the project activities design and their implementation?)
-Did the project adapt its action to the intervention setting (socio-cultural and historical determinants, security, logistical and regulatory constraints, etc.) and its evolution?
4.2Efficiency:Sound management and value for money
How well the various activities transformed the available resources into the intended results in terms of quantity, quality and timeliness. Comparison should be made against what was planned.
-To what extent the project has utilized its resources (e.g. time, money, human resources, implementing partners and government partners) efficiently?
-Does the project have appropriate and efficient financial monitoring tools?
-Outline the key elements of the management process. What are its strengths and weaknesses?
-The extent to which the costs of the project have been justified by the benefits. What quantitative and qualitative elements stand out?
-What resources from the partners contributed to the implementation of the project?
-What was the quality of synergies among other rehab and CBR projects in China (involvement in decision making, contribution in project implementation, communication mechanism)? How have these synergies contributed to the efficiency of the project?
4.3Effectiveness: Achievement of purpose
The extent to which the project’s results are attained and the specific objectives achieved, or are expected to be achieved.
-How the projects being monitored and managed in county level, provincial level and national level; and how the local partners integrate the projects into their daily work management?
-To what extend the actual results match the performance targets set out initially (if not, highlight the possible explaining factors and recommendations to address gaps in the future, would a subsequent phase be possible/necessary);
-The extent to which the target groups have access to the results/services (identify remaining barriers if any), as apparent by key stakeholders, in particular people with disabilities.
-How effective were project implementation strategies in realizing the objectives of accessing rehabilitation and social inclusion through:
Effectiveness of identification and referral systems;
Effectiveness of service delivery (e.g. PSS support, institutional rehabilitation, economic inclusion, awareness programme, etc.)
-To what extend the capacity building activities improved the quality of rehab and CBR services ( e.g., capacity building of YRC rehab professional, YRC management staff, CBR workers, DFP management staff at national-provincial and local level),
-Whether any shortcomings were due to failure to take into account cross-cutting or overarching issues such as gender, most vulnerable group, people with intellectual disabilities, aging population, etc.
4.4Impact and Sustainability
The extent to which the objectives of the project have been achieved as intended, in particular, the project planned overall objective. An analysis whether the positive outcomes of the project and the flow of benefits are likely to continue after the external funding ends.
Impact
-What is the project’s key impacts, especially for inclusion of people with disabilities, access to services and capacity building of service providers: