CLTS Workshop on M&E, Verifications, Follow-ups and Learning
August 2012 |Lilongwe, Malawi
International Workshop on CLTS M&E, Verifications, Follow-ups and Learning
Hosted by: IDS | Crossroads Hotel | Lilongwe Malawi | August 6 – 10, 2012
Table of Contents
Day 1: August 6. 2012 3
Opening 3
Logistics 3
Angola Presentation 3
Sanitation Mapper Presentation 3
ODF Rural Kenya Presentation 4
Ethiopia Presentation 4
Day 2: August 7. 2012 5
Feedback from yesterday (issues, thoughts and learning) 5
Indonesia Presentation 5
Nigeria Presentation 7
Rwanda - Village Mapping 8
India Presentations 8
Urban Mapping – Mathare Experience 9
Bangladesh Presentation 9
Malawi Presentation 11
Day 3: August 8. 2012 12
Day 4: August 9. 2012 12
Site Visit Recap 12
Nepal Presentation 14
Ghana Presentation 15
Zambia Presentation 16
Uganda Presentation 17
Day 5: August 10. 2012 17
Four Minute Presentations 17
Group Work & Messages for Government 20
Appendix A: List of Participants 22
Day 1: August 6. 2012
Opening
Opening remarks were made by the Director of Sanitation for Malawi, Mr. Mpasa. He welcomed all the participants and acknowledged the hard work put in by IDS to convene the workshop. This was followed by remarks from Robert who outlined some of the reasons behind the workshop: reports which paint and over-favourable picture on the status of CLTS and the generation of numbers which do not reflect the true situation on the ground. He urged everyone to pool their experiences and ideas with the aim of producing something that can be shared with others. He also encouraged thinking of learning systems, and to reflect on how we as CLTS implementers can learn, adapt, and adjust as we go through the CLTS process.
Logistics
Introductions were made in a few different methods, which gave everyone a chance to see who they would collaborate with in the coming week. Many government officials were present, as well as NGO officers, from multiple countries in Africa, Asia, Europe and North America (for complete list of participants please see Appendix A). Ground rules were set by the participants, followed by a brainstorming session where participants shared which issues they hoped to cover, what they hope to learn and take away from the workshop, and whether they have any practical experience to contribute. This session created the roadmap for future sessions of the workshop.
Angola Presentation
Presented by Simon Cohen, People in Need
· Piloting an M&E system that is adapted from WaterAid Sanitation Mapper which takes GPS coordinates of each toilet
· The coordinates are entered into an Excel database which produces a map that is linked to Google Earth
· Allows for tracking of triggered and ODF communities
· Handover to government and ability to frequently update information unclear; puts into question scalability and sustainability of the system
Sanitation Mapper Presentation
Presented by Sue Cavill, WaterAid UK and SHARE
· Provided more details on the capabilities of the system (building off the Angola presentation)
· WaterAid has piloted the Mapper in Bangladesh and run a training course in Tanzania for the Centre for Community Initiatives
· Captures rich information for each toilet, including their hygienic conditions (collects more information than the Angola system)
Questions & Comments:
· Who collects this information?
Right now NGO staff, using GPS devices (which replaced the paper based system)
· What is the government response to this system?
Positive, they are keen to use it after the pilot stage
· Which indicators are being collected?
Agreed upon indicators at the national level
· How do we ensure that the product is easy to use, and at which levels is it used at?
ODF Rural Kenya Presentation
Presented by Kenyan participants
· The roadmap to ODF Kenya has systems and structures which have been set up to support it, including specific committees and staff dedicated to CLTS
· Two key factors for strategy success: attitudes and behaviours of key facilitators, and sensitive support of institutions
· They are currently putting weight behind follow-ups as data was collected which showed that they were lagging in declaring ODF communities; so they re-focused and stopped triggering until the ODF numbers increased
· Community health workers and Natural Leaders conduct follow-ups
· Third party verification is conducted, using national verification protocols and ToRs which provide the criteria for selection of third party organizations who will verify
· Incentives provided for CLTS work: lunch and transport for field work, and performance management rating for each person trained in CLTS (they have to declare 10 villages ODF to receive high performance rating, after which they receive a Certificate of Competence which can be used for promotions)
· Community rewards: after they are declared ODF, the ministries and communities converge to see what facilities are needed in the area which the government can provide
· Districts are encouraged to put local revenues towards CLTS as part of their performance management criteria
Ethiopia Presentation
Presented by Muchie Kidanu, UNICEF Ethiopia
· Ethiopia implements CLTSH – hygiene component is added (hand washing and safe water handling)
· Structure for M&E: Federal Ministry of Health (National Task Force) à Regions à Zones à Woredas à Kebeles à Villages à Health and Development Armies àHouseholds
· The National Task Force develops the guidelines for monitoring to be brought down
· Village level monitoring is led by the Health Development Armies, which is led by a woman from a model household who monitors on other health issues
· Health extension workers are at the Kebeles level, where they collect information from the village and consolidate them to report to the Ministry of Health
· Ministry of Health convenes annual review meetings; aside from this feedback mechanisms exist but unclear how strong they are
· Verification conducted by health extension staff, who report the information to the woreda to verify, then regional and federal levels then verify the woreda (UNICEF and Plan also play a role in verification)
· Hygiene enters the picture from the beginning, even at CLTS triggering
Day 2: August 7. 2012
Feedback from yesterday (issues, thoughts and learning)
· Need for process monitoring so people can take corrective action when needed
· Rate of success for other countries to look more in-depth at what it takes to bring a village to ODF
· The notion of incorporating other hygiene elements into the CLTS program
· Government support structures to CLTS is important
· CLTS for pastoral areas
· Countries with low rates of ODF - different types of issues than in countries with over 50% ODF
o Do strategies change as you move along the spectrum of country wide ODF? It feels that it gets tougher as you go
· Debate on targeting subsidies after CLTS (child headed households, senior headed households, etc.)
Indonesia Presentation
Presented by Amin Robiarto, Government of Indonesia
· Introduced in 2006 through the TSSM (Total Sanitation and Sanitation Marketing) program supported by the Water and Sanitation Program (WSP, World Bank); pilot in East Java province.
· Three focus areas: demand creation at scale with CLTS (and Behaviour Change Communications) , supply improvement at scale through Sanitation Marketing, and Enabling Environment (EE) building (institutional policies and practices) for demand and supply forces to grow and sustain each other . M&E is a part of EE building
· Indonesia has 33 provinces, and over 400 districts. A typical East Java village = 1000 households; as of now 55% ODF and 40Million have access to improved sanitation and around 40 million do not have access to rural sanitation
· Use of local definition of improved and unimproved sanitation (which are compliant with Joint Monitoring Program [JMP] definitions) makes community monitoring data usable by government systems
· Paper-based monitoring system was not working as triggered villages reached into hundreds and thousands. Monitoring information reached districts once only every few months which didn't meet the government’s and the project’s needs. TSSM transitioned to a cell phone SMS –based reporting system in 2010 wherein reporting takes place monthly
· Baseline access data and progress thereafter collected for each village. Monitoring data is picked up by Health functionaries from community sanitation maps and registers maintained and updated by communities, and transferred via sms into district database gateways.
· The designated Health workers’ cell phone numbers are registered with the district database gateway. Reporting done through text messages in a uniform format. The text messages enter the district database which automatically checks for validity and aggregates data using the software (WSP-developed) installed in district Health Office computers.
· Program performance is benchmarked and monitored across all districts using 10 indicators, such as: budget allocation for non-construction activities, number of triggered villages and number of ODF villages per year, program cost per ODF community achievement, etc.
Question / AnswerWho pays for the SMS / Paid by the district government
SMS Reporting / Data fields separated by commas. Auto-checks for validity in the system. Baseline access data is sent at triggering, and progress, update texts are sent every month thereafter. When access numbers approach 100% households, that’s when verification is planned
How does the data move to the national level? / Natural leaders and communities monitor their village situation and maintain maps and records. The Sanitarian (Community Health Center worker) picks up this data and sends it by text messages to the district database. District staff relay the same to the province or national level. During 2012 a web-based national monitoring system has been established, which receives data from districts directly every month. Not all districts are able to send data yet.
Workshops to build local government capacity to make the national monitoring system functional have been conducted.
Community level monitoring / Natural leaders and Village Sanitation Committees conduct monitoring and district staff (Sanitarian) obtains data from them for transferring to districts.
Media / Annual competition among districts in East Java for good governance award by the Java Post media network - sanitation program performance now included among district evaluation criteria. Java Post Media group is the one evaluating and awarding the best district annually - not government or districts themselves.
Transition to local government costs / TSSM a Cost sharing partnership from the start. Training and 9 months of a District Facilitator’s time paid by WSP; district governments cover the costs of sending their staff for training and all operational costs of CLTS triggering and monitoring/verification. This is also the plan for National roll-out, with the national government paying for capacity building programs, with technical assistance and guidance from WSP and other donor partners.
How do you deal with inflated reporting / Built in checks in software installed in district computers to prevent this from happening (e.g. if progress is lower than the baseline, a flag is raised and spot checks done to ensure information is correct). A final check is provided by the ODF verification exercise.
Now, in the web-based national monitoring system. Sanitarians also have access to their data online and can check it to make sure it is correct. If they found anomaly data, then communicated to community based on social map
Incentives for sending SMS / For instance in Jombang district, Each Sanitarian is given $0.50 per month for sending SMS; they only need to use it once or twice to send the information per village (average they cover 6 – 10 villages), the rest of the time they use the unit for their own purposes
Nigeria Presentation
Presented by BisiAgberemi, UNICEF Nigeria
· The presentation focused on Reporting, Monitoring, verification and certification of CLTS implementation in the country.
· Four levels of reporting of CLTS activities are in place: Community; Local Government; State; and National. There is a well structured line of reporting of CLTS activities.
· There is simple CLTS database using Excel and reports are sent in to States and National by e-mails while hard copies of the report are sent by communities to the Local Government.
· Protocol developed and agreed to by all major stakeholders for verification and certification of ODF and Total Sanitation Community including a checklist for monitoring
· Two levels of verification are involved; First level of verification involved un-scheduled visits by Local Government WASH Units/Departments to claimed ODF communities; and the second level of verification of the claimed ODF communities is carried out by the State Rural Water Supply and Sanitation Agencies. The certification of ODF communities is conducted by the State Task Group on Sanitation and for a community to be certified, the community should have sustained ODF for at least 6 months. , National Task Group on Sanitation conduct quarterly monition visits for spot-checking and validation of certified ODF communities for quality assurance.
· Some states have CLTS champions supporting advocacy and awareness creation .
Question / AnswerDifference between ODF and TS (total sanitation) / Total Sanitation Includes other components of sanitation such as domestic hygiene, personal hygiene and general environmental sanitation.
6 month for community declaration of ODF - how do you tie that with the progress that you're making / For full certification as ODF, community is expected to have sustained ODF for at least 6 months to ensure sustained behavioural change. There are two categories of communities; WASHCOM declared ODF communities and Fully certified ODF communities. Based on monitoring reports, the relapse rate is low. The certification of ODF communities is conducted by the State.
Coordination between government and NGOs / There is sustained engagement of NGOs for CLTS implementation and the Society for Water and Sanitation (NEWSAN) has been sensitized on CLTS and quite a large number of NEWSAN members are involved in CLTS implementation in the country.
Local governments report every month - they have to report ona lot of things. / It is part of their work to report on ODF.
Local chiefs / Local Chief are essential for the overall success of CLTS implementation and they are engaged in all aspects of CLTS implementation at community level . The Chiefs have been very useful in local enforcement of sanctions and implementation of Community Action Plans. Sustained ODF and the path to ODF
Country wide Total sanitation Date. / The country has not set a target date for the achievement of Total Sanitation.
Donor support for CLTS is high. Donors have accepted CLTS as the approach for sanitation promotion in rural areas.
Rwanda - Village Mapping
Presented by Ashish Shah