I. INTRODUCTION

This Evaluation Procedure (EP) describes relatively simple and quick method of evaluating Total Sanitation Campaign (TSC) projects launched in the District (S) with funding from Government of India, State Governments and Beneficiaries. A public investment of this type has to satisfy social, technical, financial, legal and administrative criteria. The main concern is to establish whether the means chosen are effective given the goals set, whether the means chosen are the least-cost given the pattern of resource availability and whether the outcome is in important contribution to the socio-economic goals. In other words are the means effective efficient and making a significant contribution to achieve the declared goals.

Accordingly, the guidelines narrated herein are meant primarily for the Members of Review Team of sanitation Programmes willing to evaluate the progress of TSC project. Total Sanitation Campaign adopts demand responsive, participatory and community led programme along with campaign strategy on project mode. Implementation of the TSC projects is based on adoption of simple-user friendly and affordable technologies with nominal subsidy. As such the procedure prescribed in this Template concentrates more on evaluation of functioning and utilization of facilities and complementary hygiene education and impact of the project on health and social benefits.

The evaluation Procedure (EP) is based on the concept that there are three sequential stages that need to be evaluated in the project district i.e. i) enabling policy environment ii) implementation methodology adopted including institutional framework & iii) project functioning, fund utilization and socio-economic impact. Deficiencies found in the evaluation of a particular stage call for the improvement in the output of the previous stage or in the inputs to the stage under review. There is, therefore, little value in evaluating a particular stage unless the objectives of the previous stages have not been largely achieved. Furthermore, evaluation of impact is only appropriate for projects known to be correctly functioning and properly utilized.

2. Salient Feature of Total Sanitation Campaign Project:

The salient features of the Total Sanitation Campaign Project under the Central Rural Sanitation Programme are as follows:

I. Strategy : The Strategy is to make the programme “ community led” and “people centered”. A “ demand driven approach” is to be adopted with increased stress on awareness creation and demand generation from the people for sanitary facilities in households, schools, Anganwadis, Community and for cleaner environment.

II. Implementation : The physical implementation gets oriented towards satisfying the felt-needs wherein individual beneficiaries choose from a variety of options for their household latrines.

III. Components: The programme components are as follows:

a) Start up Activities: The Start up activities comprises conducting baseline survey and KAP (Knowledge, Aptitude, Practice) Studies.

b) IEC activities: IEC activity intends to create the awareness and generate demand/felt need for sanitary facilities in the rural areas for Households, Schools, Anganwadi, Balwadies and Women Complexes.

c) Rural Sanitary Marts (RMS) and Production Centres (PCs): The main aim of having a RMS is to provide materials and guidance needed for construction of different types of latrines and other sanitary facilities, which are technologically and financially suitable to the rural areas. Production Centres are means to improve the production of cost effective affordable sanitary materials.

d) Individual Household Latrines: A duly completed household latrine shall comprise of a Basic Low Cost Unit (without the super structure). In the first phase, the programme is aimed to cover all the Below Poverty Line (BPL) families.

e) Women Sanitary Complex: Village Sanitary Complex for Women should be setup in a place in village accetable and accessibel to women. The Gram Panchayat users and Self-Help Groups should own and maintain such units.

f) School Sanitation: Toilets in Government Schools i.e. Primary, Upper Primary, Secondary and Higher Secondary should be constructed and students educated to use the facilities.

Note: For detailed information Guidelines on Central Rural Sanitation Programme (Total Sanitation Campaign) issued by the Department of Drinking Water Supply, Ministry of Rural Development, GOI in May, 2002 may be referred.

PART B

INDICATORS TO BE USED FOR EVALUATION OF TSC PROJECTS AT THE DISTRICT LEVEL IN CONSULATION WITH DWSM AND ZILLA PANCHAYAT, BENEFICIARIES AND FIELD VISITS.

Evaluation of TSC Projects intends to identify the implementation status through the following indicators:

I. Indicators for Enabling (Policy)Environment
i. Existing political will, State level support and legislative framework for community managed projects.
ii. Priority accorded by District Administration, Zilla Parishad. Project Implementation and Panchayati Raj Institutions to the projects.
iii. Proper understanding of the project concepts at the State Districts and Gram Panchayats.
iv. Capacity of the District level to take up social mobilisation and awareness campaign and human resource development programme in Gram Panchayat.
v. Panchayat, Community powers to plan and implement schemes capacity, affordability and demand.
vi. Resources availability-trained manpower, material and funds.
vii. Capacity of the existing NGOs, CBOs and Social Organizations etc., to implement the reform initiatives.

II. Indicators for Project Implementation
i. The institution al mechanism at the State and Project district levels and implementing agencies involved. NGOs engaged in the DWSC/ZP and in the project implementation.
ii. The Process/approach adopted for creating/generating demand (social mobilisation and awareness campaign), human resource development, capacity development and implementation strategy.
iii. Actual implementation methodology adopted
iv. Baseline survey carried out including KAP studies.
v. IEC activities implemented – General Awareness generation and specific in the Gram Panchayats.
vi. HRD and Capacity Building of the Stakeholders in the Institutions involved.
vii. Number of RSMs and PCs established and role in sanitation promotion
viii. Number and percent of Households having latrines before the implementation of the TSC project in the district (block wise breakup)
ix. Number and percent of household which have adopted latrine under TSC project – Above Poverty Line and Below Poverty Line families.
x. Type of latrines constructed (single /double pit) – Material used for base and super structure – Unit Cost of each type
xi. Contribution by the beneficiaries (labour, cash, kind)
xii. Number of School Toilet Complex (STC) Constructed under TSC- Average cost of per unit (STC) and cost sharing pattern – Contribution by Students, Parents and Teachers.
xiii. Number of Women Toilet Complex (WTC) Constructed Average cost of per unit (WTC) and cost sharing pattern Number of women using the TSC in the project district.

III. Indicators on use of Latrines and Impact.
i. Proportion of people using latrines everyday (Male/Female/Children)
ii. Hand washing practice after defecation adopted – Use of soap/soil/ash etc.
iii. Reduction of excreta related diseases.
iv. More number of working days availed.
v. Less expenditure on medicine
vi. Women’s dignity, privacy, old and sick people’s convenience and children need fulfilled.
vii. Better understanding of the water and excreta related diseases and domestic hygiene.

IV. Specific Comments:
i. Limitations of the project policy guideline, process implementation strategy and funding pattern.
ii. Project Implementation Status Analysis – Constraints Innovations – Success Stories.
iii. Recommendations.

PART-C

1. HOUSEHOLD LATRINE SURVEY QUESTIONAIRE

District: ________________ Block ___________________

Gram Panchayt: _____________ Village _______________

Interviewer: _________________ Interview Date

1. Household identification

2. Number of household members

3. Socio-ecconomic status (good/moderate/poor) ________________ (Use plots size, house number or cattle, educational level or other locally relevant indicators of wealth and/income.)

4. Latrine constructed

i. Have you built a latrine?

Yes , which type (if options)

No , continue to Question 8

ii. When was it completed? ____________________ (month/year)

iii. Cost of latrine

iv. Contribution by the beneficiaries (labour, cash, material)

v. How many of the household use the latrine regularly?

5. Reasons for Construction of latrine (Assign priority 1 to 7)

6. Are there any problem with latrine already constructed?
e.g. (v which is applicable)

7. How do you think your latrine needs improvement ?

8. Have you been informed about the need for a latrine and support the Government is providing for latrine construction? ( Applies to those without a latrine)
Yes No

9. If yes, have you considered taking up your own toilet?
Yes No

10. What is the reason(s) why you have not yet joined or why you do not wish to join?

11. Maintenance and Performance of Latrine

12. Overall comments:

PART D

PROJECT DISTRICT SANITATION DATA BASE

1. Date of approval of the Project:

2. Total cost of the project approved: Rs. lakh
3. GOI share: Rs. lakh
4. State share: Rs. lakh
5. Beneficiary share Rs. lakh
6. GOI share released: Rs. lakh
7. State share released: Rs. lakh
8. Constitution by Beneficiaries Rs. lakh
9. Constitution of the DWSM & DWSC committee: Yes/No,
If yes, date
10. District profile:

i. Number of blocks
ii. Number of gram panchayat
iii. Number of census village
iv. Number of households
v. Number of households with toilets/without toilets
vi. Present population (% covered with toilet)
vii. Number of government school with toilets:

11. Scheme funding pattern adopted:

(a) Individual toilet
(b) School toilet complex
(c) Women toilet complex

12. Organisational Structure & institutional arrangement

a. Flow Chart
b. Delivery mechanism for individual household latrine

i. Role of NGO
ii. Role of ZP and other institutions
iii. Role of PC/RSM

c. Delivery Mechanism for schools/women complex

Flow Chart

13. IEC & Social Mobilisation

i. State Sanitation Cell undertaking IEC
ii. NGO partner

a. Structure
b. Strategy
c. Training Details

iii. IEC Activities

a. Group meeting
b. Poster display
c. Wall writing/painting
d. Workshop
e. House to house visits
f. School Sanitation prayers
g. Competition among schools
h. Discussion in Gram Sabha
i. Any other activity

14. Coverage

a. Coverage
b. Use
c. Process
d. Cost sharing
e. Low/No subsidy
f. Technology options

15 Impact on health hygiene and quality of life

a. Shift in behaviour and value
b. More Cleanliness
c. Reported reduction in diarrohea diseases
d. Hygiene consciousness among people and children
e. Habit change in school children
f. Hand washing with soap
g. Change in lifestyle –use of improved chulha to avoid indoor air pollution

CENTRAL RURAL SANITATION PROGRAMME
TOTAL SANITATION CAMPAIGN
PROGRESS REPORT

Year _________ to Year __________

State/UT:_____________Project/District_____________Year_____

1. A. Physical Performance

1 B. Special Provisions:

2. Financial Performance

2 A. Receipts:

1 Opening Balance as on first day of the quarter ______________ (Rs.in Lakhs)

2 Central Releases : ______________ (Rs. in Lakhs)

3 State Releases : ______________ (Rs. In Lakhs)

4 Beneficiary/Panchayat contribution ______________ (Rs. in Lakhs)

5 Interest accured ______________ (Rs. in Lakhs)

6 Total availability of funds (1 to 5) ______________ (Rs. in Lakhs)

2 B. Expenditure

(i) Expenditure under Central Share : ____________ (Rs. in Lakhs)

(ii) Expenditure under State Share : ____________ (Rs. in Lakhs)

(iii) Expenditure under Beneficiary/Panchayat Share ____________ (Rs. in Lakhs)

Total expenditure during the quarter (I to III)

Percent of expenditure to total availability of funds: ____________