3.3 Effectiveness Evaluation Question #03
What are the intended and unintended, short and long-term, positive and negative impacts of (i) supporting the water supply and drainage and sanitation scheme construction in 25 towns and (ii) providing institutional support to MOC and VDB? What have been the challenges?
Guiding Question
To what extent has WSPST contributed to capacity development and the strengthening of institutions? What have been the key factors contributing and limiting capacity development?
Guiding Question
The outcomes of the policy and institutional support to MOC and other state agencies, especially in the view of the changing operating environment in Vietnam, including the privatization of the water supply sector? Have relevant policy-level changes happened as a result of WSPST?
Evaluation Question #04
To what extent have the coordination, collaboration and information sharing between different partners and stakeholders been effective
Priority Assessment [Box]
Functioning and Impact of the Sanitation Revolving Fund?
Guiding Question [Box]
What outcomes emerged as a result of the implementation of the Sanitation Revolving Fund?
Guiding Question
Have Vietnamese authorities allocated better financial and institutional resources to maintain the services in the long run compared to non-Finnish funded provinces and small towns? Are WS+DS schemes able to achieve full cost recovery, including loan and interest repayment?
3.4 Efficiency
Evaluation Question #05
To what extent is the quality and quantity of the produced results and outputs in accordance with plans? How are results and outputs applied by the beneficiaries and other stakeholders Evaluation Question #07
How well have the various activities transformed the available resources into intended results in terms of quantity, quality and time? Can the costs of WSPST be justified by the results?
Evaluation Question #06
To what extent has the management mechanism of the FRWF been efficient Priority Assessment
The functioning of the FRWF including its financial management, decision-making and financial appraisal procedures
Priority Assessment
The efficiency of the investment made and use of laboratory equipment purchased by WSPST
3.5 Sustainability Evaluation Question #08
To what extent the programme has achieved sustainable results Evaluation Question #10
To what extent are the implementing partners committed to maintaining services?
Priority Assessment
Functionality and Sustainability of WS and DS schemes
1.The level of technical functioning of the WS and DS schemes with emphasis on DS schemes.
Especially if the schemes are found to be non-functional, the reasons should be investigated 2. The level of customer satisfaction of the WS and DS schemes that have been built during the programme lifetime
3. Are there discrepancies between men and women or majority and minority ethnic groups in customer satisfaction?
4. Sustainability of the WS and DS schemes with focus on financial sustainability of the WS schemes and O&M activities and the adequate level of customer connections of the DS schemes Priority Assessment
Has the privatization of water services affected sustainability, efficiency and/or level of service?
Guiding Question
To what extent and in what ways has the design and implementation of WSPST addressed the issue of environmental sustainability?
3.6 Cross Cutting Objectives Guiding Question
To what extent did WSPST promote the cross-cutting issues of Finland’s development policy?
3.7 Aid Effectiveness Evaluation Question #11
How and to what extent has WSPST promoted mutual accountability and ownership?
Guiding Question
To what extent and how has WSPST coordinated with other relevant interventions? Is there evidence on mutual learning/joint efforts to achieve higher effectiveness of the interventions?
Guiding Question
To what extent and how does the WSPST complement thematically interventions by other donors? Has duplication of efforts been avoided? Did WSPST work towards mutually beneficial goals with the other interventions in the programme areas?
Evaluation Question #12
Has WSPST contributed to the implementation of other projects in the country or the sector transition strategy? Has it contributed to private-sector or civil society cooperation?
Guiding Question
Assess the involvement and cooperation between line ministries, including the coordination structures/mechanism between MOC and the Ministries of Finance and Planning and Investment and the Provincial People’s Committee
Guiding Question
Assess the involvement and cooperation of WSPST with government agencies at all levels and other development partners active in the financing of piped water supply and drainage/sanitation schemes in Vietnam
Evaluation Question #13
What is the added value provided by the Finnish support?
Guiding Question
What is the value added by WSPST as a framework for the provision of water supply, drainage and sanitation services and for development generally within Vietnam?
3.8 Programme Design, Steering and Monitoring Guiding Question
Was WSPST managed with reasonable regard for efficiency? What measures were taken to ensure that resources, including personnel were efficiently used?
Guiding Question
Could WSPST have been implemented differently to achieve the same (or better) results in a more cost-effective manner?
Guiding Question
How could efficiency be improved with future programs e.g. to avoid time delays?
Priority Assessment
Role of MFA and Embassy of Finland in Hanoi in the monitoring and steering of the Programme Priority Assessment
Performance of TA consultants in the management and monitoring of the Programme Priority Assessment [Box]
The appropriateness of the decision made to design and enter Phase III to ensure the sustainability of the results of the Programme.
The Evaluation Team did not prepare SWOT analyses for the sustainability of WS and DS as per Evaluation Question #09 (below) to avoid duplication as the responses are included in the text.
What are the possible strengths/weaknesses/opportunities/threats that enhance or inhibit the sustainability of the achievements including cross-cutting objectives? The SWOT analysis will address economic/financial, institutional, technical and socio-cultural aspects of WS and DS