效果效率影響可持續(xù)性課件

1、IFADs Approach to Project EvaluationPresentation at SHIPDET, 5 May 2015國際農(nóng)業(yè)發(fā)展基金的項(xiàng)目評(píng)價(jià)方法上海國際發(fā)展評(píng)價(jià)培訓(xùn)春季班,2015年5月5日Contents 綱要Background on IFADs Independent Office of Evaluation (IOE)Some thoughts on why independent evaluation is usefulExperiences in planning and conducting evaluationsUse of project eval

2、uationsIOEs evaluation products國際農(nóng)發(fā)基金獨(dú)立評(píng)價(jià)辦公室（IOE）背景介紹對(duì)獨(dú)立評(píng)價(jià)作用的認(rèn)識(shí)評(píng)價(jià)的計(jì)劃與實(shí)施經(jīng)驗(yàn)項(xiàng)目評(píng)價(jià)的用途IOE的評(píng)價(jià)產(chǎn)品2INDEPENDENT OFFICE OF EVALUATION OF IFAD (IOE) 國際農(nóng)發(fā)基金的獨(dú)立評(píng)價(jià)辦公室Introduction 背景介紹3Background on IFAD 國際農(nóng)發(fā)基金概況IFAD = International Fund for Agricultural DevelopmentSpecialised UN Agency, operating as an internationa

3、l financial institutionloans to governments for agricultural investment projectsSmaller grant programme to a wider variety of actors for research, innovation and capacity buildingIFAD started operations in 1978. Since then, approved operations for US$ 16 billion (November 2014)IFAD = 國際農(nóng)業(yè)發(fā)展基金專門化的聯(lián)合國

4、機(jī)構(gòu)，按照國際金融機(jī)構(gòu)的方式運(yùn)作貸款各國政府的農(nóng)業(yè)投資項(xiàng)目小額贈(zèng)款-致力于研究、創(chuàng)新和能力建設(shè)的各類機(jī)構(gòu)IFAD從1978年開始運(yùn)營。截至2014年11月，批準(zhǔn)的項(xiàng)目金額達(dá)160億美元。4Independent Office of Evaluation of IFAD國際農(nóng)發(fā)基金獨(dú)立評(píng)價(jià)辦公室Responsibility of the Independent Office of Evaluation (IOE)Special division of IFAD; does not report to IFADs ManagementReports to the Executive Board o

5、f IFAD (representative of Member States)Evaluation Policy 2003 and 2011Two main principles: accountability and learning獨(dú)立評(píng)價(jià)辦公室（IOE）的職責(zé)IFAD的特設(shè)部門，不向IFAD的管理層匯報(bào)向IFAD的執(zhí)行董事會(huì)報(bào)告（執(zhí)董會(huì)由推選的成員國代表組成）評(píng)價(jià)政策2003與2011版兩條主要原則：問責(zé)與學(xué)習(xí)5Types of Evaluations 評(píng)價(jià)類別Corporate-level EvaluationsCountry Programme EvaluationsProject

6、 EvaluationsEvaluation Synthesis ReportsImpact Evaluations Annual Report on Results and Impact of IFAD Operations (ARRI)機(jī)構(gòu)層面的評(píng)價(jià)國別項(xiàng)目評(píng)價(jià)項(xiàng)目評(píng)價(jià)評(píng)價(jià)綜合報(bào)告影響評(píng)價(jià)年度結(jié)果與影響報(bào)告6WHY INDEPENDENT EVALUATION?為什么要做獨(dú)立評(píng)價(jià)？Some general considerations 一般性問題7Independent Evaluation獨(dú)立評(píng)價(jià)Self-evaluation自評(píng)價(jià)Monitoring監(jiān)測(cè)Accountability a

7、nd Learning in IFADIFAD的問責(zé)與學(xué)習(xí)8Independent Evaluation 獨(dú)立評(píng)價(jià)獨(dú)立評(píng)價(jià)對(duì)績效進(jìn)行客觀透明的評(píng)判有助于營運(yùn)知識(shí)的創(chuàng)造與傳播能盡早獲得關(guān)于營運(yùn)情況的評(píng)價(jià)結(jié)論與經(jīng)驗(yàn)教訓(xùn)，有助于改進(jìn)決策重點(diǎn)關(guān)注與發(fā)展效果有實(shí)質(zhì)性關(guān)聯(lián)的話題和問題與各種利益相關(guān)者密切合作的同時(shí)，保持IOE的獨(dú)立公正性遵循職業(yè)標(biāo)準(zhǔn)使用來自于利益相關(guān)者的反饋為創(chuàng)新和學(xué)習(xí)提供外部視角將管理的重心從關(guān)注投入轉(zhuǎn)移到關(guān)注結(jié)果Independent EvaluationJudges performance in an objective and transparent wayContributes

8、to operational knowledge creation or disseminationDelivers operations evaluation findings and lessons early enough to inform decision makingFocuses on topics and issues that have substantial relevance to development effectiveness.Engages with diverse stakeholders while maintaining its integrity Adhe

9、res to professional standardsUses feedback from stakeholdersProvides an external perspectives for innovation and learningShifts management focus from inputs to results(Based on Bob Picciotto, 2013. Evaluation Independence in Organizations; Journal of Multi Disciplinary Evaluation Volume 9, Issue 20)

10、 9Exercise 練習(xí)What are the differences between “independent evaluation” and “self evaluation”?What are the advantages and disadvantages for each of the two types of evaluations?“獨(dú)立評(píng)價(jià)”與“自評(píng)價(jià)”的區(qū)別是什么？兩種評(píng)價(jià)各自的優(yōu)缺點(diǎn)是什么？10Independent & Self-Evaluation 獨(dú)立評(píng)價(jià)與自評(píng)價(jià)Self-evaluationIndependent evaluationCloser to the

11、action Lacks distance, less objectiveExposed to vested interests Often lacks evaluation skills Interests and concerns may differ from beneficiaries. Likely to support risky management decisionsLikely to select evidence that supports assumptionsChallenges assumptions on the design of policies & progr

12、amsMakes self-evaluators think about organizational achievements, systematic stakeholder consultation, reaching consensus about program goals and focusing resources program goalsEnhances effectiveness of self-evaluationValidates information自評(píng)價(jià)獨(dú)立評(píng)價(jià)與評(píng)價(jià)的活動(dòng)關(guān)系更近 因缺乏距離，不夠客觀易受既得利益的影響通常缺乏評(píng)價(jià)技能可能有著與受益人不盡相同的利益

13、與關(guān)注點(diǎn)很可能會(huì)支持風(fēng)險(xiǎn)較大的管理決定很可能會(huì)選擇那些支持假設(shè)的證據(jù)挑戰(zhàn)政策與項(xiàng)目設(shè)計(jì)時(shí)的假設(shè)促使自評(píng)價(jià)人員對(duì)組織取得的成績、對(duì)利益相關(guān)者的系統(tǒng)性咨詢、對(duì)項(xiàng)目目標(biāo)達(dá)成共識(shí)、圍繞項(xiàng)目目標(biāo)實(shí)現(xiàn)來進(jìn)行資源配置等進(jìn)行思考提高自評(píng)價(jià)的有效性驗(yàn)證信息11PLANNING AND CONDUCTING EVALUATIONS評(píng)價(jià)的設(shè)計(jì)與實(shí)施Some experiences and tips 經(jīng)驗(yàn)與技巧12IOEs Evaluation Process獨(dú)立評(píng)價(jià)辦公室的評(píng)價(jià)流程Selection of cases & themesApproach paper Desk reviewData collection

14、 in the fieldDebriefing Draft report & peer reviewComments by Government & IFAD Management Feedback to StakeholdersManagement responseAgreement at completion pointFinal reportCommunication products選擇案例和主題方法文件案頭審查實(shí)地?cái)?shù)據(jù)采集任務(wù)報(bào)告起草報(bào)告和同行評(píng)議政府和IFAD管理層進(jìn)行評(píng)論反饋給利益相關(guān)者管理層的反饋評(píng)價(jià)完成時(shí)達(dá)成協(xié)定評(píng)價(jià)報(bào)告終稿宣傳材料13Planning an Evaluati

15、on 評(píng)價(jià)的計(jì)劃Clarify purpose, users & useDefine evaluation subject Evaluation questionsAnalytical frameworkDefine methodologyDevelop tools明確評(píng)價(jià)的目的、使用者和用途定義評(píng)價(jià)主題評(píng)價(jià)問題分析框架確定評(píng)價(jià)方法開發(fā)評(píng)價(jià)工具14Evaluation Criteria 評(píng)價(jià)標(biāo)準(zhǔn)RelevanceEffectivenessEfficiencyImpactSustainabilityGender equality and womens empowermentNatural res

16、ources and climate changeInnovation and Scaling-upBorrower performance (Government)Lender performance (IFAD)相關(guān)性效果效率影響可持續(xù)性性別平等和婦女賦權(quán)自然資源和氣候變化創(chuàng)新與規(guī)模擴(kuò)大借款人的績效（政府）貸款人的績效（IFAD）15Exercise 練習(xí)Which evaluation criteria are you familiar with?Please identify a few evaluation questions to assess those criteria.你對(duì)哪

17、種評(píng)價(jià)標(biāo)準(zhǔn)比較熟悉？請(qǐng)列出幾個(gè)評(píng)價(jià)問題來對(duì)那些評(píng)價(jià)標(biāo)準(zhǔn)進(jìn)行評(píng)估？16Evaluation Framework 評(píng)價(jià)框架體系Evaluation questionsDetailed questions/ indicatorsData sourcesMethods usedRelevanceQ1Q2Q3EffectivenessEfficiencyImpactSustainability評(píng)價(jià)問題詳細(xì)問題/指標(biāo)數(shù)據(jù)來源使用的方法相關(guān)性Q1Q2Q3效果效率影響可持續(xù)性17Data Collection Methods 數(shù)據(jù)收集方法Qualitative and semi-structuredDirec

18、t field observationsKey informant interviewsFocus group discussionsCase studies Participatory techniques (e.g. wealth ranking, community mapping, historical transects, most significant changes)QuantitativeWeb-based surveys Large sample household surveys18定性數(shù)據(jù)與半結(jié)構(gòu)化的數(shù)據(jù)直接的實(shí)地觀察關(guān)鍵知情人訪談焦點(diǎn)小組討論案例研究參與式技術(shù)（如財(cái)富

19、排名、社區(qū)地圖繪制、歷史橫切面、最顯著變化）定量數(shù)據(jù)基于網(wǎng)絡(luò)的調(diào)查大樣本的入戶調(diào)查Exercise 練習(xí)Which data collection methods are you familiar with? List as many as you can!Which methods are best suited for the following evaluations:Evaluating the impact of drinking water systems in 50 villagesEvaluating the efficiency of small scale wind pow

20、er projects in two provincesEvaluating the effectiveness of training for accountants你對(duì)哪種數(shù)據(jù)收集方法比較熟悉？請(qǐng)盡可能多地列舉。下列評(píng)價(jià)最適用哪種數(shù)據(jù)收集方法：對(duì)50個(gè)村莊的飲用水供水系統(tǒng)的影響進(jìn)行評(píng)價(jià)對(duì)兩個(gè)省的小型風(fēng)電項(xiàng)目的效能進(jìn)行評(píng)價(jià)對(duì)會(huì)計(jì)從業(yè)人員培訓(xùn)的效果進(jìn)行評(píng)價(jià)19Rating System 評(píng)級(jí)體系RatingAssessment Category6Highly satisfactory SATISFACTORY5Satisfactory4Moderately satisfactory3Moder

21、ately unsatisfactory UNSATISFACTORY2Unsatisfactory1Highly unsatisfactory評(píng)級(jí)評(píng)價(jià)類別6非常滿意滿意5滿意4比較滿意3比較不滿意不滿意2不滿意1非常不滿意20Report Outline 評(píng)價(jià)報(bào)告的提綱Executive summaryManagement responseEvaluation objectives, methodology and process The projectProject contextProject implementationMain evaluation findingsRural pov

22、erty impactCore criteriaOther performance criteria Overall project achievementPerformance of partners ConclusionsRecommendations摘要管理層的反饋意見評(píng)價(jià)的目的、方法與流程項(xiàng)目項(xiàng)目背景項(xiàng)目實(shí)施評(píng)價(jià)的主要發(fā)現(xiàn)對(duì)農(nóng)村貧困率的影響核心標(biāo)準(zhǔn)其它績效標(biāo)準(zhǔn)項(xiàng)目的總體成績合作伙伴的績效結(jié)論建議21COMMUNICATION AND USE OF EVALUATIONS IN IFAD評(píng)價(jià)在IFAD的交流與使用After the evaluation 評(píng)價(jià)完成之后22Use of Project Evaluations 項(xiàng)目評(píng)價(jià)的用途Project evaluation