OfficeEvaluationandOversight
Office Anual Report

Adapting to work under a pandemic

Adating

Due to COVID-19 OVE reorganized its work:

  • No missions
  • Virtual meetings and interviews with stakeholders
  • New methods for data collection and analysis
  • New evaluations designed with COVID restrictions in mind
Top

Lessons derived from 2020’s Country Program Evaluations (CPE)

Key common findings

The IDB Group set relevant objectives and adapted its program to the countries’ fiscal situation, promoted critical reforms using policy lending and technical cooperation support, and sought to address the region´s inequalities. However, project implementation remains a significant challenge as does the sustainability of results, due to e.g. limited physical maintenance, institutional capacity, or a tightening of fiscal situation.

OVE recommended

Strengthening institutional and implementation capacity, focus on addressing sustainability issues, using technical cooperation strategically, seeking additional opportunities for IDB Invest, improve Country Strategy (CS) results frameworks, and adopting new CS only after the effects of the pandemic are better understood.

Top

These lessons were confirmed by the: Project Completion Reports (PCRs) and Expanded Supervision Reports (XSRs): the 2020 Validation Cycle

OVE validated PCR and XSR ratings on relevance, effectiveness, efficiency and sustainability

2020 cycle:

  • 63 PCRs for SG operations (62 closed in 2018)
  • 36 XSRs for NSG operations that had reached EOM in 2018

 

Results:

  • Overall ratings were positive for:
    • 51% of PCRs for SG operations
    • 58% of XSRs for NSG operations
  • While the highest ratings were for relevance (84% positive for SG and 61% for NSG), effectiveness had the lowest ratings (29% positive for SG and 50% for NSG).

The analysis of the 2017-2020 cycles confirmed that effectiveness is a challenge, and that the main reasons arise from:

  • Poor quality of M&E mechanisms at design, monitoring and completion
  • Cancellation of components or outputs which break the vertical logic of SG operations
  • Underperformance of projects

 

3 recommendations:

1) Strengthen learning component of PCRs/XSRs

2) Analyze project alignment with country realities

3) Assess performance against baseline for IDB Invest

Top

The Recommendation Tracking System – ReTS

OVE validated management actions to address 161 active recommendations from 38 evaluations

Findings:

Management action plans were:

  • 94.0% relevant
  • 84.3% on track in their implementation

25 recommendations issued in five previous CPEs (Panama, El Salvador, Argentina, Bolivia and Uruguay)​ were retired:

  • 22 retired as "adopted“

Challenges persist in terms of:

  • sustainability of results
  • institutional strengthening
  • maintenance of infrastructure
  • support for the private sector

Two previous evaluations (sector and corporate) completed their cycle and were retired:

IDB Group's Work through Financial Intermediaries (2016) 

  • Improved coordination among the different windows that offer support to FIs; financial sector diagnoses prepared jointly by the Bank and IDB Invest in various Country Strategies
  • A broader strategic approach for FIs at the IDB Group level is still needed

Evaluation of the Results of the Realignment (2014)

  • Progress in actions that can enhance the Bank’s budgetary processes and improve quality control of the operational products
  • Challenges streamlining the multiple levels of project selection and quality review
Top

Dissemination and knowledge management

In 2020 OVE revised its communications strategy to enhance dissemination and promote discussions around evaluation results with internal and external audiences for the purposes of facilitating institutional learning, fostering accountability and transparency, and projecting OVE as a reference within the IDB Group and the evaluation community at large. A variety of outreach vehicles have been activated to broaden dissemination, such as social media (Twitter and LinkedIn), blogs, newsletters to targeted audiences, videos, webinars, workshops, and conferences.

Graficos 2020
Top