RE-230-2
4. The Bank Evaluation System and Activities
A. The
Evaluation System
4.1 This
Chapter provides the annual report on the status of the Bank's
Evaluation System (BES). It also outlines the activities of the
Evaluation Office (), which have not been covered in the previous
chapters. In summary, the status of the BES reveals that there is
greater emphasis given to real time evaluation. Major improvement
have been accomplished in setting ex-ante benchmarks and
"retrofitting" projects objectives. For the first time,
the portfolio assessment of 1997 covers all projects under
execution. Compliance to complete Project Performance Reviews (PCRs)
needs to be strengthened. No Borrower Ex-Post Report (BEP) was
received in 1997. The Board of Executive Directors reviewed two
Country Program Evaluations, a new product submitted by in 1997.
also presented for review the evaluation of the Regional
Technical Cooperation Program. Sectoral and thematic evaluations
were also submitted.
4.2 Three
years ago, the Board of Executive Directors approved the regulations
which provide direction for the implementation of the Bank
Evaluation System. These regulations specify the roles and
responsibilities of stakeholders in evaluation. They outline among
others: the programming of evaluation work, the conduct of
evaluation activities, the processing of the reports, feedback and
dissemination mechanisms. The Bank's Evaluation System (BES) aims at
using evaluation functions as a systemic tool for institutional
learning and as an instrument for assessing the effectiveness of
Bank funded activities. The BES involves the participation of four
main stakeholders: the Borrowers, Bank Management, the Evaluation
Office and the Board of Executive Directors. Each stakeholder plays
a unique role as contributor to the system. The success of the
system hinges on this contribution and on the participation of the
stakeholders in their respective roles.
4.3 The Bank
Evaluation System covers all phases of Bank operations in a
methodologically consistent fashion. The BES supports the four
levels of administration within the Bank; which are the project or
activity level, the thematic or country program level, the strategic
and policy levels.
4.4 At the activity
level, the BES begins with the identification of ex-ante
benchmarks during the formulation of the project, continues with
result oriented performance monitoring during project execution, and
ends after project completion with an assessment of results achieved
and the developmental impact. It is the responsibility of Borrowers
and Bank Project Teams to establish project benchmarks at the
project design stage and to maintain an open dialogue to ensure
cooperation and collaboration during project implementation. For the
past four years, Bank Management assisted by Country Offices, has
produced annual portfolio assessments with increasing coverage of
on-going operations. There is also a growing trend to include
mid-term evaluations during project execution, with no systematic
pattern as to who is accountable for their conduct.
4.5
Most of project ex-post evaluation work fall under the
responsibility of Borrowers and Bank Management. The Borrower
Ex-Post Evaluations (BEP) was in the past a contractual obligation
in every loan. As of 1993, Bank Management decided to make them
facultative. A recent trend consists of identifying in loan
operations, the intention for an ex-post evaluation. As in the case
of mid-term evaluation, there is no systematic pattern as to who is
accountable for the conduct of ex-post evaluation. This new trend
is, de facto, superseding the BEP system. In addition, the Country
Office is required to prepare a Project Completion Report (PCR)
within three months after the final disbursement of a loan.
Moreover, the Evaluation Office conducts Project Performance Reviews
(PPRs). 's selection of PPRs to be conducted is based on a
sampling of project evaluations undertaken in the context of
thematic evaluations. In addition, together with the Regional
Operations Depar-tments and Country Offices, has participated in
task forces to improve the Project Performance Review Form used in
the Bank's portfolio management exercise, as well as the new
guidelines for the Project Completion Reports.
4.6 At the program
level, Headquarters staff, together with Country Office and
Borrowers provide feedback on country program performance. They
prepare the Country Papers (CPs) which define the parameters of the
country strategy and portfolio. CPs are submitted to the Board of
Executive Directors. Also, the Evaluation Office has completed two
Country Programs Evaluations (CPEs). This new product being piloted,
provides feedback on the coherence of the country strategy with Bank
policies and with the existing project portfolio. CPEs summarize as
well the views of client groups to enable improvement in Bank
delivery of services. In 1997, CPEs for the Dominican Republic and
for Ecuador were reviewed by the Board of Executive Directors.
has also conducted an evaluation of a thematic program, the Regional
Technical Cooperation Program.
4.7 At the
policy and strategy levels, with the support of Bank
Management, the Board of Executive Directors is developing the cadre
of policies which will provide Bank staff with policy direction for
the implementation of the Eighth Replenishment strategic objectives.
Central department conduct thematic reviews and distill good
practices and the Evaluation Office conducts thematic and policy
evaluation such as the one on Women in Development, Social
Investment Funds and Science & Technology.
4.8 The
success of the Bank evaluation system is much dependent on the
dissemination and use of evaluation information such as lessons
learned and methodologies. Management and the Evaluation Office have
their respective responsibilities for this purpose. 's
contribution has been to make available copies of its reports and
disseminate them to stakeholders. In 1997, electronic information
systems were updated to provide, on the INTERNET, the disclosure of
evaluation results according to Bank policy. has also created an
INTRANET site to provide to Bank staff access to the full text of
all its evaluation reports. In addition, staff has organized
workshops and conference to share results of evaluation studies, and
has participated in conferences organized within and outside the
Bank Management. REG1/RSS has undertaken to create an electronic
inventory of the Project Completion Reports which will be available
on the INTRANET to Bank staff.. For the present time, keeps in
its library a copy of the PCRs that it has received and makes them
available to stakeholders. The collection goes back many years.
4.9 is
not privy to the work of the committees of Management. Hence, in
terms of ensuring the use of evaluation information for decision
making and improvement of project/program design, the main
responsibility rest with the Office of the Controller. Country
Offices and Borrowers ensure the application of evaluation lessons
learned to the design and monitoring of programs and projects. All
stakeholders contribute to the different stages of the project
cycle, coordination among them, and the unobstructed flow of
information between all are vital to the success of the BES. The
goal of the system is to draw on the evaluation experience of
borrowers, non-borrowing countries and Bank's own operations,
incorporate the lessons learned for the improvement of ongoing
activities.
4.10
During 1997, with the support of the Operational Departments,
continued promoting and supporting In-Country Capacity Building in
Evaluation. facilitated cooperation in evaluation activities
with other development agencies. Responding to requests from Bank
departments, continued its training activities in the logical
framework methodology and provided technical support to Country
Office staff, in many instances retrofit any project. REG1/RSS has
also provided coaching to project team and country office staff.
1. Review
of Evaluation Reports
4.11 A
unique feature of the Bank Evaluation System is that submits
drafts of its evaluation reports to different committees of the Bank
before finalizing the document and formally submit it to the Board
of Executive Directors. There are three levels of review. The first
is the ad hoc advisory committee which is formed for each evaluation
study. The Advisory Committee provides technical support to the
evaluator. It brings together peers from Bank staff and specialists
from outside the Bank. The second level of review is the Evaluation
Coordinators Group chaired by the Director of , which enable
departmental representatives to comment the draft report. Finally,
the draft report is submitted simultaneously for consideration by
Management's Audit and Evaluation Committee and by the Board Matters
and Evaluation Committee of the Board of Executive Directors.
4.12 The
members of the Evaluation Coordinators Group are named by Managers
and Office Heads to represent the views of their units. ECG is a
consultative committee. It is a working level group dealing with
evaluation matters and assists in its support role to Management
in activities such as the preparation of the annual work plan,
reporting on evaluation results, dissemination, development of norms
and methodologies etc. Representatives of offices of Executive
Directors are invited to participate in meetings when the subject
matter under discussion concerns a country in their constituency.
4.13 In
1997, the ECG met 25 times between February 4 and December 16, 1997.
Unfortunately, attendance to ECG meetings reduced significantly as a
result of a decision made by Management's Audit and Evaluation
Committee indicating that ECG members were to contribute not as
Management representatives but in their own individual capacity.
Nevertheless, contributions from ECG members often validated or
added to the information used by in its reports. Frank exchanges
provided relevant insights into systemic considerations which has
facilitated the wording of recommendations which were realistic in
their likelihood of being implemented by Management. ECG also
provided a useful forum to distill lesson learned from a systemic
perspective.
2.
Reporting for Development Impact
4.14 The
recent "Report of the Development Committee Task Force on
Multilateral Bank" echoes the emphasis placed in both TAPOMA
and similar reports on the need for MDBs to become more
"results-oriented institutions. The Bank has implemented
numerous measures in this direction, in particular the annual
protfolio assessments. In 1997, Management has continue to improve
the portfolio assessment exercise. For the first time there was full
coverage of the number of loans reviewed for the exercise. Also,
regional departments are conducting reviews, and are participating
actively in the implementation/execution reviews of the projects, in
order to take corrective actions to improve the portfolio.
4.15
In addition, a task force was formed to review and improve the
Project Performance Review Form (PPRF). The PPRF was designed by
Management to obtain information regarding a project's development
objective and the likelihood of achieving. The form introduces the
logical framework methodology as a substantive component of the
portfolio assessment process (i.e., development objectives,
components, indicators and risk assessments).
4.16 This
year, Management has expanded the coverage of the number of loans
reviewed for the portfolio assessment exercise. As the portfolio
assessment is a vital element of the status of the Bank's Evaluation
System, it is useful, in this context to refer to Management report.
According to Management, the annual assessment of portfolio
management for 1996 concluded that 86% of the 418 major projects
under execution are on-track to achieve their development objectives
while 14% (54 projects) were judged unlikely to achieve their goals
unless corrective actions are taken. Management subsequently
developed action plans for each of these 54 "problem
projects" and will review their status on a regular basis.
4.17 The
portfolio assessment also identified 112 projects that were
experiencing implementation difficulties. Weak institutional
capacity in project executing agencies was identified as a major
factor in 90% of these cases, leading the Bank to undertake a
special study of this issue.
4.18 This
fourth annual portfolio evaluation, marked the first time that the
Bank was able to evaluate the entire 1997 portfolio from the
perspective of project implementation progress and expected
achievement of development objectives. The structure of the
portfolio reflects the rapid growth in IDB lending in recent years:
54% of the total portfolio commitment value ($35.4 billion) was
approved in the last three years. Changes in sectoral priorities are
also notable: commitments for social projects increased by 10
percentage points (to 44% of total commitments) between 1994 and
1996, offsetting, in part, the relative decline in lending for
infrastructure projects.
4.19 Problem
projects were found to be concentrated in a number of countries.
Eleven countries had portfolios in which projects experiencing
implementation problems accounted for more than 40% of the total
commitment value, or with more than 20% of the project number were
problem projects. Accordingly, Management assigned priority to these
11 countries in planning its annual Country Portfolio Review
missions, which are instrumental in discussing issues and resolving
problems with the highest levels of authority in the borrowing
country.
4.20 These
results indicate a positive development of a "real
time"assessment component of the Bank Evaluation System. Also a
new Bank information system provides an almost complete coverage of
Bank lending operations. Management has established a
two-dimensional project information system that will assess both
implementation status and the attainment of development objectives
for projects in execution. Historically, the Bank has measured
primarily the implementation status of its portfolio, but, in the
last two years, has made an effort to assess the attainment of
development objectives.
4.21 Through
the use of a single reporting form, the new comprehensive rating
system will measure and report on both implementation status as well
as attainment of project objectives. This new project information
system is now accessible via the Bank's INTRANET system.
3.
Mid-Term & Ex-Post Evaluations
4.22 When
the Board Members request that an evaluation be prepared, it is not
always recorded in the minutes of the Committee of the Whole.
Because there does not exist yet a Bank-wide system for tracking
evaluation activities, the total number of evaluations expected in
1998 from on-going loans cannot be easily determined.
4.23 's
own evaluation activities are in part determined by evaluations
carried out by other stakeholders and by evaluation requirements
contained in the loan documents. In 1997, in an attempt to track the
completion of required evaluation products, continued to develop
a tracking system of evaluations and to identify the "pipeline"of
evaluations past, present and future.
4.24 The
analysis of loan documents enables the Evaluation Office in the
future in constructing the future pipeline of evaluation products
due upon final disbursement of loans. For example, of the 60 loan
proposals approved in 1997, some 13 included requirements for
mid-term reviews and 19 ex-post evaluations. Six of the loan
proposals require both.
4. The
1997 Project Completion Reports
4.25 In
1995, Management began a process to redesign the PCR's in light of
the TAPOMA Report and the new evaluation system of the Bank. Upon
request of the Executive Vice-President, a Task Force on PCRs was
formed to address the issue of PCR compliance and quality, and to
develop standardized procedures for processing PCRs. The Task Force
was formed with representatives from various departments including
. The Working Group reviewed the PCR form in order to simplify
it, and to include concepts related to the logical framework
methodology (i.e. lessons learned in terms of development
objectives, components, experience with the executing agency,
etc...).
4.26 In
1996, draft guidelines were prepared. These are being reviewed and
were put into effect in 1997. They are meant to ensure that the PCRs
become an integral part of the Bank's Evaluation System which now
includes such related items as the use of logframes and indicators
in project preparation, the portfolio report using these indicators
to show where the Bank stands in terms of portfolio performance and,
finally, the PCR as the last link in the chain.
4.27 The new
PCR is not only the final product of the Bank's portfolio Management
system, it is one of the key elements of the BES. It contains a
history of execution of each project, an analysis of execution
problems and steps taken to deal with them, an analysis of facts
affecting the sustainability of the project and evaluation of Bank
and borrower performance. Last but not least, it will include
lessons learned and recommendations for future projects.
4.28 One of
the issues addressed in the new guidelines is the review process of
the PCRs. One Region reviews all the PCRs at their Management Review
Committee (CRG), with the presence of the Country Office
Representatives. This sends a very positive message to the Country
offices that PCRs are being carefully reviewed at Headquarters, and
provides incentives to improve the quality of PCRs. This Region also
requires that lessons learned from the PCRs be included in the
profiles (I and II) of new operations.
4.29 In
1997, the Bank generated 38 new Project Completion Reports. This
compares with 29 reports received in 1996 and 22 received in 1995.
It appears that these numbers represent an increase due to the
recuperation of backlog from years before. Full compliance to PCR
guidelines in 1997 occur only in 37% of the cases.
4.30 In
1997, reviewed 56 PCRs from the previous 36 months Of the PCRs
received up to December 31, 1997, 100% were prepared following the
old guidelines, which are now superseded. This may have impacted
their uneven timeliness and reliability. It is important to point
out that PCRs to be prepared in 1998 using the new guidelines are
likely to show an improvement in their analytical content, contained
more useful conclusions and recommendations for future projects.
5.
Evaluability of the Operations Approved in 1996
4.31
Evaluability refers to the issue as to whether an operation can be
empirically monitored or evaluated during and after implementation.
In paragraph 2.101 of document AB-1704 , approved by the Board of
Governors, it is indicated that will contribute towards the
Bank's transparency by undertaking independent and systematic
evaluations of the Bank's strategies, policies, programs,
activities, delivery support functions and systems. Within its
mandate of providing oversight and support for the enhancement of
the effectiveness of the BES, has taken an incremental annual
approach. During 1994, concentrated its efforts on evaluability
within the BES at project level. In 1995, began to focus its
attention on evaluability at the level of country or thematic
programs. In 1996, has also paid attention to evaluability at
the policy and strategy levels.
4.32 The
Bank has made progress at the project level. Some 80% of all lending
operations approved in 1997 had benchmarks/ logframes includes in
the design. In its Annual Report for 1994, reported that half of
the projects included definitions of standards for success. Some 40%
of the projects have benchmarks. The concept of logframes which do
contain these definitions and benchmarks was not applied in 1994. In
contrast, 53 of 78 loans approved in 1996 included logframe analysis
and related indicators. This was greatly facilitated by a March 1995
decision by Management to require the introduction of appropriate
performance benchmarks into project design. Implementation of this
requirement will enable monitoring during execution and facilitate
ex-post evaluations.
4.33
conducted a review of all loan proposals approved by the Board in
1996. This exercise revealed that an increasing number of documents
were incorporating the required monitoring and evaluation elements.
The table shows that within three short years, the application of
logframes, for example, increased dramatically within the Bank.
Logframes do include monitoring and evaluation devices such as
indicators. They are therefore useful in themselves and for future
evaluations and monitoring.
4.34 In 1995
and 1996, reported that the quality of the logical frameworks,
benchmarks and indicators was uneven. In 1997, the situation
improved to the point that all logframes have usable indicators.
Further progress is still possible, as indicator research continues.
On the other hand, the "assumptions"described in the
logframes were at times less clearly spelled out in 1996 and 1997
documents. This should not be a major obstacle for later
evaluations, however. In addition judging from the results of the
past two years, the system should improve further, as Bank staff at
Headquarters and in the field participate in training programs
targeted to the formulation of benchmarks and indicators and
evaluation.
4.35 In
short, the comprehensive "evaluability assessment" of all
Board-approved 1997 Loan Proposals, as measured by the inclusion of
logframes was encouraging.
6. 1996
Country Paper Evaluability Exercise
4.36 The
above comments refer to 1996 loan documents. As part of its 1997
Work Program. conducted also an assessment of the evaluability
for four Country Papers produced in 1997 (Argentina, Costa Rica,
Paraguay and Uruguay). The purpose of the exercise was to ascertain
the extent to which these documents reflect the current Bank
priorities, and establish whether or not progress or achievement can
be measured against the desired strategic outcomes. CPs that were
approved by the Programming Committee of the Board of Executive
Directors during 1997 were identified, and a program and schedule of
review was prepared.
4.37 The
review conducted in 1997 revealed that there was improvement in CPs
in so far as the incorporation of evaluability features, as compared
to the last year's review. There has been a gradual attempt to
include some bench marking features, as well as better defining of
the goal of the strategy. CP objectives were, in general, very
clearly stated in most CPs reviewed.
4.38 In the
area of Strategic Goal and Operational Objectives, performance
indicators were generally included in country strategies. In most
cases, the CPs were clear as to how the achievement of the goal and
its objectives were to be measured at the end of the strategic
cycle. The majority of the strategies were focused, and reflected
the composition of the portfolio as well as the country's
development plans and objectives. Most CPs also addressed, albeit
superficially, the IDB-8 priorities of poverty and social equity,
modernization of the state and integration, and the environment.
4.39 CPs
reviewed identified development bottlenecks and challenges faced by
the country, though few addressed the current institutional capacity
of the country. Most importantly, the 1997 CPs , reflect better the
incorporated guidelines of the Bank. Additional work in the area of
identification of the risks associated with the implementation of
the strategy is anticipated.
B.
Activities of the Evaluation Office
4.40 The
year 1997 was more productive than most previous years. The Office
produced a range of activities:
- Project Performance
Reports (21),
- Evaluation Reports (2),
- Country Program
Evaluations (2),
- Performance Reports (3),
- Best Practice Papers (4),
- Conferences and Seminars
(15)
1.
Dissemination and Corporate Evaluation Support
4.41 After
the creation of the Evaluation Office (), questions arose as to
how lessons learned from evaluation reports could be applied in new
operations. After a series of communications between the Bank
Management and , new procedures were agreed upon by the Board of
Executive Directors in August 1995, which state that
"... the systematic dissemination of evaluation findings
and incorporation of lessons of experience into policies and
operations are key objectives of the Bank's evaluation system. They
represent a shared responsibility between the Evaluation Office and
Management" (Procedures for the Bank Evaluation System
RE-200-3; 9 August 1995,p. 5-6).
4.42 In the
past years, Management's dissemination role has been a cooperative
one following the instructions of the Board: "...Management
will take the appropriate measures to ensure that the findings and
conclusions from evaluations are adequately considered .... and
taken duly into account in the processing of new loan and technical
cooperation operations." (Procedures for the Bank
Evaluation System RE-200-3; 9 August 1995,p. 6). A special
report on this topic is prepared for mid-year review.
4.43 In
1997, the following activities took place in :
- Dissemination of
completed 1997 reports were distributed to respective
stakeholders.
- The full text of the
annual report and abstracts of evaluation reports is made
available to outside stakeholders in fulfillment of the Bank's
disclosure policy.
- An additional Internet
electronic version of all 1994-1997 evaluation summaries and
annual evaluation reports.
- Summary Reports on
"best practices" were prepared for Bank staff. They
will be published in 1998;
- An internal electronic
system (INTRANET) was completed in 1997 for Bank use which
consists of most evaluation documents up to 1997.
- Requests from Bank
Departments and Bank staff regarding lessons learned were
followed and assisted.
- Dissemination reference
guides from previous years were updated.
4.44 As a
result, almost all evaluation reports, proceedings, seminars and
working papers are now available in both paper and electronic form.
In addition, for the first time, stakeholders outside the Bank may
access 's evaluations in summary form.
4.45 In the
new year, more is intended to facilitate dissemination of evaluation
products within the Bank. The list of planned activities includes
additional seminars with interested parties, lessons learned
workshops with the regions and support for the new electronic
dissemination systems.
4.46
Dissemination outside the Bank remains somewhat problematic. The
Bank's Policy on Disclosure of Information (GN-1831-3) provides
serious limitations on the dissemination of documents. The
Policy in effect permits that only the Annual Report of and the
"abstracts of evaluation reports approved by the Board"
can be distributed outside the Bank.
4.47 As for
all dissemination products and processes, within and outside the
Bank, shares this responsibility with Management. Together with
Management, is reviewing ways in which its products can be made
available to Bank staff in a more systematic and user-friendly
fashion in 1998.
a)
Evaluation Support Services
4.48 During
1997, 990 participants received training in the four areas of
concentration of logframe workshops: (i) basic and primer; (ii)
project teams and counterparts at design level; (iii) project teams
and counterparts at execution level; and (iv) C and D countries ad
hoc logframe training. Of this total, 156 staff members participated
at headquarters workshops, and 483 professionals and executives
participated in in-country workshops.
4.49 A total
of 27 in-country workshops were carried out, covering 14 borrowing
member states. Of these in-country workshops, 12 were conducted by
and 15 by RE1/RSS. These workshops provided support to 21
investment projects, of which 6 were at the design stage and 8 at
the execution stage. A significant effort was made in the case of C
and D countries, particularly since July 1997, when the ad-hoc
program was approved. Nine "C and D" countries were
covered: Ecuador, Costa Rica, El Salvador, Bolivia, Uruguay, Haiti,
Paraguay, Dominican Republic, and Honduras; and a total of 490
national execution agency officials were trained in the use of
logframe methodology. In addition 50 senior executives participated
in half day information seminars as part of these "C and
D" country activities. An additional important effort was the
training of trainers workshop carried out in Venezuela at which 24
CO staff were trained.
4.50 With
the support of the Administrative Department and the three Regional
Operations Departments, conducted training sessions in the use
of logical framework methodology for design, execution and
evaluation of projects. In addition, fourteen regional workshops on
project monitoring and execution were held in the Country Offices.
In these workshops, 26 projects in execution were "retrofitted"with
logical frameworks and five new projects were designed using the
logical framework methodology. Altogether, these 32 projects
represent $3.1 billion in total loan amounts.
b)
In-Country Capacity Building
4.51
continues to provide support to borrowers' initiatives to use
evaluation as an instrument for improving public administration.
provided assistance to the Government of Costa Rica through the
writing of guidelines for developing "Compromisos de Resultados
(CDR)", or performance contracts, 20 of which were signed
between the President of Costa Rica and each of the 18 government
ministries, as well as with 2 public enterprises. Information
materials about the CDR program have been widely disseminated
internationally. Additional support to Costa Rica included
developing a strategy for the strengthening and sustainability of
the National Evaluation System as a key component of the public
sector reform program. organized and delivered a workshop on
Citizen's Charters to include the participatory aspect of government
performance evaluation, with consultants for the UK and World Bank
in April. Furthermore, staff assisted the Country Office in
establishing a performance measurement unit within the executing
body of the Modernization of the Health Sector Program (Loans 711 OC-CR
and 712 OC-CR).
4.52
staff provided a contribution toward the development of two national
TC operations for strengthening the evaluation system of Costa Rica
and for the Contralorķa of Peru. Additionally, spearheaded the
project team which developed and processed the approval of a
Regional Technical Cooperation (Strengthening of Evaluation
Functions in South America, ATM/SF-5574-RG).
4.53 The
Director of has provided on-going support to the regional and
sub-regional organiza-tions of Controller Generals and made
presentation during Central American Summit of Controllers General
in Guatemala.
c)
International Evaluation Network
4.54
repre-sents the Bank as an "observer" to the Expert Group
on Aid Evaluation of the Development Assis-tance Committee (DAC) of
the Organization for Economic Coope-ration and Develop-ment (OECD).
This Group comprises the Heads of the Evaluation Unit of the
bilateral donor agencies of the OECD's member countries. The
Director of attended Seminars sponsored by the OECD/DAC Expert
Group. The Director also participated in the regular meetings of
the OECD/DAC Expert Group.
4.55
represents the Bank on the Inter-Agency Working Group on Evaluation
(IAWG). The IAWG is comprised of the Directors of Evaluation of 32
specialized agencies of the United Nations system and the Directors
of Evaluation of the MDBs. was also represented at the IAWG
regular meeting held in Geneva, Switzerland, in November 1996.
4.56
staff also participated in the Annual Meeting of the American
Evaluation Association, which was held in Atlanta, Georgia in
November 1997.
C.
Follow-up on the Implementation of Recommendations Resulting from
Evaluation Reports Reviewed by the Board of Executive Directors
4.57 Bank
Management is requested to report to the Board annually on the
implementation of Board Decisions from Evaluation Reports. "To
ensure prompt and effective implementation of Board decisions, the
Controller's Office will coordinate the implementation process with
respect to action taken by Management" (RE-200-3, §8.20).
An Annual Report status is to be provided to the President and the
Board by mid-January. In the past, the Annual Report of the
Evaluation Office normally included 's review of the
implementation report.
a)
Status for 1997
4.58 In its
Second Annual Report on the implementation of recommendations of the
Evaluation Office (RE-212-1), Management proposed that future
implementation reports focus on a few major issues from recent
evaluation reports. Management and would consult each year on
the issues to be reported. The Administration would prepare an issue
paper to facilitate discussion. This proposal was approved by the
Board in 1997. Management will present its report later this year.
It will coincide with 's mid-year report.
b)
Projects Evaluation Follow-up
4.59 In the
past four years, completed some 40 projects evaluations. The
Project Performance Reviews were forwarded to the ECG for review and
to the Audit and Evaluation Committee for information. Presently,
the Evaluation Coordination Group has no existing system to
facilitate the Reporting on the implementation of the
recommendations stemming from project evaluations. began a
review of the extent to which recommendations are being implemented.
Mid-year Report will comment on this.
TOP |