Selections From the High Level Panel’s Detailed Comments
Author:
Aidspan
Article Type:Article Number: 4
Selections From the High Level Panel's Detailed Comments
The High Level Panel studied eight “layers” of the Global Fund system:
- Layer 1: The Principal Recipients
- Layer 2: The Country Coordinating Mechanisms
- Layer 3: The TRP and the Grant-Application Process
- Layer 4: The Global Fund’s Board
- Layer 5: The Global Fund Secretariat
- Layer 6: The Local Fund Agents
- Layer 7: The External Auditors
- Layer 8: Risk-Management and the Office of the Inspector General
Excerpts from the Panel’s comments about each are as follows.
Layer 1: The Principal Recipients (Full text available here.)
Examples of Weaknesses in Grant-Management…:
- Overspending or lack of respect of budget lines;
- Lack of suitable accounting software and procedures;
- Excessive use of cash payments;
- Ineligible or non-grant related expenditures;
- Absence of supporting documentation for expenditures;
- Inter-grant borrowing;
- Problems with external audits, including selection and quality;
- Poor forecasting, delays in procurement, stock-outs;
- Inadequate storage and distribution of pharmaceuticals;
- Lack of transparent procedures to select SRs;
- Inadequate monitoring of SRs; and
- Data-quality problems.
Findings of the Review of the Representative sample
After reviewing thousands of documents from hundreds of grants in 40 countries, the Panel has identified several patterns…:
- The Global Fund does not identify most weaknesses in its PRs until the grants have started:
The emergence of such a large percentage of challenges after signature suggests the review process of applications by the Technical Review Panel (TRP) and nominated PRs by the LFAs could be more effective… The late identification of weaknesses leads to calls to the Secretariat from PRs for urgent support to prevent the suspension of disbursements just before deadlines for milestones set out in the grant agreement…
- Almost every grant has had at least one financial-management problem:
- The Global Fund system of assurance needs to exercise greater oversight of how PRs choose and handle their SRs:
LFAs have only been under contract to review the internal management standards of PRs, and in many places their oversight does not extend yet to SRs. … This lack of rigor represents a significant risk to the Fund’s portfolio.
- The procurement, storage and distribution of pharmaceuticals represent significant vulnerabilities
- The nature of grant documentation at the Secretariat puts the Global Fund’s institutional memory at risk of erasure
Maintaining complete and easily accessible records on the grant portfolio is absolutely vital. … current practices at the Secretariat do not fully meet this need. the Secretariat has no centralized, “official” archive… The Secretariat has no standards for which documents to keep, or for what format in which to maintain files… Turnover in personnel at the Secretariat routinely causes files to be misplaced or lost, and Fund Portfolio Managers (FPMs) face a serious challenge in learning the history of the grants under their purview.
- Grant-management decisions are often opaque
Much (if not most) of the day to-day grant-management process takes place informally, outside of the formal documentation process, and should be more systematically tracked and archived.
The Procurement and Distribution of Pharmaceuticals and Medical Supplies: The Biggest Risk to the Global Fund’s Portfolio?
The Global Fund itself estimates that over 40 percent of its total investment in grant-making goes into the purchase of medicines and other health products… This… amounts into the hundreds of millions of dollars each year.
The sheer size of the Global Fund’s aggregate procurement of medicines and health supplies allows it to shape worldwide markets… Given this enormous scope, the Panel believes the procurement and management of pharmaceuticals and medical products poses larger risks to the Global Fund’s finances, operations and reputation than any other activity in its business model… Fourteen of the 40 countries in the Panel’s representative sample experiences serious challenges with the purchasing and distribution of drugs and other medical supplies,… The Panel has summarized this problem into four areas: Inadequate forecasting, poor procurement processes, theft and diversion from the in-country supply chain, and quality and safety.
- Forecasting
The Secretariat should accelerate the trend of requiring PRs to develop electronic systems for inventory management and tracking patients, and should expand on-site data verifications by the LFAs on stocks of drugs, number of patients reported and consumption prior to procurements. The Panel sees great promise in mobile-phone technologies for these purposes, and urges the development of standardized protocols.
- Tendering and Bidding Processes
The manipulation of tendering and bidding for contracts to furnish drugs, bed nets and supplies, whether for political or economic reasons, is a font of corruption documented by the OIG… The purchase of drugs or medical equipment is not an inherently governmental function; the principle of “country ownership” should not allow bureaucratic slow-downs to put lives at risk if external entities can do the job faster, and at a better price… The Global Fund should make the VPP [Voluntary Pooled Procurement] and other external purchasing channels the default for all grants, except if implementers can certify local institutions can meet and perform to international standards.
- Storage and Distribution
Stock-outs at the facility level are sometimes artificial, as drugs remain at the CMS [Central Medical Stores] but do not get out to the right patients at the right time…
The Panel believes enhanced quality-control of the facilities used by the recipients of Global Fund grants to store and distribute drugs and medical supplies is crucial. As with procurement, the Global Fund should require the outsourcing of the supply-chain as the norm for its grants in the short term, with the exception of implementers that can certify local institutions can meet and comply with international standards. In the long-term, the Global Fund should support the certification of organizations, whether public or private, that can safely and securely handle the management of pharmaceuticals and health products in a cost-effective and sustainable way.
- Theft and Diversion
The OIG is currently investigating 17 cases of drug theft in 13 countries in Africa, and has indicated to the Panel the problem has also appeared in South East Asia…
The Global Fund has sometimes suffered from a blind spot on theft…
The Panel therefore welcomes and encourages recent efforts by the Global Fund to cooperate with other donors, technical agencies, law-enforcement organizations and implementers to combat the traffic in stolen medicine, but urges even-greater vigilance…
Joint work between the Global Fund and the President’s Malaria Initiative of the United States to conduct detailed studies of the problem in Mozambique, Benin and Zambia is also an excellent model for future cooperation.
- Quality and Safety
Loss or degradation caused by inappropriate conditions during storage and transport can mean patients receive medicine that is expired or rendered ineffective…
The Panel sees a need for the organization to require PRs to invest more of grant budgets, systematically, in pharmacovigilance programs that monitor the quality, usage and efficacy of the drugs it buys…
The Special Case of the UNDP
As of September 2011,UNDP is managing 64 active grants on behalf of the Global Fund in 26 countries, in the amount of US$ 1.04 billion. In many cases, these are difficult places to work, and the CCM has proposed UNDP as a PR because few (or even no) local organizations have the requisite infrastructure to handle the finances; in other instances, the Global Fund itself has asked UNDP to step in as a stop-gap PR after the suspension or termination of a grant with another implementer. UNDP takes a seven-percent fee from each grant for its service as PR…
When the Secretariat signs a grant with UNDP, the Global Fund waives many of the fiduciary tools it has to work with other PRs…
While the Panel might not have advised the Global Fund to accept the provisions of the agreement with UNDP eight years ago, it does not recommend re-negotiating the arrangement now. The Global Fund should consider UNDP a transitory and temporary PR in almost all cases, and should hold the organization accountable for developing an exit strategy with concrete timelines… The Global Fund should develop a performance indicator to endorse this goal, and measure the transition of UNDP (or any other non-national implementer) against the number of countries exited, plus the infrastructure left behind and the capacities of national entities developed during the course of the grants…
The Panel… urges both UNDP and the Global Fund to pursue enhanced cooperation for the next year.
Layer 2: The Country Coordinating Mechanisms (Full text available here.)
The CCM is one of the most-treasured, and yet most-criticized, aspects of the Global Fund’s model… The Panel met with CCMs that range from highly functional to moribund…
The singular achievement of the CCM idea has been to provide a platform for various sectors to work together, in many cases for the first time in any structured way… The Global Fund has made ordinary and expected what was unthinkable in dozens of nations ten years ago, as in the following examples:
- HIV-positive people meet regularly and openly with Ministers and Presidents and appear in the media;
- Governments must account for spending that previously would have been off-the-books, including by submitting to monitoring through unannounced visits;
- Faith-based organizations coordinate the delivery of health care with State-operated institutions;
- NGOs bid for funds in transparent tenders;
- Donors engage recipients on their terms; and
- Ordinary citizens stand to represent their peers in competitive elections…
Often, the governance model of a CCM breaks the traditional dynamics of power in certain countries where the State, politics and economy are run by the same cliques…
But, like democracy itself, the CCM can be an inelegant and imperfect instrument… Since the beginning of the Global Fund, the possibility of self-dealing among members of CCMs has been… an obvious impediment to the ability of CCMs to serve in a meaningful oversight role…
Dominance of the CCMs by Government Ministries that were also PRs was a recurring, problematic pattern…
The Panel’s examination of the CCMs found two important improvements in the management of potential conflict-of-interest on CCMs:
- CCMs have diversified their leadership considerably since 2005. Thirty one CCMs (23 percent) have Chairs and/or Vice Chairs that are also representatives of PRs… Nine CCMs (seven percent) have representatives of Governments as Chair and Vice Chair.
- In no case do funding recipients make up the majority of a single-country CCM. The share of PRs/SRs/SSRs on CCMs tends to be in the range of 15 of 25 percent,
The majority of CCMs perform their oversight more on paper than in reality… CCM members all have other jobs, and quite often do not have time to read and analyze the enormous amount of information included in reports from the PRs and LFAs. In some places, the converse is true: CCMs do not receive any meaningful reports at all. Civil-society members and development partners are much more diligent in attending than the Government representatives. Many CCMs do not preserve funding in their grants to do site visits and other physical verification of implementation.
CCMs in some places are vehicles created only to access financing from the Global Fund, whose procedures and membership are made up to satisfy the letter, but not the spirit, of the rules. In many countries, NGOs have been an afterthought in the planning and development of proposals, and have received documents for endorsement only at the eleventh hour before submission to Geneva.
Characteristics of CCMs That Work:
The Panel has observed that the best CCMs share a series of characteristics and behaviors that increase their chances of acting as true stewards of the Global Fund’s resources at the local level:
- The Government has decided it does not need to control or dominate the CCM, and encourages leadership by civil-society groups;
- The CCM has shrunk its size to a manageable number of members (typically less than 20);
- An Executive Committee exercises delegated authority;
- An Oversight Committee follows the implementation of the grants closely, including through reviewing reports from the PRs and LFA, conducting site visits and unannounced spot checks and using a dashboard” tool to track progress against indicators;
- Technical Committees consider solutions to operational problems, and supervise the preparation of disbursement requests and new applications;
- Members stand for free and open elections within their constituencies, and seats rotate on a regular basis;
- Written manuals and by-laws govern the functioning of the CCM and its committees and regulate conflict-of-interest;
- The CCM has established linkages, and often has inter-locking membership, with other coordination bodies in the health sector in the country (such as donor roundtables, United Nations Theme Groups, or the steering committees for Sector-Wide Approaches); and
- Partners use the CCM process to make decisions with their own money to complement the Global Fund’s investments.
Layer 3: The TRP and the Grant-Application Process (Full text available here.)
The Panel has several concerns about the grant-application process…
The “Free-for-all” Phenomenon
Because… the Global Fund’s Board sets no upper limit for the dollar-value of individual proposals in each Round, and because the Rounds do not always occur on a predictable schedule, CCMs have every incentive to seek as much money as possible, whether they truly need it or not. Budgets can be padded (and frequently are), and CCMs often ask the Global Fund to pay for everything, without accounting sufficiently for what other donors or the national Government will be contributing to each category of activity. CCMs in large countries tend to put forward enormous proposals, which, if approved, can crowd out smaller, but perhaps needier, applicants. Around the world, the lure of new money means that a number of CCMs have focused more on repeated applications and less on the performance of previous grants. During the proposal-development phase, a struggle sometimes erupts at the country level over which interventions and organizations to include. The founders of the Global Fund envisioned that open and competitive processes would solicit proposals from a myriad of worthy local organizations, from which the CCM would then choose a coherent set to match with activities Governments would suggest. Such a methodology is the exception, not the rule. In many places, the decision-making over what goes into a Global Fund application is closed, and Governments and insiders on the CCMs tend to dominate and “divide up the pie”…
The Panel applauds the steps the Global Fund has taken in preparation for Round Eleven to link its application process to those of other institutions, and to hold CCMs more accountable for demonstrating the money they request is an addition, not a substitution, to in-country budgets…
The Complexity of the Application
Writing a Global Fund proposal has been so time-consuming and complicated that specialized expertise is required. Applications have routinely run into the hundreds of pages. An entire industry of outside consultants-for-hire has emerged in the last decade to service this need in each Round. What matters is not that the professional grant-writers understand the country context or the nuances of implementing a program in a given place, but that they know what the TRP is looking for, and can write to those specifications… When it comes time to implement an approved grant, many PRs have struggled to perform, because the proposal written by their consultants for an ideal world had little to do with the real challenges and limited capacity on the ground…
Insufficient Focus on Finances and Risk
Although many organizations which CCMs are likely to nominate as PRs (and SRs) are already managing Global Fund money, the process does not adequately address the implementation capacity and past track-record of these groups…
The Sequence of the Application and Approval Processes
Quote: “In [certain situations], funds are used in a way that is best described as mismanagement, and then prone to corruption. Corruption takes place because no one understands how these funds should be monitored, and how to take responsibility.” -TRP Member
Proposals are unconstrained at the time of application, but many vital details… are only determined during grant negotiation, after the Board has approved a notional sum of money for a specific program… Successful applicants all perceive the budget ceiling the Board gives them as an entitlement, not the starting point for reductions, as is the reality… This process puts the cart before the horse…
The entire period from submission of a proposal to the beginning of implementation could be two years or more, during which time circumstances on the ground… could have changed… This process takes too long… The Panel views the potential mismatch between conditions when the CCM puts an application on paper and the conditions that prevail at the time of first disbursement to be a major operational and financial risk for the Global Fund.
To address all of these challenges inherent in the current grant-application model, the Panel suggests the creation of a new, two-stage approval process, with different procedures for different countries, undergirded by a risk-burden matrix and linked to a strategic resource-allocation decision from the Global Fund’s Board.
Layer 4: The Global Fund’s Board (Full text available here.)
Transparency and consistency regarding the appointment processes for the various Board constituencies has been a challenge since the founding of the Global Fund. Each grouping adopts a different approach:
- Donor constituencies tend to send mid-level officials… who… can devote significant amounts of time to multilateral governance and policy activities;
- The implementing bloc typically chooses Ministers of Health as their representatives… Many of these Ministers are too busy to engage deeply in Global Fund business, and usually lack dedicated staff to support them…
- Only the three civil-society delegations have truly open and transparent selection processes…
The Government-based implementing constituencies [have] little institutional memory and a muted presence on the Global Fund’s Board… The civil-society groups on the Board have maintained a much more stable and disciplined membership over the years.
The Board should reconsider the eligibility of large, quickly-growing and powerful economies, such as the People’s Republic of China, India, Brazil, Russia and Mexico…
The Panel considers that..:
- The Board’s time spent on strategy is limited… The Board never steps back to review the Global Fund’s entire portfolio of grants from a strategic perspective.
- The Board often spends time on selective micro-managing and agenda-driven matters…
- The Board could make much better use of its Committees…
- The Board needs to do a more-skillful job of managing the Executive Director and the Inspector General…
Layer 5: The Global Fund Secretariat (Full text available here.)
The Global Fund has grown from an initial startup to a large international financing institution with over 600 staff members… The original “light-touch” approach has had to give way to an increased concern for accountability…
Many people at the Secretariat work extremely hard over long hours under a great deal of pressure and external scrutiny, with passion, determination and commitment… The question is, can the Secretariat, without appreciably increasing its head count, become more efficient, structure itself better, and, ultimately, work smarter to handle risk better and anticipate problems with grants before they occur? The Panel believes the answer to that question is yes…
The founding members view the Secretariat with some concern as it becomes, in their view, more “reactive, blame conscious, risk-averse and hierarchical,” and is slow to deal with under-performers…
Some of those who joined more recently (including some in senior positions) say they feel excluded from the longer-serving group, and are “kept out of the loop when the real decisions are taken”… The organization has no clear, shared vision of its mission and objectives within the rank-and-file…
The Global Fund Secretariat operates with, at best, a 50:50 split in resources between priority grant-making and other activities, compared with staff ratios of between 70:30 and 80:20 for the main multilateral development-financing banks… Of the total of 606 Secretariat staff, 319 are directly or indirectly employed on grant-making activities. Of these, 181 are in the Country Programs Cluster, of whom 120 are FPMs, Program Officers (POs) and Program Assistants (PAs)…
The current ratio between priority grant-related and other activities need a radical shift: first to 60:40, and then to 70:30, at least… Rebalancing the Secretariat will present a number of challenges.
Optimizing the Fund Portfolio Managers
The FPMs are the linchpins of the grant-management system…
A major shift of emphasis needs to take place: from the current somewhat process-heavy grant-management model to one in which FPMs are empowered to operate as active problem-solvers, anticipating and helping to resolve bottlenecks, rather than reacting to crises.
The Panel believes this transformation is possible with changes in five main areas, outlined below.
- Allocation and Rotation
The FPMs are over-burdened… Each recipient country is served, on average, by 1.31 staff. The Panel considers this level of effort inadequate to maintain a detailed knowledge and understanding of the in-country context, and to establish and sustain relationships with the key players on whom the Global Fund relies to implement its programs…
The Panel nevertheless notes with concern the frequency with which FPMs are sometimes rotated. For example, while the LFA in East Timor (PwC) has had the same Team Leader for the past eight years, the Global Fund’s programs in that country have seen six FPMs during the same period. Afghanistan, a country the Panel regards as lower-risk but high-burden, and which presents serious logistical and operational challenges to any donor, has had four FPMs in the past year…
The most seasoned staff should work on the riskiest portfolios. Equally, experienced FPMs should sometimes rotate to other regions and countries to spread good practice…
- Decision-Making
FPMs currently have no delegated financial powers, so they must refer upwards every adjustment with a financial implication, sometimes through several layers of management, with consequent delays to business…
- Focus and Consistency
Many times, [FPM] travel did not have Terms of Reference or defined objectives, post-visit reports were not required, and decisions made in-country were not recorded.
Because of frequent turnover and the lack of written manuals and standard operating procedures, local LFA personnel and CCM members have [sometimes] served as the de facto trainers of the Global Fund’s staff…
- Communications and Information-Sharing
The commitment of FPMs to their country portfolios is impressive, but… the FPMs are drowning in data, much of it of questionable value. Just as important, this phenomenon erodes the time and attention that FPMs are able to devote to building relationships and interacting directly with in-country partners…
The Global Fund does not appear to have a culture in which employees make routine use of tele- or video-conferences to conduct their business with outsiders…
A mostly hands-off approach to grant management and a personality-dependent set of largely unwritten rules also means that the information and guidance documents that do come from the Global Fund Secretariat are fragmented…, discursive (with little sense of what the key points are) and staccato. Some regional teams, such as the one for Latin America and the Caribbean, employ a highly structured way of interacting with CCMs and recipients in the field, including by sending Management Letters to spell out clearly what corrective actions they need to take, with specific deadlines. Other teams are more idiosyncratic.
The Global Fund acknowledges that it does not make the best use of the vast store of knowledge, evidence and insights available from the wide range of people and institutions with whom it interacts… FPMs’ pivotal position inevitably gives them a leading information-sharing role. They should be systematically exchanging knowledge with in-country players, not only CCMs, LFAs and PRs, but also with UN agencies, the World Bank, the regional development banks, and bilateral donors… FPMs should also be exchanging information with their colleagues within the… Secretariat more widely…
One is left with the impression that “communications” is something of a one-way street, more about transmitting information than having a dialogue of equals. …Communication should be two-way, and FPMs should listen and learn as much as imparting information.
- Performance-Assessment
The Global Fund Secretariat has assessed the FPMs’ performance through key performance indicators (KPIs) that are largely about the speed and volume of grant disbursement. With these incentives stacked in favor of moving money as quickly as possible, few within the organization have wanted to delay or deny a grant. Handling a troubled case has not always been popular, because of the “stigma” of sending out tough messages that could lead to a slowdown in the flow of funds…
The Secretariat’s leaders now recognize they need to recalibrate these yardsticks to reflect the quality and effectiveness of program delivery and other factors…
The Country-Team Approach (CTA)
The CTA seeks to solve these problems by bringing together all those responsible for the different aspects of grant management so they can take action jointly, in real time, rather than sequentially…
Country Teams are composed of the FPM, and a named Finance, Procurement and M&E Officer. The CTA currently covers Thirty-three countries, considered by the Secretariat to constitute the most-complex and highest-risk…
The Question of “Country Presence”
In dozens of consultations with Secretariat staff, the Board, the OIG, LFAs, PRs, CCMs, external auditors, National Audit Institutions, and bilateral and multilateral donors, the Panel and its Support Team posed the question of whether the Global Fund needs to break with its tradition and establish a permanent country presence.
Most people the Panel interviewed asserted the Global Fund Secretariat should “get closer” to the implementing countries…
The Panel has debated this issue, and considered the significant ramifications of replacing or pairing the LFAs with Secretariat staff…
Stationing Secretariat personnel in offices around the world will not resolve the issues the Global Fund faces that require it to fundamentally change the way it does business … The Global Fund should first challenge itself internally to better define the roles of and relationship between the PRs, the LFAs and the FPMs. …the Global Fund should first challenge itself internally to better define the roles of and relationship between the PRs, the LFAs and the FPMs… The FPMs and other Global Fund staff should make significant use of video-conferencing in communications with in-country stakeholders, as meetings held by video provide a personal touch without travel costs.
Tools for the Management of Human Resources (HR)
The Global Fund needs to overcome challenges in its HR approach… Merit-based promotion and career management are just beginning in the organization, and few incentives exist for good performance.
The Secretariat needs to link the performance-management of its staff closely to the core task of enhancing the quality of delivery in the Global Fund’s grants..
The Executive Management Team (EMT)
The Panel is concerned by… an erosion of confidence in the EMT throughout the Global Fund. The EMT should be, and be seen to be, the Secretariat’s prime executive decision making body.
The responsibility for leading and shaping the EMT to take up its proper role rests squarely with the Executive Director and Deputy Executive Director, in their respective roles as EMT Chair and Vice-Chair…
Managing Reform
The Global Fund is an organization in transition…
Within the Global Fund Secretariat, the Reform Steering Committee, composed of all Cluster Directors under the leadership of the Deputy Executive Director, manages the reform process… It will be important for the Board and the Secretariat to coordinate all the initiatives into a single agenda, for which the Board takes responsibility, and over which it exercises sustained and constructive leadership. This does not mean micro-managing the activities, but rather ensuring that it gives the Secretariat the resources and strategic direction needed to ensure successful implementation.
Layer 6: The Local Fund Agents (Full text available here.)
The Role of the LFAs
LFAs are now moving beyond just being the “eyes and ears” of the Secretariat, to acting more and more like the “nose,” as they must sniff out fraud risks and actual fraud. In addition, even though the LFAs explicitly do not have the authority to speak or act on behalf of the Global Fund, some within the Secretariat believe they should also serve as the “mouth” of the organization on the ground. The LFAs themselves see their role as being independent review bodies to ensure the overall effectiveness of the Global Fund’s grants…
The LFAs and Risk-Management
The work done by the LFAs on behalf of the Global Fund in many countries is not sufficiently tailored to the specific risks associated with the grants… The LFAs spend most of their time in completing templates and answering questions that are not materially relevant; the LFAs’ Scope-of-Work and tools are too prescriptive, and both need more flexibility and simplification…
Organization and Skills of the LFAS
LFAs should allocate their most experienced and best staff to the most difficult countries…
LFAs continue to experience challenges in identifying, contracting and retaining qualified staff…
The LFAs’ Scope of Work and Consistency of Approach
A final obvious flaw the Panel has found in the scope-of-work of the LFAs is the exclusion of SRs. Until recently, the Secretariat instructed the LFAs to focus exclusively on the PRs, and the assumption in the grant agreement is that PRs are responsible for overseeing the financial and programmatic performance of the organizations to which they pass funds. Revelations over the past two years by the OIG of major problems with accountability at the SR level has led to a change in attitude… FPMs are now working with the LFAs to change their workplans to include more site visits, data-verification exercises and document reviews at the SR level…
Assessing the LFAs’ Performance
The performance of the LFAs has been uneven for a number of years. The good news is that the advent of the Performance-Evaluation and Feedback System in 2009 has made the Global Fund Secretariat much more likely to fire an LFA for incompetence. In the last two years, the Secretariat has re-tendered LFA work in 18 countries out of 132, or approximately 14 percent of the entire portfolio…
Communication Between The LFAs and Other Elements in the Global Fund System
Quote: “For many sub-recipients, the LFA is like God: We believe in Him, we know He exists, but we have never touched Him.” – A CCM Chair
As the Global Fund’s only permanent in-country presence, the LFAs must be at the center of the network of information-sharing between the FPMs, the CCMs, the external auditors of the grants, National Auditors and other partners…
Yet, the Panel found in its interviews and country visits that communications with and between the LFAs and the other elements of the Global Fund’s levels of assurance remains sporadic, idiosyncratic, and of variable quality and effectiveness.
The Panel has identified the following gaps:
- The LFAs’ designed independence often turns into isolation…
- PRs and CCMs do not always have access they need to the information the LFA provides to the Secretariat… CCMs and PRs often receive inadequate and murky information about how to better manage their grants.
- Other than attending scheduled CCM meetings as observers, the LFAs do not communicate systematically with CCMs… Many CCMs would like to be more involved in the oversight of implementation, and would like more information directly from the LFAs; they lose time in making improvements because the flow of information goes to Geneva first.
- The LFAs rarely talk to the external or internal auditors of the Global Fund’s grants, nor to National Auditors…
- Better coordination is needed when LFAs spot indications of fraud…
- The only recourse the LFAs have to voice concerns to the Global Fund is through the LFA Management Team at the Secretariat… The firms have no avenue through which to raise big-picture problems with the Global Fund.
- The Global Fund has never invited the LFAs to present their findings, views and recommendations regarding the risks in each country portfolio to the Executive Management Team, or the Board… The Global Fund needs to do more to capture this in-country knowledge and expertise.
Layer 7: The External Auditors (Full text available here.)
In interviews with the Panel… LFAs were very critical of the external auditors for poor performance… Most LFAs never meet with the external auditors of the grants under their responsibility.
“Audit Fatigue”
On its field visits, the Panel was struck by the excess of apparently uncoordinated audits and financial reviews of the Global Fund’s grants, which do not appear to add up to greater assurance. In many instances, PRs are subject to as many as six layers of audit/review, many of which cover similar ground, but on different schedules, by institutions that do not communicate with each other:
- Internal-Audit Units;
- External Auditors Required by the Global Fund;
- External Auditors Required by Other Donors;
- Global Fund LFA;
- Government Auditors…;
- Global Fund OIG.
Scope of the External Audits
The Panel’s interviews and field visits found serious limitations with what the Global Fund requires of the external auditors of PRs… The external auditors of the PRs do not cover a significant portion of grant expenditure, because the implementation takes place at the SR, District or lower levels. The Global Fund’s current policy only mandates that PRs present an SR Audit Plan, but offers no guidance as to what the plan should contain…
Layer 8: Risk-Management and the OIG (Full text available here.)
Unlike other financial institutions, for most of its history the Global Fund did not adequately consider risk as a factor in its business model. The history of the Global Fund shows a lack of engagement by the Board and Secretariat in formal risk-management… A commitment to establishing a “light touch” by the Secretariat in the service of the philosophy of “country ownership” took precedence over establishing good governance arrangements.
The Panel is pleased to see a change in attitude… The last 18 months have seen increased acceptance by the Global Fund’s Board and Secretariat of the need for a more-formal approach to managing risks, especially at the operational level.
Corporate Risk-Management
“Corporate risk-management” relates to handling threats to the achievement of the Global Fund’s mission and institutional objectives, supported by a Corporate Risk Register46 and Board-approved mitigation strategies…
The Panel views both the Global Fund’s Corporate Risk Register and Risk-Management Framework as paper exercises that have had little impact on decision-making or day-to-day operations. Few of the actions the Board discussed have ever taken place… Interviews with Secretariat staff and implementing partners in the field have revealed they are not even aware of the existence of either document.
Without a clear idea of the global threats to the organization,… the organization (especially senior executives and the Board) spends considerable resources on fire-fighting and crisis-management…
Operational Risk-Management
“Operational risk-management” relates to program implementation, program impact, data collection and verification, the reporting of results, the allocation of resources and use of funds, efficiency and cost-effectiveness… The Panel sees this area as covering the myriad of threats to the integrity of the Global Fund’s grants in the field.
The Secretariat has not classified or segregated its grant portfolio based upon risk… The best managers have not been matched with the highest-risk, most-complicated countries…
There is a general belief within the Secretariat that this is a PR responsibility, even though OIG reports clearly show recipients are not fulfilling this role…
Supervisors have tended to sign off on disbursement requests based on their assumption whether the person submitting the deliverable is competent or not…
The FPMs have not always been aware or concerned with the overall danger that hundreds of thousands of lives are at risk if donors withhold contributions to the Global Fund because of fraud in a handful of grants…
In a very encouraging development, the new Director of Country Programs has formed a team, supported by external experts, to develop a matrix to segment the countries in the Global Fund’s portfolio by risk…
The Panel’s Analysis of the OIG
In the early years, the institution never developed, nor did the Board discuss, a strategy for dealing with corruption, abuse or mismanagement in its grant-making… The institution ran on a presumption that all its recipients understood and would follow “international standards” for accountability…
Established in July 2005 at the behest of the donors, the OIG has been the only risk-mitigation strategy within the Global Fund that has worked as designed. The Panel has enormous respect for the positive impact the OIG’s work has had on securing the organization’s investments… The willingness of the Fund’s Board to publish the OIG’s findings, openly and transparently, sets it apart from any other bilateral development agency or multilateral financial institution…
The OIG has proven to be a very effective, impartial mechanism to detect and report on risks and management’s stewardship of them… The uneven response by the Global Fund’s Board and Secretariat to implement the OIG’s recommendations in a timely manner, however, has negated the possibility of spreading more of these benefits across the portfolio…
The Relationship Between the OIG and the Secretariat
From the beginning, the senior management at the Secretariat did not favor the creation of the OIG, and lobbied Members of the Board against the idea. Tensions emerged almost immediately between the newly appointed Inspector General and the Global Fund’s staff, a dynamic that has continued to this day, even though the personalities involved have changed.
Some friction between an OIG and management is natural, and probably unavoidable and healthy, since no one loves a watchdog; but the degree to which the relationships have deteriorated at the Global Fund is a cause for concern… A failure by senior management at the Secretariat to heed the OIG’s recommendations in a timely manner complicated the relationships with management… A perception took hold within the OIG that it was being ignored as a matter of policy… FPMs have described becoming wary of making decisions that an OIG audit could call into question. Trust between the two sides eroded to a dangerous point, and disagreements flared openly, including in front of the Global Fund’s Board…
Some wish the Inspector General and his team would acknowledge that many staff members at the Secretariat are as committed to anti-corruption efforts and good governance as OIG staff. Nevertheless, the Panel has found unwillingness among some in the Secretariat, including among senior figures, to accept fully the mandate and role of the OIG as a crucial part of the Global Fund’s structure…
The Executive Director and the Inspector General must strengthen their contacts and communication. The two leaders must send a clear message to all staff that they are working in a collaborative and harmonious manner to achieve the organization’s core objectives. Building genuine trust between the Secretariat and the OIG is urgent and essential, and both parties have to work to solve the recent problems…
The Scope-of-Work of the OIG
The World Bank has five different units to accomplish the tasks in the OIG’s purview. Recent external assessments… have raised questions about the OIG’s mandate on two particular points: programmatic evaluation and internal audit.
Programmatic Evaluation
Evaluation and audit are different fields that each require specific skill sets. In reviewing the OIG’s audit reports, the Panel agrees with criticisms that, at times, the quality of the program evaluation in the documents has been uneven…
Internal Audit
Outside observers, particularly from Europe, agree… that the IG’s “role is a quite unusual mix of internal and external auditing.” Americans, on the other hand, find the structure and purview of the OIG much more familiar and usual.
The vast majority of the OIG’s work, audits and investigations of grants in the field, is akin to that of an external auditor…
Yet, the OIG is also the Global Fund’s internal auditor, because the office has the oversight of the Global Fund Secretariat in its Charter, both for the purpose of audit and investigations… The OIG produces cross-cutting reviews of business processes. Since 2007, the OIG has published five such reports…
These documents… evaluate current practice and underlying policy in a given area of the Secretariat’s work, consider whether that process poses risks for the Global Fund, point out areas for improvement and make specific recommendations to management.
One key difference, however, between the OIG and the internal-audit functions of comparator institutions is that the office releases its reports on the Secretariat to the public, rather than only circulating them “inside the house” as tools for the improvement of management…
Preparing the OIG’s Reports
All stakeholders, including the Secretariat, recognize the rigor and quality of the OIG’s financial audits and investigations. The depth of work involved in cases such as Mali and Mauritania is remarkable…
Nevertheless, a recurring source of complaint in the field and at the Secretariat is how long it takes the OIG to draft, review, and publish its reports… Many of the audits have taken between nine months and one year, from initial preparation through field work to drafting and release. The Panel considers this too long…
The Panel strongly supports the OIG’s intention to roll out a series of Diagnostic Reviews during 2011 and 2012, shorter exercises aimed at drilling down into areas of particular risk in the Global Fund’s grants in a country. Field work for these reports will take only a few weeks, and the schedule for writing and releasing them is much more compressed than for the OIG’s traditional audits…
The long delays in some of the investigations over the past two years have paralyzed multiple grant programs. The Secretariat and the OIG must find methods to allow for the cessation of funding to activities that appear to have been compromised, while allowing other aspects of a grant to continue, perhaps under different management…
The Panel questions whether the reports that go to the Board and the public need to contain all of the detailed information the OIG has uncovered in each case. The Panel also finds that some of the audit and investigative reports contain language that is unusually (and, at times, unnecessarily) harsh and provocative…
The Conduct of the OIG’s Field Teams
The Panel was surprised by the negative reaction, in country after country, to the way the OIG’s teams who visited those places… conducted themselves in the course of audits and investigations. The point came up so strongly and frequently that the panel believes it merits inclusion in this report. PRs, CCMs and SRs claimed that they had originally welcomed the audit process as an opportunity to take advantage of a fresh, outside look at how well they were managing their programs and how they could eliminate any weaknesses. But, in the view of many of the implementers, this goodwill was squandered because of the aggressive attitude and antagonism of the OIG’s teams…The OIG can achieve better results with more sensitivity and diplomacy…
The Panel is heartened that observers have noted the recent OIG audits in Namibia, Bangladesh, South Africa, Kazakhstan, and Burundi showed a change in approach: the OIG was more proactive, explained its work well to the country stakeholders, and left its recommendations in writing after the audit…