the lectern banner

By Steve Kelman

Blog archive

VA waiting lists and performance measurement

Accusations that a Department of Veterans Affairs hospital in Phoenix, and perhaps others, created artificially positive wait-time statistics by hiding the names of veterans who were waiting a long time for appointments on a secret list have been all over the print and television media. A Google search with the keywords "Veterans Affairs Phoenix" yielded over 19 million hits.

As a balanced Associated Press article in the Washington Post makes clear, at this point the accusations have not been proven and VA hospital officials in Phoenix have denied them. But let's assume for a moment that they are true, which is not impossible or even implausible. If so, it would not be the first time that people fudged or cheated when reporting performance information to overseers. Think of the various scandals in which teachers changed student test results or, to take a very dramatic corporate example, the accounting manipulation at Enron.

The VA's cheating, if it occurred, happened in the context of the department's performance measurement system, which collects data about various aspects of the performance of VA hospitals for the purpose of using it to improve how well the hospitals serve patients. What are the implications, then, of cheating for how we look at the increasingly widespread use of performance measurement to manage in government?

The strongest critics -- and they are not a tiny group -- would argue that situations like this show that government should not be using performance measures at all.

That argument does not make any more sense than it would to argue that Enron or any other accounting scandal meant profit should no longer be used as a performance measure for businesses. The ability of profit to drive the improved performance of companies means that a world without profit as a performance measure might not have Enron, but it would likely have lots of East Germanies.

Indeed, the allegation that VA patients died because of waiting-list falsification can be made only in the context of noting that a genuine, non-falsified system of performance measurement saves lives. In a system with no performance measures for wait times, those on the secret list would not have gotten treated any faster than they did. Indeed, in that world, everyone seeking treatment would in effect be part of a secret list.

Furthermore, the suggestion that people might have died because of the falsification makes sense only if we assume that correct performance information about wait times (as opposed to eliminating those waiting a long time from the numbers) would generate information about deficiencies that then would encourage corrective action.

So if we should be tracking the VA's performance measures, what should we do to reduce the risk of cheating? As Shelley Metzenbaum, president of the Volcker Alliance, said, the first line of defense is to integrate performance measurement into the organization's IT system for processing customers. If every patient who seeks an appointment at a VA hospital is immediately entered into an IT database and that database is used to develop the performance information on the hospital's wait times, it would not be possible to create a secret list that removes the patient from the system, especially if the system were configured to make it impossible to remove a name once entered. Frankly, I would be a little surprised if VA hospitals did not already have such a system, which makes me slightly skeptical of these allegations in the first place. (Full disclosure: Metzenbaum is a former Office of Management and Budget and Environmental Protection Agency official, a 2011 Federal 100 winner, and my wife.)

Beyond that, we should return to the Enron accounting example I mentioned earlier. The most widely used performance measure in the world is the profit measure for private firms. Given the large amounts of money at stake for financial markets and individual company executives, that measure creates enormous incentives for cheating and gaming. That is why more than a hundred years ago an accounting industry developed to audit the accuracy of companies' financial performance information. That system is not perfect, but it is hard to imagine that capitalism could function without auditors keeping the level of fraud low for performance measures.

As government becomes more serious about performance measurement, the danger of falsification will increase. In some sense, this is a good sign that measurement is being taken seriously. And falsification is not bad just in itself; it is bad because it hurts the ability of those measures to improve performance. It would be good, in my view, if inspectors general diverted energy from some low value-added, grandstanding activities in which they are currently engaged to taking on the role of an agency's auditors of performance measures.

Posted by Steve Kelman on May 19, 2014 at 10:37 AM


Reader comments

Wed, May 28, 2014

The VA is more than just health care. Who is going to reach out to homeless veterans? Who knows how to deal with severe combat injuries? How to deal with the lasting effects of combat, the psychological scars that you don't see. Who is simply going to give veterans a place to go? Who can handle the volume of people who need care? When you can answer these questions with viable alternatives, then you can close the VA. Until then, how about some support for those of us in the trenches trying to care for our veterans?

Sun, May 25, 2014

ow many of us asked that folks like FCW keep pressure on all of VA's leadership?? It's easy to take this issue at a skin deep level, but don't let them. Please! The vast majority of VA employees are hard working people who love and care about our nation's Veterans, it's unfortunate that the VA's SES leadership is a poor as it is. You're an IT-focused magazine, you've seen it in the technology department, it's just as bad outside if it; perhaps worse. Keep asking why and digging. Please!

Sat, May 24, 2014 Gorgonzola Wash, DC

Professor--you need to catch up on you DVA IG reading. The faking of lists has been documented for years. Not fixed. And you are straining, or so it seems, from being totally in denial, to waiting for.....something. Action not coming quickly to your lips. It is time to fire some officials, for cause--no legislation is needed. It is time to refine and surveil humanoid procedures that mate with the IT app that schedules. It is easy to get this right, with just a little bit of technical skill and more political will than the Administration wants to muster. Please don't invite, yet again, apologize for career Federal employees. We/they are protected enough. Time to do something other than study, pontificate, dither, and delay.

Wed, May 21, 2014 Al

Vouchers for veterans would clear the waiting list pretty quickly, if this is a real problem.

Wed, May 21, 2014 Susan US

Wait lists were clearly a problem in VA, according to its own inspector general reports - and certainly no secret. Was there a coverup in the VA? Did bonuses go to those who participated in the coverup? And were employees ostracized for trying to report these matters? http://www.va.gov/oig/pubs/VAOIG-12-00900-168.pdf

Show All Comments

Please post your comments here. Comments are moderated, so they may not appear immediately after submitting. We will not post comments that we consider abusive or off-topic.

Please type the letters/numbers you see above