the lectern banner

By Steve Kelman

Blog archive

Management 101: It really does work

Shutterstock image (by Ismagilov): restructuring business processes.
  • Set clear, and challenging yet realistic goals.
  • Build trust and commitment among your employees.
  • Elicit employee participation in organizational decision-making.
  • Provide feedback to employees about how they are doing.

Do those management practices make sense as ways to improve an organization's performance? Many of us probably think so, but in truth, most of us don't really know anything about whether such practices really work beyond instinct, anecdote and preconception.

This is why God invented scholarly research. Now three public administration academics, Nathan Favero and Ken Meier of Texas A&M and Larry O'Toole of the University of Georgia, have published a fascinating paper on such questions. It carries the straightforward title of Goals, Trust, Participation, and Feedback: Linking Internal Management with Performance Outcomes, and appears in the new issue of the Journal of Public Administration Research and Theory, the leading scholarly journal on public management.

There are two challenges to doing research that can shed light on whether following these practices in fact improves performance. The first is gathering information on an organization's performance, and hopefully similar information from a number of organizations so their performance can be compared quantitatively. (One reason there is more research on the impact of management practices on business firms than government organizations is that getting data to capture and compare performance of companies -- such as stock price or return on assets -- is far easier than for government.) The other challenge is getting information about what practices organizational leaders actually use.

If you can do both of those things, then your strategy as a researcher is fairly straightforward. You compare the performance of organizations that use a practice with those that don't, and see if there are any patterns of difference. (You need to hold constant, or in research jargon control for, differences between the more and less successful that may be correlated with success, but not caused by different management practices. So, for example, schools with privileged students are likely to perform better than those with disadvantaged kids, independently of whether the schools follow the management practices being investigated.)

The first challenge is easier in the public sector if there are organizations with a lot of units delivering the same service. Two prominent examples are schools and hospitals. And, before this paper came out, there was already a cottage industry of scholars (including Meier himself) analyzing data on schools' performance on standardized tests. Of course this isn't a perfect measure, but compared to many others, it's not bad at all.

The bigger problem is measuring use of these various management practices. Sending in outside observers to look is incredibly costly, and precludes analysis of any large number of cases. Asking managers to self-report their behavior is plagued by the grade inflation and distortion to which self-reports are prone.

Favero and colleagues came up with a great idea: they gathered information on principals' behaviors by using an existing survey that asked not the managers but the people being managed -- their subordinates (teachers) -- about them. One of several questions to measure goalsetting, for example, was, "My school has clear measures of progress for student achievement throughout the year." For feedback, it was, "School leaders visit classrooms to observe the quality of teaching at this school."

The data for the paper all come from New York City schools. And what did the researchers find? When you put all four Management 101 practices together, and added the various controls, three of the four practices had a noticeable impact on improving student test scores.

By a considerable margin (the researchers were able to compare the relative impact of one practice compared to another on test scores), the most helpful of the four practices was goal setting. Furthermore, the impact of the other practices was strengthened when done in conjunction with goal-setting. Chalk one up for performance measurement.

Guess which practice actually had a negative impact on test scores? I suspect it will surprise many readers that it was trust/commitment building, measured by questions such as "School leaders communicate a clear vision for the school" and "I trust the principal at his/her word." Interestingly, this was similar to a finding I had in research on the impact of management practices in a totally different context, anti-crime partnerships in British local government. Hard to know why, but perhaps spending time on this didn't accomplish anything, but took time away from more useful practices.

There's more. The authors also looked at measures of school success other than test scores -- such as attendance, parental satisfaction with the school, and even school violence (they were able to get data for all these) -- and likewise found that the Management 101 practices were also related, though more weakly, to success on those dimensions.

Many readers of this blog of course work for organizations whose performance cannot be measured as well as schools, especially in a way that allows comparisons across a large number of units. Yet these findings are still relevant to you. Of course, not all organizations are the same, and we can't be certain that techniques that work well in schools would work in your organization. But, in the absence of contrary information, it is not a bad bet. We should all thank these three scholars for their work. All you federal managers out there, let's move from knowledge to action.

Posted by Steve Kelman on May 09, 2016 at 3:14 PM


Rising Stars

Meet 21 early-career leaders who are doing great things in federal IT.

Featured

Reader comments

Thu, Jun 2, 2016 Gorvy

I'll bite, too. I second the notion for efficiency. Effectiveness is even more political and harder. Furthermore, many surmise that we are blessed by many policy and program implementations being hobbled by inept, unproductive, under sourced--even over-sourced--implementations.

Wed, May 18, 2016 Al

OK- I'll bite. I would like the world's most efficient Government, rather than more federal jobs created.

Tue, May 17, 2016 former psc person

Gorvan,
Perhaps you are bearing down too hard. Improving the government is a marathon, not a sprint. And it takes a village--as well as a fleet of contractors, FFRDCs, and civil service experts to make it all work. So there is a lot of process and a lot of retooling of human resources. Or waiting for generations of Feds to pass out of government. Measurements are hard; that is why we have so few that people will use and why the system tends to make it impossible to build them into programs and contracts in a compelling way. We firmly believe that more education, training, oversight, and diversity in hiring (business, industry, nationality, demographics, etc.) will make a big difference. More jobs will be created, and when u come down to it, more jobs are what the people want, not the world's most efficient government. Make sense to you?

Fri, May 13, 2016 Gorvan Mestrovich

Prof. Kelman,
Your column, which is shy any specifics, is perhaps a signal that there's not a lot of connection between the obvious TO DOs of good management and good performance in the government. Look at the quality of management in any Federal agency, say, from Reagan I to today. Can you name one that is managed better than it was 35 years ago? If so, what is the proximate cause? I think your honest answers are going to be No and Nothing Shows Up. And during this period, whole careers in the government and studying it have been spent. Hundreds or thousands of person-years on metrics, productivity, performance contracting, modern HR, nifty IT systems. All of this has produced cushy, sustainable, white collar jobs, but really not better government In fact, much of government is worse than it has ever been, regardless of what good-managed tenets have been followed. What suggests progress has been made? I have a different vantage point than you, but have been in the thick of it, 360 degrees, at very high levels for some stretches. I just can't see it. Can you?

Please post your comments here. Comments are moderated, so they may not appear immediately after submitting. We will not post comments that we consider abusive or off-topic.

Please type the letters/numbers you see above

More from 1105 Public Sector Media Group