Steve Kelman

TheLectern

By Steve Kelman


The larger message in social media metrics

Justin Herman

Justin Herman, new media manager at the GSA’s Center for Excellence in Digital Government, shown speaking at GSA's Social Media Week in February. (FCW photo by Frank Konkel)

FCW reporter Frank Konkel wrote an interesting article on FCW.com on efforts growing out of a working group inside the General Services Administration to develop performance measures for government social media sites.

I found the article fascinating from two perspectives. First, the metrics themselves look sensible. For example, they suggest tracking "conversions" (when people click through from the post to additional linked content), "loyalty" (when first-time visitors return), and "customer service" (timeliness in responding to requests). I am guessing many of these metrics grow out of private-sector practice in tracking social media effectiveness; and I say this as a kudos for learning from others, not a knock for lack of originality. There are too many home-grown approaches in government to issues that have perfectly good private-sector counterparts. I am also hoping that the data to track many of the metrics presented is generated either free or at very low cost.

These metrics also lend themselves to performance improvement – figuring out how to do a better job. Companies are already frequently running quick experiments for their webpages or social media offerings, randomly exposing visitors to different versions of a message, or positioning a message at different parts of a screen, in order to see, for example, which produces more click-throughs. Government needs to start doing these kinds of experiments (in a scientific sense – two different treatments to randomly chosen groups, to look to see whether the result is different) in a lot of areas, and experiments involving social media effectiveness is a good place to start.

But this article is significant even for people who are not involved at all in social media. It is a sign that performance measurement – in this year, the twentieth anniversary of the passage of the Government Performance and Results Act in 1993 – is now becoming taken for granted as a way to do business in government. I recently interviewed a subcabinet agency head, and he noted that he thought his agency had now gotten to the point where briefings for new leaders would include the organization’s major performance measures, the targets for performance improvement in those measures, and the historical performance over the last few years. This is a revolution in government, and a good one. Performance measurement has progressed during one Republican presidential administration and two Democratic ones, suggesting that management reform really benefits from bipartisan support.

As we approach sequestration, it is a fair question to ask whether agencies can afford to spend any of their scarce resources on measuring their performance, rather than just performing. My answer would be that in tight budget times, performance measurement is more necessary than ever, because we have to try to get better at what we do not just by throwing additional dollars around, but by improving efficiency and effectiveness. By helping organizations learn how to do a better job, by focusing them on the most-important activities, and by motivating people to try harder, performance measurement is a powerful tool for lean times.

Posted on Feb 22, 2013 at 12:09 PM1 comments


Coming soon: The university of the internet

computer and books

At a recent Kennedy School faculty meeting, our dean gave a report on a meeting he had attended with other senior university administrators from the United States and abroad. The topic that attracted the most interest in the discussion was the spread of online university education via so-called “massive open online courses” (MOOCs). These are online lectures, so far mostly but not exclusively in the sciences, given by professors who are very talented as teachers. Most are open for viewing for free, but in some cases one can pay a fee in order to take an exam and get course credit. (Here’s a link to the Wikipedia entry on MOOCs.)

The dean's basic point was that administrators agree the move towards MOOCs is going much faster than anyone expected, and an upheaval in higher education may be around the corner. Universities are, the view seems to be, about to be swept up in technology-induced change in a way that first became familiar when MCI long distance challenged the old AT&T, and that we have seen more recently with newspapers and music. Rather than trying to fight this, Harvard and MIT have joined to form EdX to promote and develop MOOC’s.

Of course, nobody knows what form all of this will take, but there are a lot of fascinating questions. The more material is taught online, the less demand there will be for traditional professors. There is going to be a lot of demand for people to grade exams (except possibly in math or science, where exams can often be graded by computer). At some (or maybe many ) universities, there will be demand for on-site education to complement online lectures -- at Harvard we like to think that many students will still want the kind of in-person experience we offer – but the kind of classroom teaching will be very different from what it is today.

The price pressures that online learning produces will be welcome to all those who worry about the affordability of higher education, but one issue will be the pressures to eliminate the “cross-subsidy” of scholarly research by other revenue sources for universities, and the danger this poses for our country’s foremost position in the world as a source of research. (Somewhat relatedly, the easiest way for universities to raise money from donors is to build buildings, and the “overhead” part of the donation currently helps pay for other activities at the university – yet online education may produce a decline in demand for buildings and hence in universities’ ability to raise money from donors.)

This movement is clearly a survival threat to lower-quality universities that are charging a lot of money for lectures that probably aren’t as good as the ones online. Some will survive by offering degrees to people who can’t pass online course exams, or through the opportunity for young people to socialize or watch football – though in both cases, likely at a much lower price point. At the other end, clearly there are far more students who could pass Harvard exams than there are students who get admitted to Harvard. What will happen to the credentialing and sorting function of universities?

I will confess that my first reaction in listening to my Dean’s discussion was that maybe I should get ready to retire earlier than I expected. We’ll see. Meanwhile, watch this space for updates.

Posted on Feb 20, 2013 at 12:09 PM1 comments


How measurement motivates, part 2

measurement tool

In my last blog post, I noted that the idea of using performance measures as a way to motivate employees to meet challenging goals is the most underused performance-improvement tool federal managers have. I promised I would share some further research findings. This topic has been well researched by scholars (led by Gary Latham of the University of Toronto and Ed Locke of the University of Maryland).

So here goes:

1) Although attaching a monetary award to achievement of a goal motivates greater improvements in performance, the motivating role of a challenging goal occurs even without monetary award. This is particularly relevant in government, where the ability to give such contingent monetary rewards is often lacking.

2) The most motivating goals are neither too easy (if they are easy to achieve, they don’t motivate) nor impossible (people will give up, and not be motivated). The most effective goals are moderate “stretch goals.”

3) One exception to the rule that performance goals are the best way to motivate is if a person is trying to learn a new task they can’t already do. In such cases, learning goals (trying some number of new strategies) motivate better than performance goals for doing the task.

4) There was a debate for a number of years between two scholars about whether it was necessary for employees to participate in establishing the goals in order for them to be motivating. The scholars finally agreed on an experiment to settle the dispute, and here’s what they found: for goals to motivate, employees must buy in to them, but participation in goal-setting is only one of the ways to get employee buy-in.

All right, given we’re talking furloughs in the government, I suspect it’s not the greatest time to be discussing motivating federal employees. I am writing about this topic now only because it came up in executive education at the Kennedy School. But improving the performance of our organizations is the best contribution feds can make to reduce the likelihood of furloughs. Performance improvement, in an important sense, gets to the root of the discontent with government that ends up producing things like furloughs.

Posted on Feb 15, 2013 at 12:09 PM1 comments