Crowdsourcing the price of everything

Shutterstock image: digital charts and graphs.

For decades, the Labor Department's Bureau of Labor Statistics has focused on prices of consumer goods, sending employees out to inspect prices in stores to generate the data for the Consumer Price Index. But the bureau may be getting close to adopting a model that focuses a bit more on the purchasers instead.

Since the summer of 2015, BLS has been in talks with Premise, a price data crowdsourcing firm, said Jim Thomas, BLS' index methods, analysis and evaluation chief.

The work is "experimental" but "accelerating," he said.

Thomas was one of many economists and statisticians speaking at the World Bank's "The Future of Price Statistics" event on March 30, where Premise announced a pilot project with the World Bank.

In more than a dozen developing countries from Brazil to Vietnam, Premise's data collectors (i.e. locals armed with smart phones) generate 1.5 million "observations" every month, Premise CTO Joe Reisinger said. The observations typically take the form of a picture of a store shelf, but can also include the input of, say, a quote for monthly rent.

The ability to gather granular data, observe it as it comes in and tweak collectors' data requests as the process progresses all combine for a powerful tool, said World Bank statistician Nada Hamadeh.

BLS' Thomas said his bureau is experimenting with web scraping to capture precisely that online data, as well as exploring the sourcing of data from companies and other sources to get a fuller price picture.

"We need alternative data sources, and they need official statistics," Thomas said.

But multiple economists suggested that Premise's approach could prove useful for capturing regional price differences. American Southerners, for example, can face radically different prices than their compatriots to the north or west, but so long as the U.S. CPI is calculated by a relative handful of BLS employees, regional differences will remain understated.

Harvard economist and former Treasury Secretary Larry Summers predicted a convergence between developing- and developed-world methods as price data capture technology continues to evolve and capitalize on the combination of easily captured images and analysis that smartphones afford. (Summers serves on Premise's board of directors.)

Summers noted how fundamental price data is to economic analysis – "No economic data are of any real meaning at all without prices," he said – and said that in the history of science, most advancements haven't come from the testing of brilliant hypotheses.

They've come, as they did with the telescope and microscope, merely from getting a better look at what's going on, Summers said. "It's ultimately observation and common sense, rather than genius, that drives scientific progress."

Summers is betting that crowdsourcing via smartphone will prove to be price statistics' telescope.

About the Author

Zach Noble is a staff writer covering digital citizen services, workforce issues and a range of civilian federal agencies.

Before joining FCW in 2015, Noble served as assistant editor at the viral news site TheBlaze, where he wrote a mix of business, political and breaking news stories and managed weekend news coverage. He has also written for online and print publications including The Washington Free Beacon, The Santa Barbara News-Press, The Federalist and Washington Technology.

Noble is a graduate of Saint Vincent College, where he studied English, economics and mathematics.

Click here for previous articles by Noble, or connect with him on Twitter: @thezachnoble.


  • Telecommunications
    Stock photo ID: 658810513 By asharkyu

    GSA extends EIS deadline to 2023

    Agencies are getting up to three more years on existing telecom contracts before having to shift to the $50 billion Enterprise Infrastructure Solutions vehicle.

  • Workforce
    Shutterstock image ID: 569172169 By Zenzen

    OMB looks to retrain feds to fill cyber needs

    The federal government is taking steps to fill high-demand, skills-gap positions in tech by retraining employees already working within agencies without a cyber or IT background.

  • Acquisition
    GSA Headquarters (Photo by Rena Schild/Shutterstock)

    GSA to consolidate multiple award schedules

    The General Services Administration plans to consolidate dozens of its buying schedules across product areas including IT and services to reduce duplication.

Stay Connected

FCW Update

Sign up for our newsletter.

I agree to this site's Privacy Policy.