Big data presents unique challenges to agencies


Big data may be on everyone’s lips but as agencies begin to think about how to manage, leverage and store large volumes of information, few have given much thought to actual challenges that may arise

Speaking at a June 21 event on big data held in Washington, Aaron Bird, general manager at Adobe Insight, said agencies grapple with dealing with large amounts of data that are beneficial and interesting when merged into a single platform. The management, sharing and storage of that unsiloed data present the largest roadblocks, he said.

Bird highlighted how the government and industry have different challenges around big data, saying it’s potentially easier to solve big-data problems for commercial-sector customers than federal clients primarily because of access to data.

Federal agencies have to consider security and privacy to a much higher degree, he said.  However, the primary challenge for agencies just launching efforts into big data is how to actually get the data.  Agencies may know from which sources they want to extract data but to actually pull it together often poses another roadblock, Bird said.

Another obstacle is getting multiple agencies to coordinate and communicate with each other, a seemingly tall order, Bird stressed.

“The infrastructure and technology may exist but [agencies] have a different set of challenges in fighting through processes and policies to bring that data together,” he said. “That’s where everyone seems to start, and few agencies have actually successfully gotten past that."

The June 21 panel discussion was part of Federal Computer Week’s Executive Briefings event series.


 

About the Author

Camille Tuutti is a former FCW staff writer who covered federal oversight and the workforce.

Featured

  • Contracting
    8 prototypes of the border walls as tweeted by CBP San Diego

    DHS contractors face protests – on the streets

    Tech companies are facing protests internally from workers and externally from activists about doing for government amid controversial policies like "zero tolerance" for illegal immigration.

  • Workforce
    By Mark Van Scyoc Royalty-free stock photo ID: 285175268

    At OPM, Weichert pushes direct hire, pay agent changes

    Margaret Weichert, now acting director of the Office of Personnel Management, is clearing agencies to make direct hires in IT, cyber and other tech fields and is changing pay for specialized occupations.

  • Cloud
    Shutterstock ID ID: 222190471 By wk1003mike

    IBM protests JEDI cloud deal

    As the deadline to submit bids on the Pentagon's $10 billion, 10-year warfighter cloud deal draws near, IBM announced a legal protest.

Stay Connected

FCW Update

Sign up for our newsletter.

I agree to this site's Privacy Policy.