Big data presents unique challenges to agencies


Big data may be on everyone’s lips but as agencies begin to think about how to manage, leverage and store large volumes of information, few have given much thought to actual challenges that may arise

Speaking at a June 21 event on big data held in Washington, Aaron Bird, general manager at Adobe Insight, said agencies grapple with dealing with large amounts of data that are beneficial and interesting when merged into a single platform. The management, sharing and storage of that unsiloed data present the largest roadblocks, he said.

Bird highlighted how the government and industry have different challenges around big data, saying it’s potentially easier to solve big-data problems for commercial-sector customers than federal clients primarily because of access to data.

Federal agencies have to consider security and privacy to a much higher degree, he said.  However, the primary challenge for agencies just launching efforts into big data is how to actually get the data.  Agencies may know from which sources they want to extract data but to actually pull it together often poses another roadblock, Bird said.

Another obstacle is getting multiple agencies to coordinate and communicate with each other, a seemingly tall order, Bird stressed.

“The infrastructure and technology may exist but [agencies] have a different set of challenges in fighting through processes and policies to bring that data together,” he said. “That’s where everyone seems to start, and few agencies have actually successfully gotten past that."

The June 21 panel discussion was part of Federal Computer Week’s Executive Briefings event series.


 

About the Author

Camille Tuutti is a former FCW staff writer who covered federal oversight and the workforce.

The Fed 100

Save the date for 28th annual Federal 100 Awards Gala.

Featured

  • computer network

    How Einstein changes the way government does business

    The Department of Commerce is revising its confidentiality agreement for statistical data survey respondents to reflect the fact that the Department of Homeland Security could see some of that data if it is captured by the Einstein system.

  • Defense Secretary Jim Mattis. Army photo by Monica King. Jan. 26, 2017.

    Mattis mulls consolidation in IT, cyber

    In a Feb. 17 memo, Defense Secretary Jim Mattis told senior leadership to establish teams to look for duplication across the armed services in business operations, including in IT and cybersecurity.

  • Image from Shutterstock.com

    DHS vague on rules for election aid, say states

    State election officials had more questions than answers after a Department of Homeland Security presentation on the designation of election systems as critical U.S. infrastructure.

  • Org Chart Stock Art - Shutterstock

    How the hiring freeze targets millennials

    The government desperately needs younger talent to replace an aging workforce, and experts say that a freeze on hiring doesn't help.

  • Shutterstock image: healthcare digital interface.

    VA moves ahead with homegrown scheduling IT

    The Department of Veterans Affairs will test an internally developed scheduling module at primary care sites nationwide to see if it's ready to service the entire agency.

  • Shutterstock images (honglouwawa & 0beron): Bitcoin image overlay replaced with a dollar sign on a hardware circuit.

    MGT Act poised for a comeback

    After missing in the last Congress, drafters of a bill to encourage cloud adoption are looking for a new plan.

Reader comments

Please post your comments here. Comments are moderated, so they may not appear immediately after submitting. We will not post comments that we consider abusive or off-topic.

Please type the letters/numbers you see above

More from 1105 Public Sector Media Group