When standardizing data is not enough

data abstract

In August, Pentagon officials updated previous guidance in a bid to facilitate better data-sharing between Defense Department components, but some say it could inadvertently place limitations on mission-critical information in the field.

DOD Instruction 8320.02 directs that "data, information and IT services will be made visible, accessible, understandable, trusted and interoperable throughout their lifecycles for all authorized users." In concept, and in most applications, this means that information will be more shareable and more accessible.

But DOD's directive applies to entities under U.S. government authority. In certain cases, including counter-IED operations in combat zones, some information comes from other sources, such as civilian bystanders posting observations on social media, or foreign governments that are not mission partners – parties not subject to U.S. regulations.

As U.S. commitment winds down in Afghanistan, and the Pentagon faces fiscal pressures at home and a changing IED threat worldwide, the reliance on non-standard data sources will only increase, according to Michael Stumborg, counter-IED and weapons technical intelligence mission engineer at Intelligent Software Solutions.

"The problem is not with 8320.02, it's that the instruction only applies to DOD data suppliers," Stumborg said. "If we limit data to what's in standard format and under the control of DOD, we go to war with one hand tied behind our back."

Even as U.S. involvement in Afghanistan recedes, IEDs will remain a dynamic threat around the world. But a limited U.S. presence and resources will require data collected from non-traditional partners, rather than the American troops on the ground that have served as primary data sources, he noted.

"We're used to our own people generating data, but we're going to have to get used to harvesting data created by someone else that is not in our control," Stumborg said. "As much as we'd like to standardize data, improve efficiencies and reduce costs, we're still going to have to find ways of ingesting non-standard data from either fully uncooperative or neutral parties."

At home, reconciling the two might not be the main objective of the DOD directive, but it could be tricky in cases such as counter-IED operations or other activities.

"The idea is that the data and formats should be registered somewhere, so we know what we have and a particular data source could be easily discovered by someone else," said Gunnar Hellekson, chief strategist at Red Hat Inc. "Standards are good because they make it easy for everyone to work together, but that comes at the expense of everyone compromising on what they think the data or the format should be."

Hellekson suggested, though, that it is often relatively easy to extend data sets to include more formats.

The idea behind open data is that all of those formats are centrally registered for easier access and inventory – and that is the goal of 8320.02.

As DOD moves forward with plans to implement the National Information Exchange Model, a plan that provides a core for data components across communities of interest, it will help take care of some of the data sources, such as mission partners. NIEM already is in place at other government agencies, and a March memo from DOD CIO Teri Takai ordered its employment at the Pentagon.

But for the non-standard sources that counter-IED efforts will continue to rely on, DOD leaders may have to find another way of doing things.

"We've had a very difficult time as a nation trying to connect the dots, and those were dots that were under our control," Stumborg said of ongoing counter-IED efforts over the years. "We're moving into an environment where we have to connect dots that we don't even have access to. They're out there in the open; we just have to get at them."

About the Author

Amber Corrin is a former staff writer for FCW and Defense Systems.

The 2015 Federal 100

Meet 100 women and men who are doing great things in federal IT.


  • Shutterstock image (by venimo): e-learning concept image, digital content and online webinar icons.

    Can MOOCs make the grade for federal training?

    Massive open online courses can offer specialized IT instruction on a flexible schedule and on the cheap. That may not always mesh with government's preference for structure and certification, however.

  • Shutterstock image (by edel): graduation cap and diploma.

    Cybersecurity: 6 schools with the right stuff

    The federal government craves more cybersecurity professionals. These six schools are helping meet that demand.

  • Rick Holgate

    Holgate to depart ATF

    Former ACT president will take a job with Gartner, follow his spouse to Vienna, Austria.

  • Are VA techies slacking off on Yammer?

    A new IG report cites security and productivity concerns associated with employees' use of the popular online collaboration tool.

  • Shutterstock image: digital fingerprint, cyber crime.

    Exclusive: The OPM breach details you haven't seen

    An official timeline of the Office of Personnel Management breach obtained by FCW pinpoints the hackers’ calibrated extraction of data, and the government's step-by-step response.

  • Stephen Warren

    Deputy CIO Warren exits VA

    The onetime acting CIO at Veterans Affairs will be taking over CIO duties at the Office of the Comptroller of the Currency.

  • Shutterstock image: monitoring factors of healthcare.

    DOD awards massive health records contract

    Leidos, Accenture and Cerner pull off an unexpected win of the multi-billion-dollar Defense Healthcare Management System Modernization contract, beating out the presumptive health-records leader.

  • Sweating the OPM data breach -- Illustration by Dragutin Cvijanovic

    Sweating the stolen data

    Millions of background-check records were compromised, OPM now says. Here's the jaw-dropping range of personal data that was exposed.

  • FCW magazine

    Let's talk about Alliant 2

    The General Services Administration is going to great lengths to gather feedback on its IT services GWAC. Will it make for a better acquisition vehicle?

Reader comments

Please post your comments here. Comments are moderated, so they may not appear immediately after submitting. We will not post comments that we consider abusive or off-topic.

Please type the letters/numbers you see above