Big Data

NSA returns to open source

The agency usually known for its devotion to secrecy has again jumped into the world of public open-source coding.

In a Nov. 25 announcement, National Security Agency officials said they were making their tool Niagarafiles, or NiFi, publicly available in the hope that industry would modify it to handle commercial big-data needs.

The technology helps automate high-volume data flows among multiple computer networks, even if those networks use different formats and protocols. NSA said the private sector could use the technology in various ways to control, manage and analyze information from geographically dispersed sites to create comprehensive situational awareness.

Given its reputation for secrecy and controversial surveillance programs, the agency turned to a less emotionally charged group to distribute the code: NiFi is available through the Apache Software Foundation, a 501(c)(3) nonprofit corporation sponsored by a decentralized community of software developers.

NSA said NiFi is the first in a series of releases of software developed under its Technology Transfer Program. Officials said posting the software to open-source forums lets the private sector get a close-up look at the agency's research and make suggestions about enhancements and other uses for the technology.

NSA officials said they often use open-source offerings to bolster creativity and agility as they develop new technologies.

In 2011, NSA contributed a technology dubbed Accumulo to the Apache foundation as an incubator project for sorting big data, which Apache turned into a top development priority.

About the Author

Mark Rockwell is a senior staff writer at FCW, whose beat focuses on acquisition, the Department of Homeland Security and the Department of Energy.

Before joining FCW, Rockwell was Washington correspondent for Government Security News, where he covered all aspects of homeland security from IT to detection dogs and border security. Over the last 25 years in Washington as a reporter, editor and correspondent, he has covered an increasingly wide array of high-tech issues for publications like Communications Week, Internet Week, Fiber Optics News, tele.com magazine and Wireless Week.

Rockwell received a Jesse H. Neal Award for his work covering telecommunications issues, and is a graduate of James Madison University.

Click here for previous articles by Rockwell. Contact him at mrockwell@fcw.com or follow him on Twitter at @MRockwell4.


Featured

  • Congress
    Rep. Jim Langevin (D-R.I.) at the Hack the Capitol conference Sept. 20, 2018

    Jim Langevin's view from the Hill

    As chairman of of the Intelligence and Emerging Threats and Capabilities subcommittee of the House Armed Services Committe and a member of the House Homeland Security Committee, Rhode Island Democrat Jim Langevin is one of the most influential voices on cybersecurity in Congress.

  • Comment
    Pilot Class. The author and Barbie Flowers are first row third and second from right, respectively.

    How VA is disrupting tech delivery

    A former Digital Service specialist at the Department of Veterans Affairs explains efforts to transition government from a legacy "project" approach to a more user-centered "product" method.

  • Cloud
    cloud migration

    DHS cloud push comes with complications

    A pressing data center closure schedule and an ensuing scramble to move applications means that some Homeland Security components might need more than one hop to get to the cloud.

Stay Connected

FCW INSIDER

Sign up for our newsletter.

I agree to this site's Privacy Policy.