Records management

NARA looks to bring agency records into the 21st century

Placeholder Image for Article Template

It has been more than two years since President Barack Obama put the government on a trajectory to archive all records electronically, and the National Archives and Records Administration recently completed a round of training on a new template for determining which official email accounts should be archived as permanent records.

Following Obama's November 2011 memorandum, a subsequent directive in August 2012 from the Office of Management and Budget put NARA in charge of the effort with the goal of having all permanent records stored electronically by 2019. Additionally, the government is facing a deadline of 2016 for the storage of agency email messages in a digital format.

The new tasks have kept NARA busy. The agency updated its guidance on managing social media records in October. In early November, it posted a draft of a major revision of media formats acceptable for archival purposes, including new formats such as computer-aided design files, digital audio and video, and a long list of commonly used document formats such as Microsoft Word and PDF. An official version is expected to be shared with agencies next year.

At a Dec. 3 Government IT Forum in Washington, D.C., Don Rosen, NARA's director of policy analysis and enforcement, said the goal of much of this activity is to make it as simple as possible for people tasked with handling records at agencies to make transfers to the archive.

NARA is also trying to lead by example. It has developed an internal approach to automating archiving on its Google-based email system and hopes to entice agencies to do the same.

Existing methods of email transfer can be surprisingly primitive. Some agencies print paper versions of email messages, file them, then ship those files to NARA in accordance with established schedules. Even electronic capture and transfer often involve dragging and dropping email messages periodically from user inboxes to archive folders.

"The scale of electronic records being created requires more individual decisions than users can be reasonably expected to process in a manual way," said Meg Phillips, external affairs liaison at NARA.

By the end of the year, NARA officials hope to arrive at a comprehensive set of approaches for automatically archiving email, social media and other electronic records. They are considering rules-based automation that keys into metadata information, an analytics approach that machine-reads email content and a service-based approach built into cloud architecture, among others. Rather than being prescriptive in terms of technology, NARA is trying give agencies a menu of options from which to choose.

Another goal of the directive is to set standards for the maturity of records management programs. The issue is especially acute at the Department of Homeland Security because of its diverse components, said DHS Records Officer Tammy Hudson during a separate panel discussion at the Government IT Forum.

When DHS was created, the Coast Guard and the Secret Service had mature records management programs, but the newly formed Transportation Security Administration had to build a program from scratch. Large functions brought in from other departments -- such as customs, which formerly belonged to the Treasury Department, and immigration services, which came from the Justice Department -- had to integrate their legacy information into the DHS structure. Adding to the chaos, the Federal Emergency Management Agency was so focused on its core mission that it was unable to keep records during disaster response activities.

Two years into a records management overhaul, Hudson just about has a handle on the situation. She explained the process alongside Suzanne Gill, a senior consultant at contractor Battle Resource Management Inc. DHS has revised the mandatory records training process for new employees and contractors, which previously came at the tail end of a two-day onboarding process. Now there is an online component to the training, and employees get periodic refreshers on how to handle records.

DHS also developed a strategy to combine a group of archiving, organizing and data retrieval functions into a single suite of services.

Records, legal document discovery and the processing of Freedom of Information Act requests have historically been handled by different offices at DHS. But with support from Keith Trippie, executive director of DHS' Enterprise System Development Office, an executive council was created to bring together those stakeholders.

The process has not been finalized yet, in part because of leadership turnover at DHS. The department is getting a new CIO, a new chief privacy officer and a new general counsel, as well as a new secretary. Once the executive council is reconstituted, Hudson said she hopes the group will approve the new records management regime.

About the Author

Adam Mazmanian is executive editor of FCW.

Before joining the editing team, Mazmanian was an FCW staff writer covering Congress, government-wide technology policy, health IT and the Department of Veterans Affairs. Prior to joining FCW, Mr. Mazmanian was technology correspondent for National Journal and served in a variety of editorial at B2B news service SmartBrief. Mazmanian started his career as an arts reporter and critic, and has contributed reviews and articles to the Washington Post, the Washington City Paper, Newsday, Architect magazine, and other publications. He was an editorial assistant and staff writer at the now-defunct New York Press and arts editor at the online network in the 1990s, and was a weekly contributor of music and film reviews to the Washington Times from 2007 to 2014.

Click here for previous articles by Mazmanian. Connect with him on Twitter at @thisismaz.

FCW in Print

In the latest issue: Looking back on three decades of big stories in federal IT.


  • Shutterstock image: looking for code.

    How DOD embraced bug bounties -- and how your agency can, too

    Hack the Pentagon proved to Defense Department officials that outside hackers can be assets, not adversaries.

  • Shutterstock image: cyber defense.

    Why PPD-41 is evolutionary, not revolutionary

    Government cybersecurity officials say the presidential policy directive codifies cyber incident response protocols but doesn't radically change what's been in practice in recent years.

  • Anne Rung -- Commerce Department Photo

    Exit interview with Anne Rung

    The government's departing top acquisition official said she leaves behind a solid foundation on which to build more effective and efficient federal IT.

  • Charles Phalen

    Administration appoints first head of NBIB

    The National Background Investigations Bureau announced the appointment of its first director as the agency prepares to take over processing government background checks.

  • Sen. James Lankford (R-Okla.)

    Senator: Rigid hiring process pushes millennials from federal work

    Sen. James Lankford (R-Okla.) said agencies are missing out on younger workers because of the government's rigidity, particularly its protracted hiring process.

  • FCW @ 30 GPS

    FCW @ 30

    Since 1987, FCW has covered it all -- the major contracts, the disruptive technologies, the picayune scandals and the many, many people who make federal IT function. Here's a look back at six of the most significant stories.

Reader comments

Wed, Dec 4, 2013 Lawrence Medina West Coast

Let's be clear here. While NARA does write the guidance for management of Federal Records (included in 36CFR), the requirements for Agencies to "archive all records electronically" applies ONLY to Permanent records. And the estimate of the volume of Federal records that meet the requirement for Permanent retention has remained around 2-3% of ALL Federal records generated. The more onerous requirement is the push to manage electronic mail in a digital form, and to segregate the records meeting the need for Permanent retention there... a true "sorting the wheat from the chaff" issue for Federal Agencies. Most e-mail applications are not designed to easily categorize content bases on taxonomy or other searches to do this automatically, so efforts are looking at things such as "role and relationship" to help determine the requirement, but even in doing this a large volume of non-records and short term retention content is getting scooped up and retained as Permanent. It's near impossible to get a clear distinction without SOME human intervention, and this is the biggest stumbling block to success. Even in private industry, it's seen as "less expensive and easier" to simply use applications improperly referred to as 'e-mail archiving' tools and keep a copy of ALL e-mail messages. The biggest issue here is if you apply that same 2-3% rule, you end up with HUGE volumes of e-mail being retained for no purpose for lengthy periods of time at a huge cost, that are unsearchable and can result in costly requirements to review in the event of a legal action. Because it qualifies as ESI (electronically stored information) ... it must be identified when you prepare a data map and disclosed, and if you have it, it's subject to discovery. The aggressive deadlines set in the Presidential Memo need to be re-evaluated and more realistic targets should be set . With the aging Federal workforce resulting in long-term records management staff dwindling and funding at some of the lowest levels seen in decades, it seems less plausible to reach these milestones. Evaluating technology, establishing new policies and procedures, training staff and developing successful models to meet the requirements is going to take more time than allotted. And NARA has to "gear up" for the influx of all of this content and establish models to manage, store, and fund the "care and feeding" of this HUGE volume of content for decades to come.

Please post your comments here. Comments are moderated, so they may not appear immediately after submitting. We will not post comments that we consider abusive or off-topic.

Please type the letters/numbers you see above

More from 1105 Public Sector Media Group