Saving it for the future

Some agencies may believe they finally have a handle on producing e-mail, Web sites and other digital documents. But unless those agencies have also figured out how to store them—for a year or a generation—they risk violating federal archiving regulations.

About 150 federal archivists, librarians, computer scientists, online services vendors and others gathered recently in Washington, D.C., for the Federal Library and Information Center Committee's 2001 Forum to discuss the government's scattered stabs at the problem—and the Library of Congress' new $100 million legislative effort to provide a blueprint for preserving the government's digital heritage.

"Information professionals believe it's about time for the federal government to acknowledge the full cost of digital preservation," said Susan Tarr, executive director of FLICC. "I don't think any of the big Cabinet-level agencies has really focused on this."

Dubbed the National Digital Information Infrastructure and Preservation Program, the LOC project will bring together representatives from the White House Office of Science and Technology, Commerce Department, National Archives and Records Administration and other agencies. Led by the librarian of Congress, James Billington, participants will begin to standardize policies and procedures for collecting, storing and indexing digital material.

"We will be putting together a plan and be going back to Congress for their approval," said Laura Campbell, LOC's associate librarian for strategic initiatives. "They wanted us to lay out a plan and come back with something that is reasonable."

The program provides $5 million immediately for planning and preserving digital troves that may vanish before the plans go into effect.

"Even in our offices, we are losing [e-mail] messages at an enormous rate," said Sen. Ted Stevens (R-Alaska), a forum speaker and sponsor of the legislation. If this continues, he said, it will hamper future citizens' ability to know "what went on in this democracy in this period."

After Congress approves the LOC plan, $20 million will be added to the $5 million already available to put it into effect, with the final $75 million available over the next two years as matching grants to nonfederal donations.

The project should shape national standards for preserving and retrieving digital materials, said Deanna Marcum, president of the Council on Library and Information Resources, a nonfederal organization that will partner with LOC.

For example, NASA collects troves of digital satellite imagery and information that need to be preserved, she said. "How are we going to be able to retrieve that information so that scientists will be able to make sense of that data years from now?"

Electronic journals, academic and research journals that are "born digital"—edited and issued electronically, with no paper counterpart—also present challenges, Marcum said. Unless such journals are put into archival repositories and moved to new systems when platforms change, they risk being lost, she said. And that violates a basic tenet libraries follow.

"Libraries have a unique responsibility to transfer materials to the next generation and the generation after that," Marcum said.

"E-journals and e-books are going to be an increasing issue for libraries, as well as other scholarly materials," such as dissertations and theses, said Taylor Surface, manager of distributed systems at the Online Computer Library Center Inc., another organization involved in the LOC project.

Although federal law is now interpreted to require the preservation of many electronic records along with paper documents, no federal standards exist to make this happen. Instead, several agencies are grappling with the problem.

As the ultimate caretakers of much of this data, National Archives and Records Administration officials are perhaps furthest along in thinking about how to tag records so that they can be found later.

As digital documents pile up into the billions, keyword searches become useless. Even a narrow search of the recently archived Clinton White House e-mail can return tens of thousands of hits, said Lewis Bellardo, deputy archivist of the United States.

It will become critical to infuse documents with indexing information as they are created, Bellardo told FLICC forum attendees. All arms of the government must work with NARA to modify the way they generate information, he said.

Still, not every record needs to be ar-chived, and others change over time. Officials at the National Library of Medicine have created a way to classify federal documents' longevity and changeability. NLM's "permanence rating" system tells whether a digital record will be eternally available, whether it will have a constant Web address and whether it will change incrementally, radically or not at all.

It took a year to develop the scheme; NLM officials hope to put it into practice soon.

How tough is it to implement a departmentwide digital preservation plan? Agriculture Department officials have been working on the issue since 1997, but a set of draft guidelines still await their chief information officer's approval.

"We've had a certain amount of progress; perhaps not as much as we would have liked, but we're moving ahead," National Agricultural Library Director Pamela Andre told attendees.

At that rate, USDA officials could find themselves overtaken by LOC's project. But when it comes to setting standards for the entire government, Stevens is satisfied with a deliberate pace.

"I think we could make big mistakes if we move too early," the senator said. "If I have my way, we'll wait until Dr. Billington completes his work."

Peniston is freelance writer based in Washington, D.C.

MORE INFO

Preserving digital records: A status report

National Archives and Records Administration: With long-term storage

strategies coming into focus, NARA is working on ways to index billions

of documents.

Library of Congress: The library has been tapped by lawmakers for a

two-year, $100 million effort to draft federal preservation standards.

Agriculture Department: USDA has been working on the issue since 1997,

but draft guidelines on digital publications await the CIO's ratification.

National Library of Medicine: Its "permanence ratings" may become a

model for classifying federal documents' longevity and changeability.

Source: FLICC

X
This website uses cookies to enhance user experience and to analyze performance and traffic on our website. We also share information about your use of our site with our social media, advertising and analytics partners. Learn More / Do Not Sell My Personal Information
Accept Cookies
X
Cookie Preferences Cookie List

Do Not Sell My Personal Information

When you visit our website, we store cookies on your browser to collect information. The information collected might relate to you, your preferences or your device, and is mostly used to make the site work as you expect it to and to provide a more personalized web experience. However, you can choose not to allow certain types of cookies, which may impact your experience of the site and the services we are able to offer. Click on the different category headings to find out more and change our default settings according to your preference. You cannot opt-out of our First Party Strictly Necessary Cookies as they are deployed in order to ensure the proper functioning of our website (such as prompting the cookie banner and remembering your settings, to log into your account, to redirect you when you log out, etc.). For more information about the First and Third Party Cookies used please follow this link.

Allow All Cookies

Manage Consent Preferences

Strictly Necessary Cookies - Always Active

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data, Targeting & Social Media Cookies

Under the California Consumer Privacy Act, you have the right to opt-out of the sale of your personal information to third parties. These cookies collect information for analytics and to personalize your experience with targeted ads. You may exercise your right to opt out of the sale of personal information by using this toggle switch. If you opt out we will not be able to offer you personalised ads and will not hand over your personal information to any third parties. Additionally, you may contact our legal department for further clarification about your rights as a California consumer by using this Exercise My Rights link

If you have enabled privacy controls on your browser (such as a plugin), we have to take that as a valid request to opt-out. Therefore we would not be able to track your activity through the web. This may affect our ability to personalize ads according to your preferences.

Targeting cookies may be set through our site by our advertising partners. They may be used by those companies to build a profile of your interests and show you relevant adverts on other sites. They do not store directly personal information, but are based on uniquely identifying your browser and internet device. If you do not allow these cookies, you will experience less targeted advertising.

Social media cookies are set by a range of social media services that we have added to the site to enable you to share our content with your friends and networks. They are capable of tracking your browser across other sites and building up a profile of your interests. This may impact the content and messages you see on other websites you visit. If you do not allow these cookies you may not be able to use or see these sharing tools.

If you want to opt out of all of our lead reports and lists, please submit a privacy request at our Do Not Sell page.

Save Settings
Cookie Preferences Cookie List

Cookie List

A cookie is a small piece of data (text file) that a website – when visited by a user – asks your browser to store on your device in order to remember information about you, such as your language preference or login information. Those cookies are set by us and called first-party cookies. We also use third-party cookies – which are cookies from a domain different than the domain of the website you are visiting – for our advertising and marketing efforts. More specifically, we use cookies and other tracking technologies for the following purposes:

Strictly Necessary Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Functional Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Performance Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Social Media Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Targeting Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.