Quick Study

By Brian Robinson

Blog archive

Getting out in front of the burgeoning data deluge

Digital preservation is one of those issues that everyone thinks is obvious; it also is one that no one really talks about and, least of all, offers any solutions for.

Everyone will have yet another chance to confront the issue on April 1 when the Blue Ribbon Task Force on Sustainable Digital Preservation and Access plans to hold a symposium in Washington on “sustainable digital preservation practices.” It will include a wide range of organizations whose existence depends upon digital preservation, such as Google, as well as representatives from the publishing and movie industries. There also surely will be plenty of government involvement as well.

This isn’t a new subject, but it’s one that rarely makes the headlines. Data protection is all the rage, and producing data comes in a close second, but who ever talks about preserving it? It’s taken as given. Every now and then stories about the work of the National Archives or Library of Congress are published but never seem to make it onto the most-popular or most-read lists.

But think about it: We are now well into the exabyte-per-year era of data (1 billion gigabytes), and reports from outfits such as the International Data Corp. predict a doubling of the size of the digital universe every 18 months. Given the explosion in social media, and the coming one in online video, I’d say that’s conservative.

How do you store all of that data, let alone find ways to manage it so you can retrieve it and make use of it? Government mandates on retaining data aren’t going away, after all.

The blue ribbon panel recently came out with a report that examines the economies involved with both preserving data and making sure it can be accessed.

In an earlier article, task force member Dr. Fran Berman, director of the San Diego Supercomputer Center (SDSC) at the University of California-San Diego, talked about what’s needed to meet the data-cyberinfrastructure challenge.

Good stuff. I’m sure that and lots more will be discussed at the April 1 symposium. But will anybody be listening?

Posted by Brian Robinson on Mar 03, 2010 at 12:19 PM


The Fed 100

Save the date for 28th annual Federal 100 Awards Gala.

Featured

  • computer network

    How Einstein changes the way government does business

    The Department of Commerce is revising its confidentiality agreement for statistical data survey respondents to reflect the fact that the Department of Homeland Security could see some of that data if it is captured by the Einstein system.

  • Defense Secretary Jim Mattis. Army photo by Monica King. Jan. 26, 2017.

    Mattis mulls consolidation in IT, cyber

    In a Feb. 17 memo, Defense Secretary Jim Mattis told senior leadership to establish teams to look for duplication across the armed services in business operations, including in IT and cybersecurity.

  • Image from Shutterstock.com

    DHS vague on rules for election aid, say states

    State election officials had more questions than answers after a Department of Homeland Security presentation on the designation of election systems as critical U.S. infrastructure.

  • Org Chart Stock Art - Shutterstock

    How the hiring freeze targets millennials

    The government desperately needs younger talent to replace an aging workforce, and experts say that a freeze on hiring doesn't help.

  • Shutterstock image: healthcare digital interface.

    VA moves ahead with homegrown scheduling IT

    The Department of Veterans Affairs will test an internally developed scheduling module at primary care sites nationwide to see if it's ready to service the entire agency.

  • Shutterstock images (honglouwawa & 0beron): Bitcoin image overlay replaced with a dollar sign on a hardware circuit.

    MGT Act poised for a comeback

    After missing in the last Congress, drafters of a bill to encourage cloud adoption are looking for a new plan.

Reader comments

Please post your comments here. Comments are moderated, so they may not appear immediately after submitting. We will not post comments that we consider abusive or off-topic.

Please type the letters/numbers you see above

More from 1105 Public Sector Media Group