GAO finds widespread fed data mining

According to a new study, data mining is more pervasive in the federal government than many citizens may realize, a finding that government auditors suggest may exacerbate privacy concerns.

A General Accounting Office report released this week reveals 52 federal agencies that use or plan to use data mining, in most cases for reasons other than searching for hidden terrorist activities. At least 122 of the data mining projects reported in the study include the use of personally identifying information, some of it held in private-sector databases.

For its study, GAO looked at data mining that relies on statistical and modeling techniques to help analysts discover hidden patterns and relationships and to make predictions based on those discoveries.

As GAO noted in its study of 128 federal departments and agencies, data mining challenges the concept of privacy protection afforded to individuals "through the inherent inefficiency of government agencies analyzing paper, rather than aggregated, computer records."

Among the 52 agencies, 199 separate data mining projects are underway or are planned. Service improvement accounts for the largest number of projects, and analyzing intelligence accounts for the smallest number, the study found.

Not surprisingly, the Defense Department accounts for the largest number of data mining projects. The Education Department reports the greatest portion of data mining activities for discovering fraud, waste and abuse. NASA is the source of the most numerous data mining efforts at analyzing scientific information.

Auditors found the most common use of data mining among all agencies is for detecting patterns of criminal activity. GAO conducted the study between May 2003 and April 2004 at the request of Sen. Daniel Akaka (D-Hawaii), ranking minority member of the Senate Subcommittee on Financial Management, the Budget and International Security.


  • 2018 Fed 100

    The 2018 Federal 100

    This year's Fed 100 winners show just how much committed and talented individuals can accomplish in federal IT. Read their profiles to learn more!

  • Census
    How tech can save money for 2020 census

    Trump campaign taps census question as a fund-raising tool

    A fundraising email for the Trump-Pence reelection campaign is trying to get supporters behind a controversial change to the census -- asking respondents whether or not they are U.S. citizens.

  • Cloud
    DOD cloud

    DOD's latest cloud moves leave plenty of questions

    Speculation is still swirling about the implications of the draft solicitation for JEDI -- and about why a separate agreement for cloud-migration services was scaled back so dramatically.

Stay Connected

FCW Update

Sign up for our newsletter.

I agree to this site's Privacy Policy.