Big data: Border protection's first line of defense

US Canada border

The Department of Homeland Security's biggest weapon in securing American borders is not a fence or a fingerprint, but data -- and lots of it.

DHS and its component agencies clear some 1 million people across U.S. borders and process some 60,000 maritime and air-freight containers daily, just a small portion of the $2 trillion worth of imported goods that enter the country every year.

The incoming flow of goods and people also comprises massive datasets DHS continuously runs against other federal databases – no-fly and watch lists, for example – allowing the agency to differentiate among risks specific to a particular passenger or cargo.

DHS has been collecting and logging these datasets for upwards of 10 years, building petabyte-sized "haystacks of data" in which hide elusive needles of useful information. The department's evolutionary successes in handling the information has turned big data into a big part of its strategy in protecting borders, according to Alan Bersin, assistant secretary of international affairs and chief diplomatic officer for DHS.

Big data, he said, has changed the way DHS looks at borders.

"We typically think of borders as the first line of defense, with hard lines, but in the global context, our job is to keep dangerous people and dangerous things away from the homeland," said Bersin, speaking Oct. 30 at the Bipartisan Policy Center. "We don't do that by looking at borders as the first line of defense, but as the last line."

By Bersin's count, there are three ways to approach the problem. The government's post-Sept. 11 attempt at one of them – looking at every piece of data – was a failure, Bersin said, noting that border personnel can't possibly open every trunk of every vehicle that comes by.

The second, using specific intelligence such as a suspected terrorist's phone number to find the person works only if that specific intelligence is available.

Where DHS has been successful in recent years is with the third approach, making the proverbial haystack smaller, Bersin said. The ability to differentiate among risks "is where big data comes into play," he said.

The case of Umar Farouk Abdulmutallab, the Nigerian man jailed for attempting to bring down Northwest flight 253 over Detroit in 2009 with a bomb hidden in his underwear, is "the seminal case that changed the way we looked at using data," Bersin said.

Abdulmutallab purchased a one-way ticket to the U.S. in Africa and carried no luggage. Today those unusual data points would be scanned against previous flight records and a series of other databases, leading authorities to a rapid secondary examination of such a passenger.

Were Abdulmutallab's scenario to unfold again, DHS's big data efforts would likely have prevented him from getting aboard his target flight. As it was, he was foiled by a quick thinking flight attendant.

About the Author

Frank Konkel is a former staff writer for FCW.

FCW in Print

In the latest issue: Looking back on three decades of big stories in federal IT.


  • Anne Rung -- Commerce Department Photo

    Exit interview with Anne Rung

    The government's departing top acquisition official said she leaves behind a solid foundation on which to build more effective and efficient federal IT.

  • Charles Phalen

    Administration appoints first head of NBIB

    The National Background Investigations Bureau announced the appointment of its first director as the agency prepares to take over processing government background checks.

  • Sen. James Lankford (R-Okla.)

    Senator: Rigid hiring process pushes millennials from federal work

    Sen. James Lankford (R-Okla.) said agencies are missing out on younger workers because of the government's rigidity, particularly its protracted hiring process.

  • FCW @ 30 GPS

    FCW @ 30

    Since 1987, FCW has covered it all -- the major contracts, the disruptive technologies, the picayune scandals and the many, many people who make federal IT function. Here's a look back at six of the most significant stories.

  • Shutterstock image.

    A 'minibus' appropriations package could be in the cards

    A short-term funding bill is expected by Sept. 30 to keep the federal government operating through early December, but after that the options get more complicated.

  • Defense Secretary Ash Carter speaks at the TechCrunch Disrupt conference in San Francisco

    DOD launches new tech hub in Austin

    The DOD is opening a new Defense Innovation Unit Experimental office in Austin, Texas, while Congress debates legislation that could defund DIUx.

Reader comments

Thu, Oct 31, 2013

A lot of this data is pure garbage and causes useless cargo examinations that produce nothing 99% of the time and only hamper efforts by personnel...

Thu, Oct 31, 2013

All the data in the world (which Big Data people not only lack but are unable to fully and quickly process what they do have) is useless to provide any sort of defense if you do not have a physical presence to identify, intercept, and stop the threat. So if Big Data is the first line of defense then we obviously have a poor line of defense and will continue to do so with that attitude running the show.

Please post your comments here. Comments are moderated, so they may not appear immediately after submitting. We will not post comments that we consider abusive or off-topic.

Please type the letters/numbers you see above

More from 1105 Public Sector Media Group