Can battlefield drones spot threats to troops?

Army Lt. Col. Philip Root, the acting deputy director for DARPA’s Tactical Technology Office, explains how the DOD plans to operationalize autonomous systems, forever changing the human-machine relationship.

Screenshot of U.S. Army “microdrone” commercial published 21 November 2016 on YouTube. (Screenshot courtesy of the U.S. Army)

The Defense Department is rapidly and unabashedly bringing integrating artificial intelligence into its ecosystem -- from back-office functions to the battlefield. But with increased public scrutiny over human interactions with AI-enhanced machines, tactical projects have an extra load to bear.

Enter URSA, the Urban Reconnaissance through Supervised Autonomy project, a program that has become notorious for weaving legal, moral, and ethical concerns into its foundation. It aims to use sensors, AI and drones to distinguish between threats and noncombatants.

URSA is working four companies during the first phase: Draper Laboratory, Scientific Systems Co., SRI International, and Soar Technology. Contracts were awarded in December and January for a combined $22.6 million, according to the broad agency announcement.

FCW talked with Army Lt. Col. Philip Root, the acting deputy director for the Defense Advanced Research Projects Agency’s Tactical Technology Office, to get an update on how DOD plans to operationalize autonomy and forge relationships between humans and machines.

This interview was edited and condensed for clarity.

FCW: So what’s the URSA pitch?

Root: URSA, which just started Phase 1 this year with four performers, takes a different look at the vexing problem of discriminating hostile and non-hostile [individuals] in urban operations. We want to provide more awareness so when a soldier or Marine encounters an individual … they have more information about that individual's intentions as he comes into view. It may seem crazy to aspire to have that level of discrimination, but at traffic control points we do the same thing.

For example, with a van speeding toward a traffic control point at 55 mph, soldiers have 15 seconds from the time they see that van to the time it could explode. So in 15 seconds, a soldier has to identify whether that’s a van full of explosives or a van full of kids.

FCW: How do you even do that?

Root: It’s amazing, right? So from the outside, it's the same. We have to get inside the driver’s head to understand intent. We do that by putting signs out, a stop sign. If they speed by the stop sign, that’s information. So we’re putting out a sign, a probe, to tell the target, someone we’re watching, to stop. And then we give them another sign -- send out a flare or fire warning shots depending on rules of engagement -- to insert a message. And how they respond is more information.

A van full of kids that blows through that stop sign doesn’t mean they are a target. If they blow by several, it doesn’t mean they are a target. But at some point we say, "You’ve failed a number of tests here."

You can look at URSA as finding targets, but I don’t like that view. I prefer the view of ensuring that noncombatants can get out of this scene, a van full of soccer kids turns around. Fantastic! We don’t want you around; we want to give you awareness that this isn’t a good day to be outside.

So as a military patrol is moving through a city, we’d love to let everyone know in advance. But they can’t all just leave. We have to operate with non-combatants around and provide them every opportunity to remove themselves from the environment. Anyone left would then have hostile intent.

We might send a message via drone for instance, and say today is not a good day to be outside. We recommend you go to the nearest building.

FCW: So a drone just comes down and starts talking?

Root: Could be. We just started, so I don’t presume to know. It could come down and say, "U.S. forces are approaching. Not a good day to be outside." Anyone who stays outside might have a really good reason to be outside; it doesn’t mean they’re hostile in any way.

Could be they didn’t hear us, are deaf, it’s noisy out -- so we have to seek a different method. Maybe we put a laser on the ground to confirm they’re seeing it. Perhaps we play a popping sound and combatants and non-combatants respond differently. But at no point is the autonomy doing this on its own.

We just want to collect as much information so if someone with non-hostile intent wanders into a U.S. patrol, we can provide a folder of information before a soldier takes their finger out of the trigger well. Nobody wants to be in the situation where a soldier and a non-combatant come in contact and both are surprised.

FCW: There’s such a personal and emotional component to this. Do you have a suite of people working on this -- psychologists, behaviorists?

Root: We have a team of behavioral psychologists and social science models of how people respond. But, unfortunately, there’s not a whole lot of data into these types of drone interactions. Nobody’s tried this. We’re going to watch social science develop at the same time as the AI and machine learning. And I’m not convinced that it’s going to work. But I’m convinced someone should be trying so we can take these lessons learned and apply it to whatever comes next.

We have to be committed to this problem. We can’t shirk away from it, because the outcome is far more perilous with the current problem -- where soldiers and non-combatants are put in harm’s way.

One lesson that we’ve learned is that under a real interrogation, suspects that are angry are often those that are innocent because they’re so mad they’re caught up in this. To your point, if someone is having a bad day and a drone gets in their face, they might throw a rock at it. We have to understand and factor that in. It might mean that we’re terrorizing the population. We could absolutely make the situation worse; we’re very sensitive about it.

FCW: Have you started designing it? I’m thinking that would also have an impact on how people interact with the technology.

Root: If you’ve ever had a drone buzzing in your face, I’m not sure there’s a way to react other than with anger. All of that’s real. A ground robot that crawls up to you, into your personal space is not going to elicit a positive response. But at some point, that is appropriate to let people know we’re serious. There’s a spectrum of probing and solicitations, but we have to start with some suspicion and shouldn’t terrorize people who are not suspicious.

We’ve started the legal, moral, ethical considerations before we even awarded the contracts so we could get ahead of this. A panel of lawyers, ethicists, philosophers and academics meets quarterly to provide written technical guidance.

Harm has many forms. Clearly, warning shots have a greater potential for harm than just a message. Hopefully, warning shots are never necessary, but we have to understand this spectrum of the possibility of harm. It’s never been done -- only theorized. We have to reduce that theory to practice. Because the performers just want a number. When we design AI, it’s just math.

Is it going to be right? Absolutely not, but it’ll be better than the nothing we have now.

FCW: And then there are the cultural differences between allies and subjects that also have to be considered.

Root: Absolutely.

FCW: So what are the milestones for URSA in the next 18 months?

Root: The first phase is 18 months, so at the end we’ll have a demonstration from each of the performers on their approaches and have a down select into Phase 2 to about two performers.

We expect experiments from each in the meantime, of whatever they have ready, in simulation, augmented reality and field experimentation, culminating with real social science experiments with robotics.

NEXT STORY: Your agency isn’t ready for AI

X
This website uses cookies to enhance user experience and to analyze performance and traffic on our website. We also share information about your use of our site with our social media, advertising and analytics partners. Learn More / Do Not Sell My Personal Information
Accept Cookies
X
Cookie Preferences Cookie List

Do Not Sell My Personal Information

When you visit our website, we store cookies on your browser to collect information. The information collected might relate to you, your preferences or your device, and is mostly used to make the site work as you expect it to and to provide a more personalized web experience. However, you can choose not to allow certain types of cookies, which may impact your experience of the site and the services we are able to offer. Click on the different category headings to find out more and change our default settings according to your preference. You cannot opt-out of our First Party Strictly Necessary Cookies as they are deployed in order to ensure the proper functioning of our website (such as prompting the cookie banner and remembering your settings, to log into your account, to redirect you when you log out, etc.). For more information about the First and Third Party Cookies used please follow this link.

Allow All Cookies

Manage Consent Preferences

Strictly Necessary Cookies - Always Active

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data, Targeting & Social Media Cookies

Under the California Consumer Privacy Act, you have the right to opt-out of the sale of your personal information to third parties. These cookies collect information for analytics and to personalize your experience with targeted ads. You may exercise your right to opt out of the sale of personal information by using this toggle switch. If you opt out we will not be able to offer you personalised ads and will not hand over your personal information to any third parties. Additionally, you may contact our legal department for further clarification about your rights as a California consumer by using this Exercise My Rights link

If you have enabled privacy controls on your browser (such as a plugin), we have to take that as a valid request to opt-out. Therefore we would not be able to track your activity through the web. This may affect our ability to personalize ads according to your preferences.

Targeting cookies may be set through our site by our advertising partners. They may be used by those companies to build a profile of your interests and show you relevant adverts on other sites. They do not store directly personal information, but are based on uniquely identifying your browser and internet device. If you do not allow these cookies, you will experience less targeted advertising.

Social media cookies are set by a range of social media services that we have added to the site to enable you to share our content with your friends and networks. They are capable of tracking your browser across other sites and building up a profile of your interests. This may impact the content and messages you see on other websites you visit. If you do not allow these cookies you may not be able to use or see these sharing tools.

If you want to opt out of all of our lead reports and lists, please submit a privacy request at our Do Not Sell page.

Save Settings
Cookie Preferences Cookie List

Cookie List

A cookie is a small piece of data (text file) that a website – when visited by a user – asks your browser to store on your device in order to remember information about you, such as your language preference or login information. Those cookies are set by us and called first-party cookies. We also use third-party cookies – which are cookies from a domain different than the domain of the website you are visiting – for our advertising and marketing efforts. More specifically, we use cookies and other tracking technologies for the following purposes:

Strictly Necessary Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Functional Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Performance Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Social Media Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Targeting Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.