[Script Info]
Title: 
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:00.69,0:00:03.85,Default,,0000,0000,0000,,I write fiction sci-fi thrillers,
Dialogue: 0,0:00:03.85,0:00:06.04,Default,,0000,0000,0000,,so if I say "killer robots,"
Dialogue: 0,0:00:06.04,0:00:08.40,Default,,0000,0000,0000,,you'd probably think something like this.
Dialogue: 0,0:00:08.40,0:00:10.96,Default,,0000,0000,0000,,But I'm actually not here to talk about fiction.
Dialogue: 0,0:00:10.96,0:00:13.91,Default,,0000,0000,0000,,I'm here to talk about very real killer robots,
Dialogue: 0,0:00:13.91,0:00:17.03,Default,,0000,0000,0000,,autonomous combat drones.
Dialogue: 0,0:00:17.03,0:00:20.66,Default,,0000,0000,0000,,Now, I'm not referring to Predator and Reaper drones,
Dialogue: 0,0:00:20.66,0:00:23.92,Default,,0000,0000,0000,,which have a human making targeting decisions.
Dialogue: 0,0:00:23.92,0:00:27.04,Default,,0000,0000,0000,,I'm talking about fully autonomous robotic weapons
Dialogue: 0,0:00:27.04,0:00:29.70,Default,,0000,0000,0000,,that make lethal decisions about human beings
Dialogue: 0,0:00:29.70,0:00:32.12,Default,,0000,0000,0000,,all on their own.
Dialogue: 0,0:00:32.12,0:00:36.12,Default,,0000,0000,0000,,There's actually a technical term for this: lethal autonomy.
Dialogue: 0,0:00:36.12,0:00:38.97,Default,,0000,0000,0000,,Now, lethally autonomous killer robots
Dialogue: 0,0:00:38.97,0:00:42.04,Default,,0000,0000,0000,,would take many forms -- flying, driving,
Dialogue: 0,0:00:42.04,0:00:44.79,Default,,0000,0000,0000,,or just lying in wait.
Dialogue: 0,0:00:44.79,0:00:47.90,Default,,0000,0000,0000,,And actually, they're very quickly becoming a reality.
Dialogue: 0,0:00:47.90,0:00:50.38,Default,,0000,0000,0000,,These are two automatic sniper stations
Dialogue: 0,0:00:50.38,0:00:54.52,Default,,0000,0000,0000,,currently deployed in the DMZ between North and South Korea.
Dialogue: 0,0:00:54.52,0:00:56.69,Default,,0000,0000,0000,,Both of these machines are capable of automatically
Dialogue: 0,0:00:56.69,0:01:00.21,Default,,0000,0000,0000,,identifying a human target and firing on it,
Dialogue: 0,0:01:00.21,0:01:04.54,Default,,0000,0000,0000,,the one on the left at a distance of over a kilometer.
Dialogue: 0,0:01:04.54,0:01:08.12,Default,,0000,0000,0000,,Now, in both cases, there's still a human in the loop
Dialogue: 0,0:01:08.12,0:01:10.50,Default,,0000,0000,0000,,to make that lethal firing decision,
Dialogue: 0,0:01:10.50,0:01:15.91,Default,,0000,0000,0000,,but it's not a technological requirement. It's a choice.
Dialogue: 0,0:01:15.91,0:01:19.00,Default,,0000,0000,0000,,And it's that choice that I want to focus on,
Dialogue: 0,0:01:19.00,0:01:21.64,Default,,0000,0000,0000,,because as we migrate lethal decision-making
Dialogue: 0,0:01:21.64,0:01:24.75,Default,,0000,0000,0000,,from humans to software,
Dialogue: 0,0:01:24.75,0:01:28.23,Default,,0000,0000,0000,,we risk not only taking the humanity out of war,
Dialogue: 0,0:01:28.23,0:01:31.75,Default,,0000,0000,0000,,but also changing our social landscape entirely,
Dialogue: 0,0:01:31.75,0:01:33.98,Default,,0000,0000,0000,,far from the battlefield.
Dialogue: 0,0:01:33.98,0:01:38.49,Default,,0000,0000,0000,,That's because the way humans resolve conflict
Dialogue: 0,0:01:38.49,0:01:40.22,Default,,0000,0000,0000,,shapes our social landscape.
Dialogue: 0,0:01:40.22,0:01:42.85,Default,,0000,0000,0000,,And this has always been the case, throughout history.
Dialogue: 0,0:01:42.85,0:01:45.51,Default,,0000,0000,0000,,For example, these were state-of-the-art weapons systems
Dialogue: 0,0:01:45.51,0:01:47.59,Default,,0000,0000,0000,,in 1400 A.D.
Dialogue: 0,0:01:47.59,0:01:50.74,Default,,0000,0000,0000,,Now they were both very expensive to build and maintain,
Dialogue: 0,0:01:50.74,0:01:53.98,Default,,0000,0000,0000,,but with these you could dominate the populace,
Dialogue: 0,0:01:53.98,0:01:57.87,Default,,0000,0000,0000,,and the distribution of political power in feudal society reflected that.
Dialogue: 0,0:01:57.87,0:02:00.55,Default,,0000,0000,0000,,Power was focused at the very top.
Dialogue: 0,0:02:00.55,0:02:04.08,Default,,0000,0000,0000,,And what changed? Technological innovation.
Dialogue: 0,0:02:04.08,0:02:05.95,Default,,0000,0000,0000,,Gunpowder, cannon.
Dialogue: 0,0:02:05.95,0:02:09.77,Default,,0000,0000,0000,,And pretty soon, armor and castles were obsolete,
Dialogue: 0,0:02:09.77,0:02:12.30,Default,,0000,0000,0000,,and it mattered less who you brought to the battlefield
Dialogue: 0,0:02:12.30,0:02:16.08,Default,,0000,0000,0000,,versus how many people you brought to the battlefield.
Dialogue: 0,0:02:16.08,0:02:19.72,Default,,0000,0000,0000,,And as armies grew in size, the nation-state arose
Dialogue: 0,0:02:19.72,0:02:23.40,Default,,0000,0000,0000,,as a political and logistical requirement of defense.
Dialogue: 0,0:02:23.40,0:02:25.78,Default,,0000,0000,0000,,And as leaders had to rely on more of their populace,
Dialogue: 0,0:02:25.78,0:02:27.61,Default,,0000,0000,0000,,they began to share power.
Dialogue: 0,0:02:27.61,0:02:30.21,Default,,0000,0000,0000,,Representative government began to form.
Dialogue: 0,0:02:30.21,0:02:33.50,Default,,0000,0000,0000,,So again, the tools we use to resolve conflict
Dialogue: 0,0:02:33.50,0:02:36.80,Default,,0000,0000,0000,,shape our social landscape.
Dialogue: 0,0:02:36.80,0:02:40.86,Default,,0000,0000,0000,,Autonomous robotic weapons are such a tool,
Dialogue: 0,0:02:40.86,0:02:46.03,Default,,0000,0000,0000,,except that, by requiring very few people to go to war,
Dialogue: 0,0:02:46.03,0:02:50.87,Default,,0000,0000,0000,,they risk re-centralizing power into very few hands,
Dialogue: 0,0:02:50.87,0:02:57.39,Default,,0000,0000,0000,,possibly reversing a five-century trend toward democracy.
Dialogue: 0,0:02:57.39,0:02:59.14,Default,,0000,0000,0000,,Now, I think, knowing this,
Dialogue: 0,0:02:59.14,0:03:03.50,Default,,0000,0000,0000,,we can take decisive steps to preserve our democratic institutions,
Dialogue: 0,0:03:03.50,0:03:07.47,Default,,0000,0000,0000,,to do what humans do best, which is adapt.
Dialogue: 0,0:03:07.47,0:03:09.48,Default,,0000,0000,0000,,But time is a factor.
Dialogue: 0,0:03:09.48,0:03:12.33,Default,,0000,0000,0000,,Seventy nations are developing remotely-piloted
Dialogue: 0,0:03:12.33,0:03:14.49,Default,,0000,0000,0000,,combat drones of their own,
Dialogue: 0,0:03:14.49,0:03:17.08,Default,,0000,0000,0000,,and as you'll see, remotely-piloted combat drones
Dialogue: 0,0:03:17.08,0:03:21.55,Default,,0000,0000,0000,,are the precursors to autonomous robotic weapons.
Dialogue: 0,0:03:21.55,0:03:24.32,Default,,0000,0000,0000,,That's because once you've deployed remotely-piloted drones,
Dialogue: 0,0:03:24.32,0:03:27.70,Default,,0000,0000,0000,,there are three powerful factors pushing decision-making
Dialogue: 0,0:03:27.70,0:03:32.30,Default,,0000,0000,0000,,away from humans and on to the weapon platform itself.
Dialogue: 0,0:03:32.30,0:03:37.56,Default,,0000,0000,0000,,The first of these is the deluge of video that drones produce.
Dialogue: 0,0:03:37.56,0:03:41.42,Default,,0000,0000,0000,,For example, in 2004, the U.S. drone fleet produced
Dialogue: 0,0:03:41.42,0:03:46.73,Default,,0000,0000,0000,,a grand total of 71 hours of video surveillance for analysis.
Dialogue: 0,0:03:46.73,0:03:51.23,Default,,0000,0000,0000,,By 2011, this had gone up to 300,000 hours,
Dialogue: 0,0:03:51.23,0:03:54.38,Default,,0000,0000,0000,,outstripping human ability to review it all,
Dialogue: 0,0:03:54.38,0:03:58.04,Default,,0000,0000,0000,,but even that number is about to go up drastically.
Dialogue: 0,0:03:58.04,0:04:00.61,Default,,0000,0000,0000,,The Pentagon's Gorgon Stare and Argus programs
Dialogue: 0,0:04:00.61,0:04:03.78,Default,,0000,0000,0000,,will put up to 65 independently operated camera eyes
Dialogue: 0,0:04:03.78,0:04:05.82,Default,,0000,0000,0000,,on each drone platform,
Dialogue: 0,0:04:05.82,0:04:09.12,Default,,0000,0000,0000,,and this would vastly outstrip human ability to review it.
Dialogue: 0,0:04:09.12,0:04:11.28,Default,,0000,0000,0000,,And that means visual intelligence software will need
Dialogue: 0,0:04:11.28,0:04:15.33,Default,,0000,0000,0000,,to scan it for items of interest.
Dialogue: 0,0:04:15.33,0:04:16.68,Default,,0000,0000,0000,,And that means very soon
Dialogue: 0,0:04:16.68,0:04:19.42,Default,,0000,0000,0000,,drones will tell humans what to look at,
Dialogue: 0,0:04:19.42,0:04:21.92,Default,,0000,0000,0000,,not the other way around.
Dialogue: 0,0:04:21.92,0:04:24.39,Default,,0000,0000,0000,,But there's a second powerful incentive pushing
Dialogue: 0,0:04:24.39,0:04:27.78,Default,,0000,0000,0000,,decision-making away from humans and onto machines,
Dialogue: 0,0:04:27.78,0:04:30.65,Default,,0000,0000,0000,,and that's electromagnetic jamming,
Dialogue: 0,0:04:30.65,0:04:32.88,Default,,0000,0000,0000,,severing the connection between the drone
Dialogue: 0,0:04:32.88,0:04:35.70,Default,,0000,0000,0000,,and its operator.
Dialogue: 0,0:04:35.70,0:04:38.32,Default,,0000,0000,0000,,Now we saw an example of this in 2011
Dialogue: 0,0:04:38.32,0:04:41.27,Default,,0000,0000,0000,,when an American RQ-170 Sentinel drone
Dialogue: 0,0:04:41.27,0:04:45.58,Default,,0000,0000,0000,,got a bit confused over Iran due to a GPS spoofing attack,
Dialogue: 0,0:04:45.58,0:04:50.69,Default,,0000,0000,0000,,but any remotely-piloted drone is susceptible to this type of attack,
Dialogue: 0,0:04:50.69,0:04:52.74,Default,,0000,0000,0000,,and that means drones
Dialogue: 0,0:04:52.74,0:04:56.36,Default,,0000,0000,0000,,will have to shoulder more decision-making.
Dialogue: 0,0:04:56.36,0:04:59.41,Default,,0000,0000,0000,,They'll know their mission objective,
Dialogue: 0,0:04:59.41,0:05:04.25,Default,,0000,0000,0000,,and they'll react to new circumstances without human guidance.
Dialogue: 0,0:05:04.25,0:05:06.83,Default,,0000,0000,0000,,They'll ignore external radio signals
Dialogue: 0,0:05:06.83,0:05:09.16,Default,,0000,0000,0000,,and send very few of their own.
Dialogue: 0,0:05:09.16,0:05:11.17,Default,,0000,0000,0000,,Which brings us to, really, the third
Dialogue: 0,0:05:11.17,0:05:15.03,Default,,0000,0000,0000,,and most powerful incentive pushing decision-making
Dialogue: 0,0:05:15.03,0:05:18.37,Default,,0000,0000,0000,,away from humans and onto weapons:
Dialogue: 0,0:05:18.37,0:05:21.67,Default,,0000,0000,0000,,plausible deniability.
Dialogue: 0,0:05:21.67,0:05:24.55,Default,,0000,0000,0000,,Now we live in a global economy.
Dialogue: 0,0:05:24.55,0:05:28.89,Default,,0000,0000,0000,,High-tech manufacturing is occurring on most continents.
Dialogue: 0,0:05:28.89,0:05:31.80,Default,,0000,0000,0000,,Cyber espionage is spiriting away advanced designs
Dialogue: 0,0:05:31.80,0:05:33.69,Default,,0000,0000,0000,,to parts unknown,
Dialogue: 0,0:05:33.69,0:05:35.70,Default,,0000,0000,0000,,and in that environment, it is very likely
Dialogue: 0,0:05:35.70,0:05:40.44,Default,,0000,0000,0000,,that a successful drone design will be knocked off in contract factories,
Dialogue: 0,0:05:40.44,0:05:42.60,Default,,0000,0000,0000,,proliferate in the gray market.
Dialogue: 0,0:05:42.60,0:05:45.06,Default,,0000,0000,0000,,And in that situation, sifting through the wreckage
Dialogue: 0,0:05:45.06,0:05:48.02,Default,,0000,0000,0000,,of a suicide drone attack, it will be very difficult to say
Dialogue: 0,0:05:48.02,0:05:52.42,Default,,0000,0000,0000,,who sent that weapon.
Dialogue: 0,0:05:52.42,0:05:55.22,Default,,0000,0000,0000,,This raises the very real possibility
Dialogue: 0,0:05:55.22,0:05:58.16,Default,,0000,0000,0000,,of anonymous war.
Dialogue: 0,0:05:58.16,0:06:00.77,Default,,0000,0000,0000,,This could tilt the geopolitical balance on its head,
Dialogue: 0,0:06:00.77,0:06:04.26,Default,,0000,0000,0000,,make it very difficult for a nation to turn its firepower
Dialogue: 0,0:06:04.26,0:06:07.11,Default,,0000,0000,0000,,against an attacker, and that could shift the balance
Dialogue: 0,0:06:07.11,0:06:10.88,Default,,0000,0000,0000,,in the 21st century away from defense and toward offense.
Dialogue: 0,0:06:10.88,0:06:14.00,Default,,0000,0000,0000,,It could make military action a viable option
Dialogue: 0,0:06:14.00,0:06:16.29,Default,,0000,0000,0000,,not just for small nations,
Dialogue: 0,0:06:16.29,0:06:18.83,Default,,0000,0000,0000,,but criminal organizations, private enterprise,
Dialogue: 0,0:06:18.83,0:06:21.31,Default,,0000,0000,0000,,even powerful individuals.
Dialogue: 0,0:06:21.31,0:06:24.64,Default,,0000,0000,0000,,It could create a landscape of rival warlords
Dialogue: 0,0:06:24.64,0:06:28.32,Default,,0000,0000,0000,,undermining rule of law and civil society.
Dialogue: 0,0:06:28.32,0:06:31.94,Default,,0000,0000,0000,,Now if responsibility and transparency
Dialogue: 0,0:06:31.94,0:06:34.32,Default,,0000,0000,0000,,are two of the cornerstones of representative government,
Dialogue: 0,0:06:34.32,0:06:38.64,Default,,0000,0000,0000,,autonomous robotic weapons could undermine both.
Dialogue: 0,0:06:38.64,0:06:40.19,Default,,0000,0000,0000,,Now you might be thinking that
Dialogue: 0,0:06:40.19,0:06:42.43,Default,,0000,0000,0000,,citizens of high-tech nations
Dialogue: 0,0:06:42.43,0:06:45.14,Default,,0000,0000,0000,,would have the advantage in any robotic war,
Dialogue: 0,0:06:45.14,0:06:48.77,Default,,0000,0000,0000,,that citizens of those nations would be less vulnerable,
Dialogue: 0,0:06:48.77,0:06:53.06,Default,,0000,0000,0000,,particularly against developing nations.
Dialogue: 0,0:06:53.06,0:06:56.58,Default,,0000,0000,0000,,But I think the truth is the exact opposite.
Dialogue: 0,0:06:56.58,0:06:58.83,Default,,0000,0000,0000,,I think citizens of high-tech societies
Dialogue: 0,0:06:58.83,0:07:02.56,Default,,0000,0000,0000,,are more vulnerable to robotic weapons,
Dialogue: 0,0:07:02.56,0:07:07.03,Default,,0000,0000,0000,,and the reason can be summed up in one word: data.
Dialogue: 0,0:07:07.03,0:07:10.51,Default,,0000,0000,0000,,Data powers high-tech societies.
Dialogue: 0,0:07:10.51,0:07:13.70,Default,,0000,0000,0000,,Cell phone geolocation, telecom metadata,
Dialogue: 0,0:07:13.70,0:07:17.17,Default,,0000,0000,0000,,social media, email, text, financial transaction data,
Dialogue: 0,0:07:17.17,0:07:20.70,Default,,0000,0000,0000,,transportation data, it's a wealth of real-time data
Dialogue: 0,0:07:20.70,0:07:24.07,Default,,0000,0000,0000,,on the movements and social interactions of people.
Dialogue: 0,0:07:24.07,0:07:27.85,Default,,0000,0000,0000,,In short, we are more visible to machines
Dialogue: 0,0:07:27.85,0:07:30.09,Default,,0000,0000,0000,,than any people in history,
Dialogue: 0,0:07:30.09,0:07:35.71,Default,,0000,0000,0000,,and this perfectly suits the targeting needs of autonomous weapons.
Dialogue: 0,0:07:35.71,0:07:37.44,Default,,0000,0000,0000,,What you're looking at here
Dialogue: 0,0:07:37.44,0:07:40.69,Default,,0000,0000,0000,,is a link analysis map of a social group.
Dialogue: 0,0:07:40.69,0:07:44.32,Default,,0000,0000,0000,,Lines indicate social connectedness between individuals.
Dialogue: 0,0:07:44.32,0:07:47.20,Default,,0000,0000,0000,,And these types of maps can be automatically generated
Dialogue: 0,0:07:47.20,0:07:51.92,Default,,0000,0000,0000,,based on the data trail modern people leave behind.
Dialogue: 0,0:07:51.92,0:07:54.40,Default,,0000,0000,0000,,Now it's typically used to market goods and services
Dialogue: 0,0:07:54.40,0:07:58.81,Default,,0000,0000,0000,,to targeted demographics, but it's a dual-use technology,
Dialogue: 0,0:07:58.81,0:08:02.17,Default,,0000,0000,0000,,because targeting is used in another context.
Dialogue: 0,0:08:02.17,0:08:04.73,Default,,0000,0000,0000,,Notice that certain individuals are highlighted.
Dialogue: 0,0:08:04.73,0:08:08.01,Default,,0000,0000,0000,,These are the hubs of social networks.
Dialogue: 0,0:08:08.01,0:08:11.60,Default,,0000,0000,0000,,These are organizers, opinion-makers, leaders,
Dialogue: 0,0:08:11.60,0:08:14.28,Default,,0000,0000,0000,,and these people also can be automatically identified
Dialogue: 0,0:08:14.28,0:08:16.67,Default,,0000,0000,0000,,from their communication patterns.
Dialogue: 0,0:08:16.67,0:08:18.81,Default,,0000,0000,0000,,Now, if you're a marketer, you might then target them
Dialogue: 0,0:08:18.81,0:08:21.36,Default,,0000,0000,0000,,with product samples, try to spread your brand
Dialogue: 0,0:08:21.36,0:08:24.18,Default,,0000,0000,0000,,through their social group.
Dialogue: 0,0:08:24.18,0:08:26.14,Default,,0000,0000,0000,,But if you're a repressive government
Dialogue: 0,0:08:26.14,0:08:30.95,Default,,0000,0000,0000,,searching for political enemies, you might instead remove them,
Dialogue: 0,0:08:30.95,0:08:33.71,Default,,0000,0000,0000,,eliminate them, disrupt their social group,
Dialogue: 0,0:08:33.71,0:08:36.88,Default,,0000,0000,0000,,and those who remain behind lose social cohesion
Dialogue: 0,0:08:36.88,0:08:39.50,Default,,0000,0000,0000,,and organization.
Dialogue: 0,0:08:39.50,0:08:42.82,Default,,0000,0000,0000,,Now in a world of cheap, proliferating robotic weapons,
Dialogue: 0,0:08:42.82,0:08:45.46,Default,,0000,0000,0000,,borders would offer very little protection
Dialogue: 0,0:08:45.46,0:08:47.40,Default,,0000,0000,0000,,to critics of distant governments
Dialogue: 0,0:08:47.40,0:08:51.05,Default,,0000,0000,0000,,or trans-national criminal organizations.
Dialogue: 0,0:08:51.05,0:08:54.54,Default,,0000,0000,0000,,Popular movements agitating for change
Dialogue: 0,0:08:54.54,0:08:58.15,Default,,0000,0000,0000,,could be detected early and their leaders eliminated
Dialogue: 0,0:08:58.15,0:09:01.06,Default,,0000,0000,0000,,before their ideas achieve critical mass.
Dialogue: 0,0:09:01.06,0:09:03.65,Default,,0000,0000,0000,,And ideas achieving critical mass
Dialogue: 0,0:09:03.65,0:09:07.59,Default,,0000,0000,0000,,is what political activism in popular government is all about.
Dialogue: 0,0:09:07.59,0:09:11.59,Default,,0000,0000,0000,,Anonymous lethal weapons could make lethal action
Dialogue: 0,0:09:11.59,0:09:15.37,Default,,0000,0000,0000,,an easy choice for all sorts of competing interests.
Dialogue: 0,0:09:15.37,0:09:19.10,Default,,0000,0000,0000,,And this would put a chill on free speech
Dialogue: 0,0:09:19.10,0:09:24.41,Default,,0000,0000,0000,,and popular political action, the very heart of democracy.
Dialogue: 0,0:09:24.41,0:09:27.32,Default,,0000,0000,0000,,And this is why we need an international treaty
Dialogue: 0,0:09:27.32,0:09:30.86,Default,,0000,0000,0000,,on robotic weapons, and in particular a global ban
Dialogue: 0,0:09:30.86,0:09:34.77,Default,,0000,0000,0000,,on the development and deployment of killer robots.
Dialogue: 0,0:09:34.77,0:09:38.03,Default,,0000,0000,0000,,Now we already have international treaties
Dialogue: 0,0:09:38.03,0:09:41.41,Default,,0000,0000,0000,,on nuclear and biological weapons, and, while imperfect,
Dialogue: 0,0:09:41.41,0:09:43.70,Default,,0000,0000,0000,,these have largely worked.
Dialogue: 0,0:09:43.70,0:09:47.47,Default,,0000,0000,0000,,But robotic weapons might be every bit as dangerous,
Dialogue: 0,0:09:47.47,0:09:50.76,Default,,0000,0000,0000,,because they will almost certainly be used,
Dialogue: 0,0:09:50.76,0:09:55.78,Default,,0000,0000,0000,,and they would also be corrosive to our democratic institutions.
Dialogue: 0,0:09:55.78,0:09:59.25,Default,,0000,0000,0000,,Now in November 2012 the U.S. Department of Defense
Dialogue: 0,0:09:59.25,0:10:01.71,Default,,0000,0000,0000,,issued a directive requiring
Dialogue: 0,0:10:01.71,0:10:06.23,Default,,0000,0000,0000,,a human being be present in all lethal decisions.
Dialogue: 0,0:10:06.23,0:10:11.00,Default,,0000,0000,0000,,This temporarily effectively banned autonomous weapons in the U.S. military,
Dialogue: 0,0:10:11.00,0:10:14.76,Default,,0000,0000,0000,,but that directive needs to be made permanent.
Dialogue: 0,0:10:14.76,0:10:19.13,Default,,0000,0000,0000,,And it could set the stage for global action.
Dialogue: 0,0:10:19.13,0:10:22.98,Default,,0000,0000,0000,,Because we need an international legal framework
Dialogue: 0,0:10:22.98,0:10:25.12,Default,,0000,0000,0000,,for robotic weapons.
Dialogue: 0,0:10:25.12,0:10:28.04,Default,,0000,0000,0000,,And we need it now, before there's a devastating attack
Dialogue: 0,0:10:28.04,0:10:31.20,Default,,0000,0000,0000,,or a terrorist incident that causes nations of the world
Dialogue: 0,0:10:31.20,0:10:33.12,Default,,0000,0000,0000,,to rush to adopt these weapons
Dialogue: 0,0:10:33.12,0:10:36.89,Default,,0000,0000,0000,,before thinking through the consequences.
Dialogue: 0,0:10:36.89,0:10:39.87,Default,,0000,0000,0000,,Autonomous robotic weapons concentrate too much power
Dialogue: 0,0:10:39.87,0:10:46.16,Default,,0000,0000,0000,,in too few hands, and they would imperil democracy itself.
Dialogue: 0,0:10:46.16,0:10:48.84,Default,,0000,0000,0000,,Now, don't get me wrong, I think there are tons
Dialogue: 0,0:10:48.84,0:10:51.46,Default,,0000,0000,0000,,of great uses for unarmed civilian drones:
Dialogue: 0,0:10:51.46,0:10:55.40,Default,,0000,0000,0000,,environmental monitoring, search and rescue, logistics.
Dialogue: 0,0:10:55.40,0:10:58.22,Default,,0000,0000,0000,,If we have an international treaty on robotic weapons,
Dialogue: 0,0:10:58.22,0:11:01.81,Default,,0000,0000,0000,,how do we gain the benefits of autonomous drones
Dialogue: 0,0:11:01.81,0:11:04.46,Default,,0000,0000,0000,,and vehicles while still protecting ourselves
Dialogue: 0,0:11:04.46,0:11:08.44,Default,,0000,0000,0000,,against illegal robotic weapons?
Dialogue: 0,0:11:08.44,0:11:13.18,Default,,0000,0000,0000,,I think the secret will be transparency.
Dialogue: 0,0:11:13.18,0:11:16.19,Default,,0000,0000,0000,,No robot should have an expectation of privacy
Dialogue: 0,0:11:16.19,0:11:19.64,Default,,0000,0000,0000,,in a public place.
Dialogue: 0,0:11:19.64,0:11:24.69,Default,,0000,0000,0000,,(Applause)
Dialogue: 0,0:11:24.69,0:11:26.74,Default,,0000,0000,0000,,Each robot and drone should have
Dialogue: 0,0:11:26.74,0:11:29.62,Default,,0000,0000,0000,,a cryptographically signed I.D. burned in at the factory
Dialogue: 0,0:11:29.62,0:11:32.54,Default,,0000,0000,0000,,that can be used to track its movement through public spaces.
Dialogue: 0,0:11:32.54,0:11:35.92,Default,,0000,0000,0000,,We have license plates on cars, tail numbers on aircraft.
Dialogue: 0,0:11:35.92,0:11:37.76,Default,,0000,0000,0000,,This is no different.
Dialogue: 0,0:11:37.76,0:11:39.78,Default,,0000,0000,0000,,And every citizen should be able to download an app
Dialogue: 0,0:11:39.78,0:11:42.90,Default,,0000,0000,0000,,that shows the population of drones and autonomous vehicles
Dialogue: 0,0:11:42.90,0:11:45.33,Default,,0000,0000,0000,,moving through public spaces around them,
Dialogue: 0,0:11:45.33,0:11:48.06,Default,,0000,0000,0000,,both right now and historically.
Dialogue: 0,0:11:48.06,0:11:51.61,Default,,0000,0000,0000,,And civic leaders should deploy sensors and civic drones
Dialogue: 0,0:11:51.61,0:11:53.96,Default,,0000,0000,0000,,to detect rogue drones,
Dialogue: 0,0:11:53.96,0:11:57.13,Default,,0000,0000,0000,,and instead of sending killer drones of their own up to shoot them down,
Dialogue: 0,0:11:57.13,0:12:00.12,Default,,0000,0000,0000,,they should notify humans to their presence.
Dialogue: 0,0:12:00.12,0:12:02.73,Default,,0000,0000,0000,,And in certain very high-security areas,
Dialogue: 0,0:12:02.73,0:12:04.64,Default,,0000,0000,0000,,perhaps civic drones would snare them
Dialogue: 0,0:12:04.64,0:12:07.48,Default,,0000,0000,0000,,and drag them off to a bomb disposal facility.
Dialogue: 0,0:12:07.48,0:12:10.51,Default,,0000,0000,0000,,But notice, this is more an immune system
Dialogue: 0,0:12:10.51,0:12:11.83,Default,,0000,0000,0000,,than a weapons system.
Dialogue: 0,0:12:11.83,0:12:14.42,Default,,0000,0000,0000,,It would allow us to avail ourselves of the use
Dialogue: 0,0:12:14.42,0:12:16.45,Default,,0000,0000,0000,,of autonomous vehicles and drones
Dialogue: 0,0:12:16.45,0:12:20.75,Default,,0000,0000,0000,,while still preserving our open, civil society.
Dialogue: 0,0:12:20.75,0:12:23.75,Default,,0000,0000,0000,,We must ban the deployment and development
Dialogue: 0,0:12:23.75,0:12:25.61,Default,,0000,0000,0000,,of killer robots.
Dialogue: 0,0:12:25.61,0:12:30.46,Default,,0000,0000,0000,,Let's not succumb to the temptation to automate war.
Dialogue: 0,0:12:30.46,0:12:33.18,Default,,0000,0000,0000,,Autocratic governments and criminal organizations
Dialogue: 0,0:12:33.18,0:12:36.13,Default,,0000,0000,0000,,undoubtedly will, but let's not join them.
Dialogue: 0,0:12:36.13,0:12:38.02,Default,,0000,0000,0000,,Autonomous robotic weapons
Dialogue: 0,0:12:38.02,0:12:40.07,Default,,0000,0000,0000,,would concentrate too much power
Dialogue: 0,0:12:40.07,0:12:42.56,Default,,0000,0000,0000,,in too few unseen hands,
Dialogue: 0,0:12:42.56,0:12:45.81,Default,,0000,0000,0000,,and that would be corrosive to representative government.
Dialogue: 0,0:12:45.81,0:12:48.77,Default,,0000,0000,0000,,Let's make sure, for democracies at least,
Dialogue: 0,0:12:48.77,0:12:51.38,Default,,0000,0000,0000,,killer robots remain fiction.
Dialogue: 0,0:12:51.38,0:12:52.49,Default,,0000,0000,0000,,Thank you.
Dialogue: 0,0:12:52.49,0:12:57.05,Default,,0000,0000,0000,,(Applause)
Dialogue: 0,0:12:57.05,0:13:01.67,Default,,0000,0000,0000,,Thank you. (Applause)