[Script Info] Title: [Events] Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text Dialogue: 0,0:00:17.86,0:00:22.51,Default,,0000,0000,0000,,My job is to design, build and study\Nrobots that communicate with people. Dialogue: 0,0:00:22.53,0:00:26.15,Default,,0000,0000,0000,,But this story doesn't start with robotics\Nat all, it starts with animation. Dialogue: 0,0:00:26.17,0:00:28.54,Default,,0000,0000,0000,,When I first saw Pixar's "Luxo Jr.," Dialogue: 0,0:00:29.17,0:00:31.87,Default,,0000,0000,0000,,I was amazed by how much\Nemotion they could put Dialogue: 0,0:00:31.90,0:00:34.72,Default,,0000,0000,0000,,into something as trivial as a desk lamp. Dialogue: 0,0:00:35.38,0:00:37.72,Default,,0000,0000,0000,,I mean, look at them --\Nat the end of this movie, Dialogue: 0,0:00:37.75,0:00:40.53,Default,,0000,0000,0000,,you actually feel something\Nfor two pieces of furniture. Dialogue: 0,0:00:40.55,0:00:42.58,Default,,0000,0000,0000,,And I said, I have\Nto learn how to do this. Dialogue: 0,0:00:42.61,0:00:44.83,Default,,0000,0000,0000,,So I made a really bad career decision. Dialogue: 0,0:00:44.86,0:00:46.05,Default,,0000,0000,0000,,(Laughter) Dialogue: 0,0:00:46.08,0:00:48.27,Default,,0000,0000,0000,,And that's what my mom\Nwas like when I did it. Dialogue: 0,0:00:48.29,0:00:50.43,Default,,0000,0000,0000,,(Laughter) Dialogue: 0,0:00:50.46,0:00:53.88,Default,,0000,0000,0000,,I left a very cozy tech job in Israel\Nat a nice software company Dialogue: 0,0:00:53.90,0:00:56.19,Default,,0000,0000,0000,,and I moved to New York\Nto study animation. Dialogue: 0,0:00:56.22,0:00:57.37,Default,,0000,0000,0000,,And there I lived Dialogue: 0,0:00:57.39,0:01:00.21,Default,,0000,0000,0000,,in a collapsing apartment building\Nin Harlem with roommates. Dialogue: 0,0:01:00.24,0:01:02.26,Default,,0000,0000,0000,,I'm not using this phrase\Nmetaphorically -- Dialogue: 0,0:01:02.28,0:01:05.01,Default,,0000,0000,0000,,the ceiling actually collapsed\None day in our living room. Dialogue: 0,0:01:05.04,0:01:08.28,Default,,0000,0000,0000,,Whenever they did news stories\Nabout building violations in New York, Dialogue: 0,0:01:08.30,0:01:10.72,Default,,0000,0000,0000,,they would put the report\Nin front of our building, Dialogue: 0,0:01:10.72,0:01:13.36,Default,,0000,0000,0000,,as kind of, like, a backdrop\Nto show how bad things are. Dialogue: 0,0:01:13.36,0:01:15.32,Default,,0000,0000,0000,,Anyway, during the day, I went to school Dialogue: 0,0:01:15.32,0:01:18.59,Default,,0000,0000,0000,,and at night I would sit and draw\Nframe by frame of pencil animation. Dialogue: 0,0:01:18.62,0:01:20.80,Default,,0000,0000,0000,,And I learned two surprising lessons. Dialogue: 0,0:01:20.82,0:01:25.31,Default,,0000,0000,0000,,One of them was that\Nwhen you want to arouse emotions, Dialogue: 0,0:01:25.34,0:01:27.51,Default,,0000,0000,0000,,it doesn't matter so much\Nhow something looks; Dialogue: 0,0:01:27.54,0:01:30.74,Default,,0000,0000,0000,,it's all in the motion, in the timing\Nof how the thing moves. Dialogue: 0,0:01:31.12,0:01:34.31,Default,,0000,0000,0000,,And the second was something\None of our teachers told us. Dialogue: 0,0:01:34.33,0:01:36.62,Default,,0000,0000,0000,,He actually did the weasel in "Ice Age." Dialogue: 0,0:01:36.96,0:01:40.82,Default,,0000,0000,0000,,And he said, "As an animator,\Nyou're not a director -- you're an actor." Dialogue: 0,0:01:41.20,0:01:44.22,Default,,0000,0000,0000,,So, if you want to find\Nthe right motion for a character, Dialogue: 0,0:01:44.24,0:01:46.69,Default,,0000,0000,0000,,don't think about it --\Ngo use your body to find it. Dialogue: 0,0:01:46.71,0:01:49.64,Default,,0000,0000,0000,,Stand in front of a mirror,\Nact it out in front of a camera -- Dialogue: 0,0:01:49.67,0:01:52.58,Default,,0000,0000,0000,,whatever you need -- and then\Nput it back in your character. Dialogue: 0,0:01:52.58,0:01:55.49,Default,,0000,0000,0000,,A year later I found myself at MIT\Nin the Robotic Life Group. Dialogue: 0,0:01:55.49,0:01:58.36,Default,,0000,0000,0000,,It was one of the first groups\Nresearching the relationships Dialogue: 0,0:01:58.36,0:01:59.61,Default,,0000,0000,0000,,between humans and robots. Dialogue: 0,0:01:59.61,0:02:03.21,Default,,0000,0000,0000,,And I still had this dream\Nto make an actual, physical Luxo Jr. lamp. Dialogue: 0,0:02:03.23,0:02:06.22,Default,,0000,0000,0000,,But I found that robots didn't move\Nat all in this engaging way Dialogue: 0,0:02:06.25,0:02:08.42,Default,,0000,0000,0000,,that I was used to\Nfrom my animation studies. Dialogue: 0,0:02:08.45,0:02:10.91,Default,,0000,0000,0000,,Instead, they were all --\Nhow should I put it -- Dialogue: 0,0:02:10.94,0:02:12.39,Default,,0000,0000,0000,,they were all kind of robotic. Dialogue: 0,0:02:12.41,0:02:13.60,Default,,0000,0000,0000,,(Laughter) Dialogue: 0,0:02:13.61,0:02:17.35,Default,,0000,0000,0000,,And I thought, what if I took\Nwhatever I learned in animation school, Dialogue: 0,0:02:17.37,0:02:19.97,Default,,0000,0000,0000,,and used that to design\Nmy robotic desk lamp. Dialogue: 0,0:02:19.100,0:02:22.04,Default,,0000,0000,0000,,So I went and designed frame by frame Dialogue: 0,0:02:22.07,0:02:26.03,Default,,0000,0000,0000,,to try to make this robot as graceful\Nand engaging as possible. Dialogue: 0,0:02:26.60,0:02:30.31,Default,,0000,0000,0000,,And here when you see the robot\Ninteracting with me on a desktop -- Dialogue: 0,0:02:30.33,0:02:32.37,Default,,0000,0000,0000,,and I'm actually redesigning the robot, Dialogue: 0,0:02:32.39,0:02:34.20,Default,,0000,0000,0000,,so, unbeknownst to itself, Dialogue: 0,0:02:34.22,0:02:36.80,Default,,0000,0000,0000,,it's kind of digging its own\Ngrave by helping me. Dialogue: 0,0:02:36.82,0:02:38.82,Default,,0000,0000,0000,,(Laughter) Dialogue: 0,0:02:38.85,0:02:42.09,Default,,0000,0000,0000,,I wanted it to be less of a mechanical\Nstructure giving me light, Dialogue: 0,0:02:42.11,0:02:45.13,Default,,0000,0000,0000,,and more of a helpful,\Nkind of quiet apprentice Dialogue: 0,0:02:45.15,0:02:48.32,Default,,0000,0000,0000,,that's always there when you need it\Nand doesn't really interfere. Dialogue: 0,0:02:48.35,0:02:51.68,Default,,0000,0000,0000,,And when, for example, I'm looking\Nfor a battery that I can't find, Dialogue: 0,0:02:51.71,0:02:54.65,Default,,0000,0000,0000,,in a subtle way, it'll show me\Nwhere the battery is. Dialogue: 0,0:02:54.67,0:02:57.67,Default,,0000,0000,0000,,And I want you to notice\Nhow the same mechanical structure Dialogue: 0,0:02:57.70,0:02:59.77,Default,,0000,0000,0000,,can at one point,\Njust by the way it moves, Dialogue: 0,0:02:59.77,0:03:01.26,Default,,0000,0000,0000,,seem gentle and caring, Dialogue: 0,0:03:01.30,0:03:03.95,Default,,0000,0000,0000,,and in the other case seem \Nviolent and confrontational Dialogue: 0,0:03:04.02,0:03:07.02,Default,,0000,0000,0000,,And it's the same structure, \Njust the motion is different. Dialogue: 0,0:03:07.18,0:03:09.92,Default,,0000,0000,0000,,Actor: "You want to know something? Dialogue: 0,0:03:09.95,0:03:11.72,Default,,0000,0000,0000,,You wanna know something?! Dialogue: 0,0:03:11.91,0:03:13.50,Default,,0000,0000,0000,,He was already dead! Dialogue: 0,0:03:13.86,0:03:17.56,Default,,0000,0000,0000,,Just laying there, eyes glazed over." Dialogue: 0,0:03:17.85,0:03:18.88,Default,,0000,0000,0000,,(Laughter) Dialogue: 0,0:03:18.90,0:03:21.96,Default,,0000,0000,0000,,But, moving in a graceful way\Nis just one building block Dialogue: 0,0:03:21.98,0:03:24.57,Default,,0000,0000,0000,,of this whole structure\Ncalled human-robot interaction. Dialogue: 0,0:03:24.60,0:03:28.05,Default,,0000,0000,0000,,I was, at the time, doing my PhD,\NI was working on human-robot teamwork, Dialogue: 0,0:03:28.08,0:03:30.14,Default,,0000,0000,0000,,teams of humans and robots\Nworking together. Dialogue: 0,0:03:30.16,0:03:31.80,Default,,0000,0000,0000,,I was studying the engineering, Dialogue: 0,0:03:31.82,0:03:34.35,Default,,0000,0000,0000,,the psychology,\Nthe philosophy of teamwork, Dialogue: 0,0:03:34.38,0:03:35.53,Default,,0000,0000,0000,,and at the same time, Dialogue: 0,0:03:35.55,0:03:38.04,Default,,0000,0000,0000,,I found myself in my own kind\Nof teamwork situation, Dialogue: 0,0:03:38.07,0:03:40.32,Default,,0000,0000,0000,,with a good friend of mine,\Nwho's actually here. Dialogue: 0,0:03:40.34,0:03:42.75,Default,,0000,0000,0000,,And in that situation,\Nwe can easily imagine robots Dialogue: 0,0:03:42.77,0:03:44.67,Default,,0000,0000,0000,,in the near future being there with us. Dialogue: 0,0:03:44.70,0:03:46.39,Default,,0000,0000,0000,,It was after a Passover Seder. Dialogue: 0,0:03:46.41,0:03:48.47,Default,,0000,0000,0000,,We were folding up\Na lot of folding chairs, Dialogue: 0,0:03:48.49,0:03:51.15,Default,,0000,0000,0000,,and I was amazed at how quickly\Nwe found our own rhythm. Dialogue: 0,0:03:51.17,0:03:54.28,Default,,0000,0000,0000,,Everybody did their own part,\Nwe didn't have to divide our tasks. Dialogue: 0,0:03:54.31,0:03:56.75,Default,,0000,0000,0000,,We didn't have to communicate\Nverbally about this -- Dialogue: 0,0:03:56.78,0:03:57.97,Default,,0000,0000,0000,,it all just happened. Dialogue: 0,0:03:57.99,0:04:00.87,Default,,0000,0000,0000,,And I thought, humans and robots\Ndon't look at all like this. Dialogue: 0,0:04:00.89,0:04:04.02,Default,,0000,0000,0000,,When humans and robots interact,\Nit's much more like a chess game: Dialogue: 0,0:04:04.05,0:04:07.17,Default,,0000,0000,0000,,the human does a thing, the robot\Nanalyzes whatever the human did, Dialogue: 0,0:04:07.19,0:04:09.84,Default,,0000,0000,0000,,the robot decides what to do next,\Nplans it and does it. Dialogue: 0,0:04:09.86,0:04:12.22,Default,,0000,0000,0000,,Then the human waits,\Nuntil it's their turn again. Dialogue: 0,0:04:12.24,0:04:14.97,Default,,0000,0000,0000,,So it's much more like a chess game,\Nand that makes sense, Dialogue: 0,0:04:14.99,0:04:18.10,Default,,0000,0000,0000,,because chess is great for mathematicians\Nand computer scientists. Dialogue: 0,0:04:18.13,0:04:21.56,Default,,0000,0000,0000,,It's all about information, analysis,\Ndecision-making and planning. Dialogue: 0,0:04:21.58,0:04:24.26,Default,,0000,0000,0000,,But I wanted my robot\Nto be less of a chess player, Dialogue: 0,0:04:24.34,0:04:26.13,Default,,0000,0000,0000,,and more like a doer Dialogue: 0,0:04:26.15,0:04:28.15,Default,,0000,0000,0000,,that just clicks and works together. Dialogue: 0,0:04:28.18,0:04:30.75,Default,,0000,0000,0000,,So I made my second\Nhorrible career choice: Dialogue: 0,0:04:30.77,0:04:33.77,Default,,0000,0000,0000,,- actually, I think maybe \NI should title this talk Dialogue: 0,0:04:35.49,0:04:38.49,Default,,0000,0000,0000,,"A lot of ways to give your Jewish mother\Na heart attack." Dialogue: 0,0:04:38.52,0:04:39.63,Default,,0000,0000,0000,,(Laughter) Dialogue: 0,0:04:40.87,0:04:43.43,Default,,0000,0000,0000,,I decided to study acting for a semester. Dialogue: 0,0:04:43.45,0:04:46.37,Default,,0000,0000,0000,,I took off from the PhD,\NI went to acting classes. Dialogue: 0,0:04:46.39,0:04:48.92,Default,,0000,0000,0000,,I actually participated in a play -- Dialogue: 0,0:04:48.95,0:04:51.25,Default,,0000,0000,0000,,I hope there’s no video\Nof that around still. Dialogue: 0,0:04:51.28,0:04:52.32,Default,,0000,0000,0000,,(Laughter) Dialogue: 0,0:04:52.34,0:04:54.63,Default,,0000,0000,0000,,And I got every book\NI could find about acting, Dialogue: 0,0:04:54.66,0:04:57.79,Default,,0000,0000,0000,,including one from the 19th century\Nthat I got from the library. Dialogue: 0,0:04:57.81,0:05:01.42,Default,,0000,0000,0000,,And I was really amazed, because my name\Nwas the second name on the list -- Dialogue: 0,0:05:01.45,0:05:03.45,Default,,0000,0000,0000,,the previous name was in 1889. Dialogue: 0,0:05:03.47,0:05:04.49,Default,,0000,0000,0000,,(Laughter) Dialogue: 0,0:05:04.51,0:05:06.76,Default,,0000,0000,0000,,And this book was\Nkind of waiting for 100 years Dialogue: 0,0:05:06.78,0:05:08.47,Default,,0000,0000,0000,,to be rediscovered for robotics. Dialogue: 0,0:05:08.54,0:05:10.12,Default,,0000,0000,0000,,And this book shows actors Dialogue: 0,0:05:10.14,0:05:12.38,Default,,0000,0000,0000,,how to move every muscle in the body Dialogue: 0,0:05:12.40,0:05:15.12,Default,,0000,0000,0000,,to match every kind of emotion\Nthat they want to express. Dialogue: 0,0:05:15.14,0:05:18.17,Default,,0000,0000,0000,,But the real revelation was\Nwhen I learned about method acting. Dialogue: 0,0:05:18.19,0:05:20.44,Default,,0000,0000,0000,,It became very popular\Nin the 20th century. Dialogue: 0,0:05:20.47,0:05:21.62,Default,,0000,0000,0000,,And method acting said Dialogue: 0,0:05:21.64,0:05:23.94,Default,,0000,0000,0000,,you don't have to plan\Nevery muscle in your body; Dialogue: 0,0:05:23.97,0:05:26.91,Default,,0000,0000,0000,,instead, you have to use your body\Nto find the right movement. Dialogue: 0,0:05:26.94,0:05:29.82,Default,,0000,0000,0000,,You have to use your sense memory\Nto reconstruct the emotions Dialogue: 0,0:05:29.84,0:05:32.88,Default,,0000,0000,0000,,and kind of think with your body\Nto find the right expression -- Dialogue: 0,0:05:32.90,0:05:34.78,Default,,0000,0000,0000,,improvise, play off your scene partner. Dialogue: 0,0:05:34.80,0:05:36.25,Default,,0000,0000,0000,,And this came at the same time Dialogue: 0,0:05:36.27,0:05:39.38,Default,,0000,0000,0000,,as I was reading about this trend\Nin cognitive psychology, Dialogue: 0,0:05:39.40,0:05:42.65,Default,,0000,0000,0000,,called embodied cognition,\Nwhich also talks about the same ideas. Dialogue: 0,0:05:42.68,0:05:44.19,Default,,0000,0000,0000,,We use our bodies to think; Dialogue: 0,0:05:44.22,0:05:47.17,Default,,0000,0000,0000,,we don't just think with our brains\Nand use our bodies to move, Dialogue: 0,0:05:47.20,0:05:49.12,Default,,0000,0000,0000,,but our bodies feed back into our brain Dialogue: 0,0:05:49.14,0:05:51.30,Default,,0000,0000,0000,,to generate the way that we behave. Dialogue: 0,0:05:51.33,0:05:52.92,Default,,0000,0000,0000,,And it was like a lightning bolt. Dialogue: 0,0:05:52.95,0:05:54.16,Default,,0000,0000,0000,,I went back to my office, Dialogue: 0,0:05:54.19,0:05:56.59,Default,,0000,0000,0000,,I wrote this paper,\Nwhich I never really published, Dialogue: 0,0:05:56.62,0:05:59.15,Default,,0000,0000,0000,,called "Acting Lessons\Nfor Artificial Intelligence." Dialogue: 0,0:05:59.17,0:06:00.55,Default,,0000,0000,0000,,And I even took another month Dialogue: 0,0:06:00.58,0:06:03.02,Default,,0000,0000,0000,,to do what was then the first theater play Dialogue: 0,0:06:03.04,0:06:04.100,Default,,0000,0000,0000,,with a human and a robot acting together. Dialogue: 0,0:06:05.02,0:06:07.41,Default,,0000,0000,0000,,That's what you saw\Nbefore with the actors. Dialogue: 0,0:06:08.76,0:06:09.92,Default,,0000,0000,0000,,And I thought: Dialogue: 0,0:06:09.94,0:06:12.88,Default,,0000,0000,0000,,How can we make an artificial\Nintelligence model -- Dialogue: 0,0:06:12.90,0:06:14.49,Default,,0000,0000,0000,,a computational model -- Dialogue: 0,0:06:14.49,0:06:17.12,Default,,0000,0000,0000,,that will model some of these\Nideas of improvisation, Dialogue: 0,0:06:17.12,0:06:18.89,Default,,0000,0000,0000,,of taking risks, of taking chances, Dialogue: 0,0:06:18.89,0:06:20.37,Default,,0000,0000,0000,,even of making mistakes? Dialogue: 0,0:06:20.37,0:06:23.11,Default,,0000,0000,0000,,Maybe it can make for better\Nrobotic teammates. Dialogue: 0,0:06:23.11,0:06:25.63,Default,,0000,0000,0000,,So I worked for quite\Na long time on these models Dialogue: 0,0:06:25.63,0:06:27.84,Default,,0000,0000,0000,,and I implemented them\Non a number of robots. Dialogue: 0,0:06:27.84,0:06:29.94,Default,,0000,0000,0000,,Here you can see a very early example Dialogue: 0,0:06:29.94,0:06:33.55,Default,,0000,0000,0000,,with the robots trying to use\Nthis embodied artificial intelligence Dialogue: 0,0:06:33.55,0:06:36.47,Default,,0000,0000,0000,,to try to match my movements\Nas closely as possible. Dialogue: 0,0:06:36.47,0:06:38.20,Default,,0000,0000,0000,,It's sort of like a game. Dialogue: 0,0:06:38.22,0:06:40.85,Default,,0000,0000,0000,,And it's a little bit like\Nwhat you might see actors do Dialogue: 0,0:06:40.87,0:06:44.65,Default,,0000,0000,0000,,when they try to mirror each other\Nto find the right synchrony between them. Dialogue: 0,0:06:44.66,0:06:46.50,Default,,0000,0000,0000,,And then, I did another experiment, Dialogue: 0,0:06:46.52,0:06:50.58,Default,,0000,0000,0000,,and I got people off the street\Nto use the robotic desk lamp, Dialogue: 0,0:06:50.60,0:06:53.70,Default,,0000,0000,0000,,and try out this idea\Nof embodied artificial intelligence. Dialogue: 0,0:06:53.82,0:06:56.48,Default,,0000,0000,0000,,I actually used two kinds\Nof brains for the same robot. Dialogue: 0,0:06:56.54,0:06:58.50,Default,,0000,0000,0000,,The robot is the same lamp that you saw, Dialogue: 0,0:06:58.52,0:06:59.86,Default,,0000,0000,0000,,and I put two brains in it. Dialogue: 0,0:06:59.88,0:07:01.61,Default,,0000,0000,0000,,For one half of the people, Dialogue: 0,0:07:01.63,0:07:03.90,Default,,0000,0000,0000,,I put in a brain\Nthat's kind of the traditional, Dialogue: 0,0:07:03.92,0:07:05.12,Default,,0000,0000,0000,,calculated robotic brain. Dialogue: 0,0:07:05.15,0:07:07.79,Default,,0000,0000,0000,,It waits for its turn,\Nit analyzes everything, it plans. Dialogue: 0,0:07:07.81,0:07:09.49,Default,,0000,0000,0000,,Let's call it the calculated brain. Dialogue: 0,0:07:09.52,0:07:12.76,Default,,0000,0000,0000,,The other got more the stage\Nactor, risk-taker brain. Dialogue: 0,0:07:12.79,0:07:14.91,Default,,0000,0000,0000,,Let's call it the adventurous brain. Dialogue: 0,0:07:14.93,0:07:17.87,Default,,0000,0000,0000,,It sometimes acts without knowing\Neverything it has to know. Dialogue: 0,0:07:17.89,0:07:20.19,Default,,0000,0000,0000,,It sometimes makes mistakes\Nand corrects them. Dialogue: 0,0:07:20.21,0:07:24.13,Default,,0000,0000,0000,,And I had them do this very tedious task\Nthat took almost 20 minutes, Dialogue: 0,0:07:24.15,0:07:25.63,Default,,0000,0000,0000,,and they had to work together, Dialogue: 0,0:07:25.65,0:07:28.20,Default,,0000,0000,0000,,somehow simulating, like, a factory job Dialogue: 0,0:07:28.23,0:07:30.32,Default,,0000,0000,0000,,of repetitively doing the same thing. Dialogue: 0,0:07:30.34,0:07:33.68,Default,,0000,0000,0000,,What I found is that people\Nactually loved the adventurous robot. Dialogue: 0,0:07:33.70,0:07:35.48,Default,,0000,0000,0000,,They thought it was more intelligent, Dialogue: 0,0:07:35.50,0:07:37.61,Default,,0000,0000,0000,,more committed,\Na better member of the team, Dialogue: 0,0:07:37.63,0:07:39.70,Default,,0000,0000,0000,,contributed to the success\Nof the team more. Dialogue: 0,0:07:39.72,0:07:41.43,Default,,0000,0000,0000,,They even called it "he" and "she," Dialogue: 0,0:07:41.45,0:07:43.57,Default,,0000,0000,0000,,whereas people with the calculated brain Dialogue: 0,0:07:43.60,0:07:46.40,Default,,0000,0000,0000,,called it "it," and nobody\Never called it "he" or "she." Dialogue: 0,0:07:46.58,0:07:49.87,Default,,0000,0000,0000,,When they talked about it after the task,\Nwith the adventurous brain, Dialogue: 0,0:07:49.89,0:07:53.68,Default,,0000,0000,0000,,they said, "By the end, we were good\Nfriends and high-fived mentally." Dialogue: 0,0:07:53.80,0:07:55.09,Default,,0000,0000,0000,,Whatever that means. Dialogue: 0,0:07:55.11,0:07:57.02,Default,,0000,0000,0000,,(Laughter) Dialogue: 0,0:07:57.04,0:07:58.40,Default,,0000,0000,0000,,Sounds painful. Dialogue: 0,0:07:58.42,0:08:01.16,Default,,0000,0000,0000,,Whereas the people\Nwith the calculated brain Dialogue: 0,0:08:01.18,0:08:03.54,Default,,0000,0000,0000,,said it was just like a lazy apprentice. Dialogue: 0,0:08:03.56,0:08:06.31,Default,,0000,0000,0000,,It only did what it was supposed\Nto do and nothing more, Dialogue: 0,0:08:06.33,0:08:08.68,Default,,0000,0000,0000,,which is almost what people\Nexpect robots to do, Dialogue: 0,0:08:08.71,0:08:12.26,Default,,0000,0000,0000,,so I was surprised that people\Nhad higher expectations of robots Dialogue: 0,0:08:12.29,0:08:15.79,Default,,0000,0000,0000,,than what anybody in robotics\Nthought robots should be doing. Dialogue: 0,0:08:17.13,0:08:19.14,Default,,0000,0000,0000,,And in a way, I thought,\Nmaybe it's time -- Dialogue: 0,0:08:19.17,0:08:22.13,Default,,0000,0000,0000,,just like method acting\Nchanged the way people thought Dialogue: 0,0:08:22.15,0:08:23.75,Default,,0000,0000,0000,,about acting in the 19th century, Dialogue: 0,0:08:23.77,0:08:26.85,Default,,0000,0000,0000,,from going from the very calculated,\Nplanned way of behaving, Dialogue: 0,0:08:26.87,0:08:30.37,Default,,0000,0000,0000,,to a more intuitive, risk-taking,\Nembodied way of behaving -- Dialogue: 0,0:08:30.40,0:08:33.59,Default,,0000,0000,0000,,maybe it's time for robots\Nto have the same kind of revolution. Dialogue: 0,0:08:35.49,0:08:39.09,Default,,0000,0000,0000,,A few years later, I was at my next\Nresearch job at Georgia Tech in Atlanta, Dialogue: 0,0:08:39.12,0:08:41.94,Default,,0000,0000,0000,,and I was working in a group\Ndealing with robotic musicians. Dialogue: 0,0:08:41.96,0:08:44.32,Default,,0000,0000,0000,,And I thought, music:\Nthat's the perfect place Dialogue: 0,0:08:44.35,0:08:48.49,Default,,0000,0000,0000,,to look at teamwork, coordination,\Ntiming, improvisation -- Dialogue: 0,0:08:48.52,0:08:50.96,Default,,0000,0000,0000,,and we just got this robot\Nplaying marimba. Dialogue: 0,0:08:50.98,0:08:53.24,Default,,0000,0000,0000,,And the marimba, for everybody like me, Dialogue: 0,0:08:53.26,0:08:56.00,Default,,0000,0000,0000,,it was this huge, wooden xylophone. Dialogue: 0,0:08:56.03,0:08:58.09,Default,,0000,0000,0000,,And when I was looking at this, Dialogue: 0,0:08:58.11,0:09:01.11,Default,,0000,0000,0000,,I looked at other works\Nin human-robot improvisation -- Dialogue: 0,0:09:01.14,0:09:03.88,Default,,0000,0000,0000,,yes, there are other works\Nin human-robot improvisation -- Dialogue: 0,0:09:03.91,0:09:06.26,Default,,0000,0000,0000,,and they were also a little bit\Nlike a chess game. Dialogue: 0,0:09:06.28,0:09:07.43,Default,,0000,0000,0000,,The human would play, Dialogue: 0,0:09:07.45,0:09:09.63,Default,,0000,0000,0000,,the robot analyzed what was played, Dialogue: 0,0:09:09.65,0:09:11.73,Default,,0000,0000,0000,,and would improvise their own part. Dialogue: 0,0:09:11.75,0:09:14.89,Default,,0000,0000,0000,,So, this is what musicians called\Na call-and-response interaction, Dialogue: 0,0:09:14.92,0:09:18.31,Default,,0000,0000,0000,,and it also fits very well\Nrobots and artificial intelligence. Dialogue: 0,0:09:18.39,0:09:21.64,Default,,0000,0000,0000,,But I thought, if I use the same ideas\NI used in the theater play Dialogue: 0,0:09:21.66,0:09:23.41,Default,,0000,0000,0000,,and in the teamwork studies, Dialogue: 0,0:09:23.43,0:09:27.08,Default,,0000,0000,0000,,maybe I can make the robots\Njam together like a band. Dialogue: 0,0:09:27.11,0:09:30.91,Default,,0000,0000,0000,,Everybody's riffing off each other,\Nnobody is stopping for a moment. Dialogue: 0,0:09:30.93,0:09:33.77,Default,,0000,0000,0000,,And so I tried to do the same\Nthings, this time with music, Dialogue: 0,0:09:33.80,0:09:36.63,Default,,0000,0000,0000,,where the robot doesn't really know\Nwhat it's about to play, Dialogue: 0,0:09:36.65,0:09:39.67,Default,,0000,0000,0000,,it just sort of moves its body\Nand uses opportunities to play, Dialogue: 0,0:09:39.70,0:09:42.23,Default,,0000,0000,0000,,and does what my jazz teacher\Nwhen I was 17 taught me. Dialogue: 0,0:09:42.26,0:09:43.66,Default,,0000,0000,0000,,She said, when you improvise, Dialogue: 0,0:09:44.38,0:09:47.40,Default,,0000,0000,0000,,sometimes you don't know\Nwhat you're doing, and you still do it. Dialogue: 0,0:09:47.42,0:09:50.75,Default,,0000,0000,0000,,So I tried to make a robot that doesn't\Nactually know what it's doing, Dialogue: 0,0:09:50.77,0:09:51.99,Default,,0000,0000,0000,,but is still doing it. Dialogue: 0,0:09:52.01,0:09:54.52,Default,,0000,0000,0000,,So let's look at a few seconds\Nfrom this performance, Dialogue: 0,0:09:54.55,0:09:56.68,Default,,0000,0000,0000,,where the robot listens\Nto the human musician Dialogue: 0,0:09:56.70,0:09:57.86,Default,,0000,0000,0000,,and improvises. Dialogue: 0,0:09:57.89,0:10:00.86,Default,,0000,0000,0000,,And then, look how the human\Nmusician also responds Dialogue: 0,0:10:00.89,0:10:02.16,Default,,0000,0000,0000,,to what the robot is doing Dialogue: 0,0:10:02.18,0:10:04.83,Default,,0000,0000,0000,,and picking up from its behavior, Dialogue: 0,0:10:04.85,0:10:08.81,Default,,0000,0000,0000,,and at some point can even be surprised\Nby what the robot came up with. Dialogue: 0,0:10:08.83,0:10:11.03,Default,,0000,0000,0000,,(Music) Dialogue: 0,0:10:47.62,0:10:49.62,Default,,0000,0000,0000,,(Music ends) Dialogue: 0,0:10:51.13,0:10:56.87,Default,,0000,0000,0000,,(Applause) Dialogue: 0,0:10:56.89,0:10:59.14,Default,,0000,0000,0000,,Being a musician\Nis not just about making notes, Dialogue: 0,0:10:59.17,0:11:01.51,Default,,0000,0000,0000,,otherwise nobody\Nwould ever go see a live show. Dialogue: 0,0:11:01.54,0:11:03.66,Default,,0000,0000,0000,,Musicians also communicate\Nwith their bodies, Dialogue: 0,0:11:03.68,0:11:05.70,Default,,0000,0000,0000,,with other band members,\Nwith the audience, Dialogue: 0,0:11:05.72,0:11:07.74,Default,,0000,0000,0000,,they use their bodies\Nto express the music. Dialogue: 0,0:11:07.76,0:11:10.46,Default,,0000,0000,0000,,And I thought, we already have\Na robot musician on stage, Dialogue: 0,0:11:10.48,0:11:12.80,Default,,0000,0000,0000,,why not make it be\Na full-fledged musician? Dialogue: 0,0:11:12.82,0:11:15.49,Default,,0000,0000,0000,,And I started designing\Na socially expressive head Dialogue: 0,0:11:15.52,0:11:16.86,Default,,0000,0000,0000,,for the robot. Dialogue: 0,0:11:16.88,0:11:18.96,Default,,0000,0000,0000,,The head doesn’t actually\Ntouch the marimba, Dialogue: 0,0:11:18.98,0:11:20.94,Default,,0000,0000,0000,,it just expresses what the music is like. Dialogue: 0,0:11:20.96,0:11:23.46,Default,,0000,0000,0000,,These are some napkin sketches\Nfrom a bar in Atlanta Dialogue: 0,0:11:23.48,0:11:26.02,Default,,0000,0000,0000,,that was dangerously\Nlocated exactly halfway Dialogue: 0,0:11:26.05,0:11:27.86,Default,,0000,0000,0000,,between my lab and my home. Dialogue: 0,0:11:27.88,0:11:31.82,Default,,0000,0000,0000,,So I spent, I would say, on average,\Nthree to four hours a day there. Dialogue: 0,0:11:31.85,0:11:33.03,Default,,0000,0000,0000,,I think. Dialogue: 0,0:11:33.06,0:11:34.59,Default,,0000,0000,0000,,(Laughter) Dialogue: 0,0:11:34.62,0:11:37.50,Default,,0000,0000,0000,,And I went back to my animation\Ntools and tried to figure out Dialogue: 0,0:11:37.52,0:11:39.89,Default,,0000,0000,0000,,not just what a robotic\Nmusician would look like, Dialogue: 0,0:11:39.92,0:11:42.54,Default,,0000,0000,0000,,but especially what a robotic\Nmusician would move like, Dialogue: 0,0:11:42.57,0:11:45.97,Default,,0000,0000,0000,,to sort of show that it doesn't like\Nwhat the other person is playing -- Dialogue: 0,0:11:45.99,0:11:49.82,Default,,0000,0000,0000,,and maybe show whatever beat\Nit's feeling at the moment. Dialogue: 0,0:11:49.84,0:11:54.34,Default,,0000,0000,0000,,So we ended up actually getting the money\Nto build this robot, which was nice. Dialogue: 0,0:11:54.37,0:11:56.97,Default,,0000,0000,0000,,I'm going to show you now\Nthe same kind of performance, Dialogue: 0,0:11:56.100,0:11:59.04,Default,,0000,0000,0000,,this time with a socially expressive head. Dialogue: 0,0:11:59.06,0:12:00.24,Default,,0000,0000,0000,,And notice one thing -- Dialogue: 0,0:12:00.28,0:12:01.96,Default,,0000,0000,0000,,how the robot is really showing us Dialogue: 0,0:12:01.98,0:12:03.88,Default,,0000,0000,0000,,the beat it's picking up from the human, Dialogue: 0,0:12:03.91,0:12:07.84,Default,,0000,0000,0000,,while also giving the human a sense\Nthat the robot knows what it's doing. Dialogue: 0,0:12:07.86,0:12:09.78,Default,,0000,0000,0000,,And also how it changes the way it moves Dialogue: 0,0:12:09.80,0:12:11.76,Default,,0000,0000,0000,,as soon as it starts its own solo. Dialogue: 0,0:12:11.78,0:12:15.68,Default,,0000,0000,0000,,(Music) Dialogue: 0,0:12:40.38,0:12:43.30,Default,,0000,0000,0000,,Now look at the final chord\Nof the piece again. Dialogue: 0,0:12:43.33,0:12:46.24,Default,,0000,0000,0000,,And this time the robot\Ncommunicates with its body Dialogue: 0,0:12:46.27,0:12:48.38,Default,,0000,0000,0000,,when it's busy doing its own thing, Dialogue: 0,0:12:48.40,0:12:53.26,Default,,0000,0000,0000,,and when it's ready to coordinate\Nthe final chord with me. Dialogue: 0,0:12:53.28,0:12:56.02,Default,,0000,0000,0000,,(Music) Dialogue: 0,0:13:00.98,0:13:02.98,Default,,0000,0000,0000,,(Music ending) Dialogue: 0,0:13:05.30,0:13:06.30,Default,,0000,0000,0000,,(Final chord) Dialogue: 0,0:13:06.34,0:13:11.26,Default,,0000,0000,0000,,(Applause) Dialogue: 0,0:13:11.31,0:13:12.46,Default,,0000,0000,0000,,Thanks. Dialogue: 0,0:13:12.48,0:13:14.07,Default,,0000,0000,0000,,I hope you see Dialogue: 0,0:13:14.09,0:13:18.49,Default,,0000,0000,0000,,how much this part of the body\Nthat doesn't touch the instrument Dialogue: 0,0:13:18.51,0:13:21.10,Default,,0000,0000,0000,,actually helps\Nwith the musical performance. Dialogue: 0,0:13:21.56,0:13:23.57,Default,,0000,0000,0000,,And at some point -- we are in Atlanta, Dialogue: 0,0:13:23.59,0:13:26.84,Default,,0000,0000,0000,,so obviously some rapper\Nwill come into our lab at some point -- Dialogue: 0,0:13:26.87,0:13:31.66,Default,,0000,0000,0000,,and we had this rapper come in and do\Na little jam with the robot. Dialogue: 0,0:13:31.68,0:13:35.73,Default,,0000,0000,0000,,Here you can see the robot\Nbasically responding to the beat. Dialogue: 0,0:13:35.76,0:13:36.91,Default,,0000,0000,0000,,Notice two things: Dialogue: 0,0:13:36.93,0:13:40.54,Default,,0000,0000,0000,,one, how irresistible it is to join\Nthe robot while it's moving its head. Dialogue: 0,0:13:40.56,0:13:43.17,Default,,0000,0000,0000,,You kind of want to move\Nyour own head when it does it. Dialogue: 0,0:13:43.19,0:13:46.78,Default,,0000,0000,0000,,And second, even though the rapper\Nis really focused on his iPhone, Dialogue: 0,0:13:46.80,0:13:49.91,Default,,0000,0000,0000,,as soon as the robot turns\Nto him, he turns back. Dialogue: 0,0:13:49.94,0:13:52.57,Default,,0000,0000,0000,,So even though it's just\Nin the periphery of his vision, Dialogue: 0,0:13:52.60,0:13:54.72,Default,,0000,0000,0000,,in the corner of his eye,\Nit's very powerful. Dialogue: 0,0:13:54.74,0:13:56.57,Default,,0000,0000,0000,,And the reason is that we can't ignore Dialogue: 0,0:13:56.60,0:13:58.62,Default,,0000,0000,0000,,physical things moving in our environment. Dialogue: 0,0:13:58.64,0:13:59.82,Default,,0000,0000,0000,,We are wired for that. Dialogue: 0,0:13:59.84,0:14:01.48,Default,,0000,0000,0000,,So if you have a problem -- Dialogue: 0,0:14:01.51,0:14:05.15,Default,,0000,0000,0000,,maybe your partner is looking\Nat their iPhone or smartphone too much -- Dialogue: 0,0:14:05.17,0:14:08.00,Default,,0000,0000,0000,,you might want to have a robot\Nthere to get their attention. Dialogue: 0,0:14:08.00,0:14:08.98,Default,,0000,0000,0000,,(Laughter) Dialogue: 0,0:14:08.100,0:14:11.07,Default,,0000,0000,0000,,(Music) Dialogue: 0,0:14:23.51,0:14:25.51,Default,,0000,0000,0000,,(Music ends) Dialogue: 0,0:14:26.14,0:14:33.09,Default,,0000,0000,0000,,(Applause) Dialogue: 0,0:14:33.63,0:14:37.47,Default,,0000,0000,0000,,Just to introduce the last robot\Nthat we've worked on, Dialogue: 0,0:14:37.49,0:14:39.84,Default,,0000,0000,0000,,it came out of something\Nsurprising that we found: Dialogue: 0,0:14:39.86,0:14:43.02,Default,,0000,0000,0000,,At some point people didn't care\Nabout the robot being intelligent, Dialogue: 0,0:14:43.05,0:14:44.45,Default,,0000,0000,0000,,able to improvise and listen, Dialogue: 0,0:14:44.47,0:14:48.88,Default,,0000,0000,0000,,and do all these embodied intelligence\Nthings that I spent years developing. Dialogue: 0,0:14:48.90,0:14:51.58,Default,,0000,0000,0000,,They really liked that the robot\Nwas enjoying the music. Dialogue: 0,0:14:51.61,0:14:52.61,Default,,0000,0000,0000,,(Laughter) Dialogue: 0,0:14:52.63,0:14:55.18,Default,,0000,0000,0000,,And they didn't say the robot\Nwas moving to the music, Dialogue: 0,0:14:55.20,0:14:56.69,Default,,0000,0000,0000,,they said "enjoying" the music. Dialogue: 0,0:14:56.71,0:14:58.84,Default,,0000,0000,0000,,And we thought,\Nwhy don't we take this idea, Dialogue: 0,0:14:58.86,0:15:01.60,Default,,0000,0000,0000,,and I designed a new piece of furniture. Dialogue: 0,0:15:01.63,0:15:04.20,Default,,0000,0000,0000,,This time it wasn't a desk lamp,\Nit was a speaker dock, Dialogue: 0,0:15:04.22,0:15:06.86,Default,,0000,0000,0000,,one of those things\Nyou plug your smartphone in. Dialogue: 0,0:15:06.89,0:15:08.04,Default,,0000,0000,0000,,And I thought, Dialogue: 0,0:15:08.06,0:15:11.56,Default,,0000,0000,0000,,what would happen if your speaker dock\Ndidn't just play the music for you, Dialogue: 0,0:15:11.59,0:15:13.63,Default,,0000,0000,0000,,but would actually enjoy it, too? Dialogue: 0,0:15:13.66,0:15:17.82,Default,,0000,0000,0000,,And so again, here are some\Nanimation tests from an early stage. Dialogue: 0,0:15:17.84,0:15:19.23,Default,,0000,0000,0000,,(Laughter) Dialogue: 0,0:15:19.84,0:15:22.71,Default,,0000,0000,0000,,And this is what the final\Nproduct looked like. Dialogue: 0,0:15:34.25,0:15:36.43,Default,,0000,0000,0000,,(Music) Dialogue: 0,0:15:56.05,0:15:58.05,Default,,0000,0000,0000,,(Music ends) Dialogue: 0,0:15:58.66,0:16:01.28,Default,,0000,0000,0000,,So, a lot of bobbing heads. Dialogue: 0,0:16:01.30,0:16:04.92,Default,,0000,0000,0000,,(Applause) Dialogue: 0,0:16:07.14,0:16:09.03,Default,,0000,0000,0000,,A lot of bobbing heads in the audience, Dialogue: 0,0:16:09.05,0:16:11.76,Default,,0000,0000,0000,,so we can still see\Nrobots influence people. Dialogue: 0,0:16:11.79,0:16:14.57,Default,,0000,0000,0000,,And it's not just fun and games. Dialogue: 0,0:16:14.60,0:16:16.80,Default,,0000,0000,0000,,I think one of the reasons I care so much Dialogue: 0,0:16:16.82,0:16:19.05,Default,,0000,0000,0000,,about robots that use\Ntheir body to communicate Dialogue: 0,0:16:19.08,0:16:20.78,Default,,0000,0000,0000,,and use their body to move is -- Dialogue: 0,0:16:20.81,0:16:24.20,Default,,0000,0000,0000,,I'm going to let you in on a little\Nsecret we roboticists are hiding -- Dialogue: 0,0:16:24.22,0:16:27.01,Default,,0000,0000,0000,,is that every one of you\Nis going to be living with a robot Dialogue: 0,0:16:27.04,0:16:28.63,Default,,0000,0000,0000,,at some point in your life. Dialogue: 0,0:16:28.65,0:16:31.59,Default,,0000,0000,0000,,Somewhere in your future,\Nthere will be a robot in your life. Dialogue: 0,0:16:31.61,0:16:33.48,Default,,0000,0000,0000,,If not in yours, your children's lives. Dialogue: 0,0:16:33.50,0:16:38.49,Default,,0000,0000,0000,,And I want these robots to be more fluent,\Nmore engaging, more graceful Dialogue: 0,0:16:38.52,0:16:40.25,Default,,0000,0000,0000,,than currently they seem to be. Dialogue: 0,0:16:40.27,0:16:43.56,Default,,0000,0000,0000,,And for that I think maybe robots\Nneed to be less like chess players Dialogue: 0,0:16:43.58,0:16:46.22,Default,,0000,0000,0000,,and more like stage actors\Nand more like musicians. Dialogue: 0,0:16:46.25,0:16:49.06,Default,,0000,0000,0000,,Maybe they should be able\Nto take chances and improvise. Dialogue: 0,0:16:49.08,0:16:52.11,Default,,0000,0000,0000,,Maybe they should be able\Nto anticipate what you're about to do. Dialogue: 0,0:16:52.13,0:16:55.48,Default,,0000,0000,0000,,Maybe they even need to be able\Nto make mistakes and correct them, Dialogue: 0,0:16:55.50,0:16:57.39,Default,,0000,0000,0000,,because in the end, we are human. Dialogue: 0,0:16:57.42,0:17:00.97,Default,,0000,0000,0000,,And maybe as humans,\Nrobots that are a little less than perfect Dialogue: 0,0:17:00.99,0:17:02.72,Default,,0000,0000,0000,,are just perfect for us. Dialogue: 0,0:17:02.75,0:17:03.91,Default,,0000,0000,0000,,Thank you. Dialogue: 0,0:17:03.93,0:17:10.77,Default,,0000,0000,0000,,(Applause)