[Script Info] Title: [Events] Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text Dialogue: 0,0:00:01.14,0:00:03.11,Default,,0000,0000,0000,,Everyone is both a learner Dialogue: 0,0:00:03.11,0:00:04.62,Default,,0000,0000,0000,,and a teacher. Dialogue: 0,0:00:04.62,0:00:07.08,Default,,0000,0000,0000,,This is me being inspired Dialogue: 0,0:00:07.08,0:00:08.27,Default,,0000,0000,0000,,by my first tutor, Dialogue: 0,0:00:08.27,0:00:09.22,Default,,0000,0000,0000,,my mom, Dialogue: 0,0:00:09.22,0:00:11.84,Default,,0000,0000,0000,,and this is me teaching Dialogue: 0,0:00:11.84,0:00:13.79,Default,,0000,0000,0000,,Introduction to Artificial Intelligence Dialogue: 0,0:00:13.79,0:00:15.03,Default,,0000,0000,0000,,to 200 students Dialogue: 0,0:00:15.03,0:00:16.30,Default,,0000,0000,0000,,at Stanford University. Dialogue: 0,0:00:16.30,0:00:17.76,Default,,0000,0000,0000,,Now the students and I Dialogue: 0,0:00:17.76,0:00:18.94,Default,,0000,0000,0000,,enjoyed the class, Dialogue: 0,0:00:18.94,0:00:20.35,Default,,0000,0000,0000,,but it occurred to me Dialogue: 0,0:00:20.35,0:00:22.06,Default,,0000,0000,0000,,that while the subject matter Dialogue: 0,0:00:22.06,0:00:23.35,Default,,0000,0000,0000,,of the class is advanced Dialogue: 0,0:00:23.35,0:00:24.04,Default,,0000,0000,0000,,and modern, Dialogue: 0,0:00:24.04,0:00:26.36,Default,,0000,0000,0000,,the teaching technology isn't. Dialogue: 0,0:00:26.36,0:00:28.69,Default,,0000,0000,0000,,In fact, I use basically Dialogue: 0,0:00:28.69,0:00:31.06,Default,,0000,0000,0000,,the same technology as Dialogue: 0,0:00:31.06,0:00:33.69,Default,,0000,0000,0000,,this 14th-century classroom. Dialogue: 0,0:00:33.69,0:00:36.49,Default,,0000,0000,0000,,Note the textbook, Dialogue: 0,0:00:36.49,0:00:39.44,Default,,0000,0000,0000,,the sage on the stage, Dialogue: 0,0:00:39.44,0:00:41.34,Default,,0000,0000,0000,,and the sleeping guy Dialogue: 0,0:00:41.34,0:00:42.24,Default,,0000,0000,0000,,in the back. (Laughter) Dialogue: 0,0:00:42.24,0:00:45.18,Default,,0000,0000,0000,,Just like today. Dialogue: 0,0:00:45.18,0:00:48.29,Default,,0000,0000,0000,,So my co-teacher, Dialogue: 0,0:00:48.29,0:00:49.93,Default,,0000,0000,0000,,Sebastian Thrun, and I thought, Dialogue: 0,0:00:49.93,0:00:51.70,Default,,0000,0000,0000,,there must be a better way. Dialogue: 0,0:00:51.70,0:00:53.35,Default,,0000,0000,0000,,We challenged ourselves Dialogue: 0,0:00:53.35,0:00:54.64,Default,,0000,0000,0000,,to create an online class Dialogue: 0,0:00:54.64,0:00:56.28,Default,,0000,0000,0000,,that would be equal or better Dialogue: 0,0:00:56.28,0:00:58.61,Default,,0000,0000,0000,,in quality to our Stanford class, Dialogue: 0,0:00:58.61,0:01:00.82,Default,,0000,0000,0000,,but to bring it to anyone Dialogue: 0,0:01:00.82,0:01:02.45,Default,,0000,0000,0000,,in the world for free. Dialogue: 0,0:01:02.45,0:01:05.02,Default,,0000,0000,0000,,We announced the class on July 29th, Dialogue: 0,0:01:05.02,0:01:08.23,Default,,0000,0000,0000,,and within two weeks, 50,000 people Dialogue: 0,0:01:08.23,0:01:09.64,Default,,0000,0000,0000,,had signed up for it. Dialogue: 0,0:01:09.64,0:01:12.74,Default,,0000,0000,0000,,And that grew to 160,000 students Dialogue: 0,0:01:12.74,0:01:14.80,Default,,0000,0000,0000,,from 209 countries. Dialogue: 0,0:01:14.80,0:01:16.61,Default,,0000,0000,0000,,We were thrilled to have Dialogue: 0,0:01:16.61,0:01:17.73,Default,,0000,0000,0000,,that kind of audience, Dialogue: 0,0:01:17.73,0:01:20.37,Default,,0000,0000,0000,,and just a bit terrified that we Dialogue: 0,0:01:20.37,0:01:22.68,Default,,0000,0000,0000,,hadn't finished preparing the class yet. (Laughter) Dialogue: 0,0:01:22.68,0:01:24.30,Default,,0000,0000,0000,,So we got to work. Dialogue: 0,0:01:24.30,0:01:25.93,Default,,0000,0000,0000,,We studied what others had done, Dialogue: 0,0:01:25.93,0:01:28.26,Default,,0000,0000,0000,,what we could copy and what we could change. Dialogue: 0,0:01:28.26,0:01:30.92,Default,,0000,0000,0000,,Benjamin Bloom had showed Dialogue: 0,0:01:30.92,0:01:32.72,Default,,0000,0000,0000,,that one-on-one tutoring works best, Dialogue: 0,0:01:32.72,0:01:34.85,Default,,0000,0000,0000,,so that's what we tried to emulate, Dialogue: 0,0:01:34.85,0:01:36.29,Default,,0000,0000,0000,,like with me and my mom, Dialogue: 0,0:01:36.29,0:01:37.80,Default,,0000,0000,0000,,even though we knew Dialogue: 0,0:01:37.80,0:01:39.72,Default,,0000,0000,0000,,it would be one-on-thousands. Dialogue: 0,0:01:39.72,0:01:41.92,Default,,0000,0000,0000,,Here, an overhead video camera Dialogue: 0,0:01:41.92,0:01:43.75,Default,,0000,0000,0000,,is recording me as I'm talking Dialogue: 0,0:01:43.75,0:01:45.43,Default,,0000,0000,0000,,and drawing on a piece of paper. Dialogue: 0,0:01:45.43,0:01:47.84,Default,,0000,0000,0000,,A student said, "This class felt Dialogue: 0,0:01:47.84,0:01:48.99,Default,,0000,0000,0000,,like sitting in a bar Dialogue: 0,0:01:48.99,0:01:50.47,Default,,0000,0000,0000,,with a really smart friend Dialogue: 0,0:01:50.47,0:01:51.67,Default,,0000,0000,0000,,who's explaining something Dialogue: 0,0:01:51.67,0:01:53.97,Default,,0000,0000,0000,,you haven't grasped, but are about to." Dialogue: 0,0:01:53.97,0:01:56.09,Default,,0000,0000,0000,,And that's exactly what we were aiming for. Dialogue: 0,0:01:56.09,0:01:58.88,Default,,0000,0000,0000,,Now, from Khan Academy, we saw Dialogue: 0,0:01:58.88,0:02:00.70,Default,,0000,0000,0000,,that short 10-minute videos Dialogue: 0,0:02:00.70,0:02:02.48,Default,,0000,0000,0000,,worked much better than trying Dialogue: 0,0:02:02.48,0:02:04.55,Default,,0000,0000,0000,,to record an hour-long lecture Dialogue: 0,0:02:04.55,0:02:06.96,Default,,0000,0000,0000,,and put it on the small-format screen. Dialogue: 0,0:02:06.96,0:02:09.16,Default,,0000,0000,0000,,We decided to go even shorter Dialogue: 0,0:02:09.16,0:02:10.80,Default,,0000,0000,0000,,and more interactive. Dialogue: 0,0:02:10.80,0:02:13.05,Default,,0000,0000,0000,,Our typical video is two minutes, Dialogue: 0,0:02:13.05,0:02:14.80,Default,,0000,0000,0000,,sometimes shorter, never more Dialogue: 0,0:02:14.80,0:02:17.49,Default,,0000,0000,0000,,than six, and then we pause for Dialogue: 0,0:02:17.49,0:02:18.86,Default,,0000,0000,0000,,a quiz question, to make it Dialogue: 0,0:02:18.86,0:02:20.74,Default,,0000,0000,0000,,feel like one-on-one tutoring. Dialogue: 0,0:02:20.74,0:02:23.14,Default,,0000,0000,0000,,Here, I'm explaining how a computer uses Dialogue: 0,0:02:23.14,0:02:24.39,Default,,0000,0000,0000,,the grammar of English Dialogue: 0,0:02:24.39,0:02:26.56,Default,,0000,0000,0000,,to parse sentences, and here, Dialogue: 0,0:02:26.56,0:02:28.63,Default,,0000,0000,0000,,there's a pause and the student Dialogue: 0,0:02:28.63,0:02:30.87,Default,,0000,0000,0000,,has to reflect, understand what's going on Dialogue: 0,0:02:30.87,0:02:32.51,Default,,0000,0000,0000,,and check the right boxes Dialogue: 0,0:02:32.51,0:02:33.92,Default,,0000,0000,0000,,before they can continue. Dialogue: 0,0:02:33.92,0:02:36.37,Default,,0000,0000,0000,,Students learn best when Dialogue: 0,0:02:36.37,0:02:37.62,Default,,0000,0000,0000,,they're actively practicing. Dialogue: 0,0:02:37.62,0:02:39.92,Default,,0000,0000,0000,,We wanted to engage them, to have them grapple Dialogue: 0,0:02:39.92,0:02:42.88,Default,,0000,0000,0000,,with ambiguity and guide them to synthesize Dialogue: 0,0:02:42.88,0:02:44.55,Default,,0000,0000,0000,,the key ideas themselves. Dialogue: 0,0:02:44.55,0:02:46.26,Default,,0000,0000,0000,,We mostly avoid questions Dialogue: 0,0:02:46.26,0:02:47.97,Default,,0000,0000,0000,,like, "Here's a formula, now Dialogue: 0,0:02:47.97,0:02:49.05,Default,,0000,0000,0000,,tell me the value of Y Dialogue: 0,0:02:49.05,0:02:50.26,Default,,0000,0000,0000,,when X is equal to two." Dialogue: 0,0:02:50.26,0:02:52.08,Default,,0000,0000,0000,,We preferred open-ended questions. Dialogue: 0,0:02:52.08,0:02:55.25,Default,,0000,0000,0000,,One student wrote, "Now I'm seeing Dialogue: 0,0:02:55.25,0:02:57.12,Default,,0000,0000,0000,,Bayes networks and examples of Dialogue: 0,0:02:57.12,0:02:58.68,Default,,0000,0000,0000,,game theory everywhere I look." Dialogue: 0,0:02:58.68,0:03:00.42,Default,,0000,0000,0000,,And I like that kind of response. Dialogue: 0,0:03:00.42,0:03:02.23,Default,,0000,0000,0000,,That's just what we were going for. Dialogue: 0,0:03:02.23,0:03:04.42,Default,,0000,0000,0000,,We didn't want students to memorize the formulas; Dialogue: 0,0:03:04.42,0:03:05.61,Default,,0000,0000,0000,,we wanted to change the way Dialogue: 0,0:03:05.61,0:03:06.70,Default,,0000,0000,0000,,they looked at the world. Dialogue: 0,0:03:06.70,0:03:08.03,Default,,0000,0000,0000,,And we succeeded. Dialogue: 0,0:03:08.03,0:03:10.43,Default,,0000,0000,0000,,Or, I should say, the students succeeded. Dialogue: 0,0:03:10.43,0:03:12.35,Default,,0000,0000,0000,,And it's a little bit ironic Dialogue: 0,0:03:12.35,0:03:15.26,Default,,0000,0000,0000,,that we set about to disrupt traditional education, Dialogue: 0,0:03:15.26,0:03:17.28,Default,,0000,0000,0000,,and in doing so, we ended up Dialogue: 0,0:03:17.28,0:03:18.86,Default,,0000,0000,0000,,making our online class Dialogue: 0,0:03:18.86,0:03:21.19,Default,,0000,0000,0000,,much more like a traditional college class Dialogue: 0,0:03:21.19,0:03:23.03,Default,,0000,0000,0000,,than other online classes. Dialogue: 0,0:03:23.03,0:03:26.24,Default,,0000,0000,0000,,Most online classes, the videos are always available. Dialogue: 0,0:03:26.24,0:03:28.06,Default,,0000,0000,0000,,You can watch them any time you want. Dialogue: 0,0:03:28.06,0:03:30.35,Default,,0000,0000,0000,,But if you can do it any time, Dialogue: 0,0:03:30.35,0:03:31.85,Default,,0000,0000,0000,,that means you can do it tomorrow, Dialogue: 0,0:03:31.85,0:03:33.26,Default,,0000,0000,0000,,and if you can do it tomorrow, Dialogue: 0,0:03:33.26,0:03:35.42,Default,,0000,0000,0000,,well, you may not ever Dialogue: 0,0:03:35.42,0:03:37.18,Default,,0000,0000,0000,,get around to it. (Laughter) Dialogue: 0,0:03:37.18,0:03:39.37,Default,,0000,0000,0000,,So we brought back the innovation Dialogue: 0,0:03:39.37,0:03:41.46,Default,,0000,0000,0000,,of having due dates. (Laughter) Dialogue: 0,0:03:41.46,0:03:42.77,Default,,0000,0000,0000,,You could watch the videos Dialogue: 0,0:03:42.77,0:03:44.68,Default,,0000,0000,0000,,any time you wanted during the week, Dialogue: 0,0:03:44.68,0:03:45.84,Default,,0000,0000,0000,,but at the end of the week, Dialogue: 0,0:03:45.84,0:03:47.55,Default,,0000,0000,0000,,you had to get the homework done. Dialogue: 0,0:03:47.55,0:03:49.47,Default,,0000,0000,0000,,This motivated the students to keep going, and it also Dialogue: 0,0:03:49.47,0:03:52.32,Default,,0000,0000,0000,,meant that everybody was working Dialogue: 0,0:03:52.32,0:03:53.84,Default,,0000,0000,0000,,on the same thing at the same time, Dialogue: 0,0:03:53.84,0:03:55.34,Default,,0000,0000,0000,,so if you went into a discussion forum, Dialogue: 0,0:03:55.34,0:03:58.04,Default,,0000,0000,0000,,you could get an answer from a peer within minutes. Dialogue: 0,0:03:58.04,0:04:00.98,Default,,0000,0000,0000,,Now, I'll show you some of the forums, most of which Dialogue: 0,0:04:00.98,0:04:03.75,Default,,0000,0000,0000,,were self-organized by the students themselves. Dialogue: 0,0:04:03.75,0:04:06.97,Default,,0000,0000,0000,,From Daphne Koller and Andrew Ng, we learned Dialogue: 0,0:04:06.97,0:04:08.97,Default,,0000,0000,0000,,the concept of "flipping" the classroom. Dialogue: 0,0:04:08.97,0:04:10.26,Default,,0000,0000,0000,,Students watched the videos Dialogue: 0,0:04:10.26,0:04:11.85,Default,,0000,0000,0000,,on their own, and then they Dialogue: 0,0:04:11.85,0:04:13.56,Default,,0000,0000,0000,,come together to discuss them. Dialogue: 0,0:04:13.56,0:04:16.72,Default,,0000,0000,0000,,From Eric Mazur, I learned about peer instruction, Dialogue: 0,0:04:16.72,0:04:19.34,Default,,0000,0000,0000,,that peers can be the best teachers, Dialogue: 0,0:04:19.34,0:04:20.77,Default,,0000,0000,0000,,because they're the ones Dialogue: 0,0:04:20.77,0:04:23.62,Default,,0000,0000,0000,,that remember what it's like to not understand. Dialogue: 0,0:04:23.62,0:04:26.30,Default,,0000,0000,0000,,Sebastian and I have forgotten some of that. Dialogue: 0,0:04:26.30,0:04:28.70,Default,,0000,0000,0000,,Of course, we couldn't have Dialogue: 0,0:04:28.70,0:04:30.33,Default,,0000,0000,0000,,a classroom discussion with Dialogue: 0,0:04:30.33,0:04:31.88,Default,,0000,0000,0000,,tens of thousands of students, Dialogue: 0,0:04:31.88,0:04:35.36,Default,,0000,0000,0000,,so we encouraged and nurtured these online forums. Dialogue: 0,0:04:35.36,0:04:38.41,Default,,0000,0000,0000,,And finally, from Teach For America, Dialogue: 0,0:04:38.41,0:04:39.89,Default,,0000,0000,0000,,I learned that a class is not Dialogue: 0,0:04:39.89,0:04:41.39,Default,,0000,0000,0000,,primarily about information. Dialogue: 0,0:04:41.39,0:04:44.22,Default,,0000,0000,0000,,More important is motivation and determination. Dialogue: 0,0:04:44.22,0:04:46.06,Default,,0000,0000,0000,,It was crucial that the students see Dialogue: 0,0:04:46.06,0:04:47.86,Default,,0000,0000,0000,,that we're working hard for them and Dialogue: 0,0:04:47.86,0:04:49.27,Default,,0000,0000,0000,,they're all supporting each other. Dialogue: 0,0:04:49.27,0:04:52.24,Default,,0000,0000,0000,,Now, the class ran 10 weeks, Dialogue: 0,0:04:52.24,0:04:56.15,Default,,0000,0000,0000,,and in the end, about half of the 160,000 students watched Dialogue: 0,0:04:56.15,0:04:57.71,Default,,0000,0000,0000,,at least one video each week, Dialogue: 0,0:04:57.71,0:05:00.40,Default,,0000,0000,0000,,and over 20,000 finished all the homework, Dialogue: 0,0:05:00.40,0:05:02.07,Default,,0000,0000,0000,,putting in 50 to 100 hours. Dialogue: 0,0:05:02.07,0:05:03.62,Default,,0000,0000,0000,,They got this statement of accomplishment. Dialogue: 0,0:05:03.62,0:05:05.74,Default,,0000,0000,0000,,So what have we learned? Dialogue: 0,0:05:05.74,0:05:08.56,Default,,0000,0000,0000,,Well, we tried some old ideas Dialogue: 0,0:05:08.56,0:05:10.21,Default,,0000,0000,0000,,and some new and put them together, Dialogue: 0,0:05:10.21,0:05:12.30,Default,,0000,0000,0000,,but there are more ideas to try. Dialogue: 0,0:05:12.30,0:05:14.11,Default,,0000,0000,0000,,Sebastian's teaching another class now. Dialogue: 0,0:05:14.11,0:05:15.48,Default,,0000,0000,0000,,I'll do one in the fall. Dialogue: 0,0:05:15.48,0:05:19.24,Default,,0000,0000,0000,,Stanford Coursera, Udacity, MITx Dialogue: 0,0:05:19.24,0:05:21.51,Default,,0000,0000,0000,,and others have more classes coming. Dialogue: 0,0:05:21.51,0:05:22.100,Default,,0000,0000,0000,,It's a really exciting time. Dialogue: 0,0:05:22.100,0:05:24.47,Default,,0000,0000,0000,,But to me, the most exciting Dialogue: 0,0:05:24.47,0:05:27.44,Default,,0000,0000,0000,,part of it is the data that we're gathering. Dialogue: 0,0:05:27.44,0:05:30.14,Default,,0000,0000,0000,,We're gathering thousands Dialogue: 0,0:05:30.14,0:05:31.80,Default,,0000,0000,0000,,of interactions per student per class, Dialogue: 0,0:05:31.80,0:05:34.00,Default,,0000,0000,0000,,billions of interactions altogether, Dialogue: 0,0:05:34.00,0:05:36.51,Default,,0000,0000,0000,,and now we can start analyzing that, Dialogue: 0,0:05:36.51,0:05:37.97,Default,,0000,0000,0000,,and when we learn from that, Dialogue: 0,0:05:37.97,0:05:39.21,Default,,0000,0000,0000,,do experimentations, Dialogue: 0,0:05:39.21,0:05:41.45,Default,,0000,0000,0000,,that's when the real revolution will come. Dialogue: 0,0:05:41.45,0:05:44.23,Default,,0000,0000,0000,,And you'll be able to see the results from Dialogue: 0,0:05:44.23,0:05:46.49,Default,,0000,0000,0000,,a new generation of amazing students. Dialogue: 0,0:05:46.49,0:05:48.75,Default,,0000,0000,0000,,(Applause)