[Script Info]
Title: 
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:00.72,0:00:03.84,Default,,0000,0000,0000,,Like many of you, I'm one of the lucky people.
Dialogue: 0,0:00:03.84,0:00:07.24,Default,,0000,0000,0000,,I was born to a family where education was pervasive.
Dialogue: 0,0:00:07.24,0:00:11.47,Default,,0000,0000,0000,,I'm a third-generation PhD, a daughter of two academics.
Dialogue: 0,0:00:11.47,0:00:15.27,Default,,0000,0000,0000,,In my childhood, I played around in my father's university lab.
Dialogue: 0,0:00:15.27,0:00:19.12,Default,,0000,0000,0000,,So it was taken for granted that I attend some of the best universities,
Dialogue: 0,0:00:19.12,0:00:22.92,Default,,0000,0000,0000,,which in turn opened the door to a world of opportunity.
Dialogue: 0,0:00:22.92,0:00:27.04,Default,,0000,0000,0000,,Unfortunately, most of the people in the world are not so lucky.
Dialogue: 0,0:00:27.04,0:00:30.17,Default,,0000,0000,0000,,In some parts of the world, for example, South Africa,
Dialogue: 0,0:00:30.17,0:00:32.88,Default,,0000,0000,0000,,education is just not readily accessible.
Dialogue: 0,0:00:32.88,0:00:35.85,Default,,0000,0000,0000,,In South Africa, the educational system was constructed
Dialogue: 0,0:00:35.85,0:00:38.73,Default,,0000,0000,0000,,in the days of apartheid for the white minority.
Dialogue: 0,0:00:38.73,0:00:41.43,Default,,0000,0000,0000,,And as a consequence, today there is just not enough spots
Dialogue: 0,0:00:41.43,0:00:45.28,Default,,0000,0000,0000,,for the many more people who want and deserve a high quality education.
Dialogue: 0,0:00:45.28,0:00:49.16,Default,,0000,0000,0000,,That scarcity led to a crisis in January of this year
Dialogue: 0,0:00:49.16,0:00:50.99,Default,,0000,0000,0000,,at the University of Johannesburg.
Dialogue: 0,0:00:50.99,0:00:53.12,Default,,0000,0000,0000,,There were a handful of positions left open
Dialogue: 0,0:00:53.12,0:00:56.09,Default,,0000,0000,0000,,from the standard admissions process, and the night before
Dialogue: 0,0:00:56.09,0:00:58.65,Default,,0000,0000,0000,,they were supposed to open that for registration,
Dialogue: 0,0:00:58.65,0:01:02.71,Default,,0000,0000,0000,,thousands of people lined up outside the gate in a line a mile long,
Dialogue: 0,0:01:02.71,0:01:06.59,Default,,0000,0000,0000,,hoping to be first in line to get one of those positions.
Dialogue: 0,0:01:06.59,0:01:08.89,Default,,0000,0000,0000,,When the gates opened, there was a stampede,
Dialogue: 0,0:01:08.89,0:01:12.55,Default,,0000,0000,0000,,and 20 people were injured and one woman died.
Dialogue: 0,0:01:12.55,0:01:14.49,Default,,0000,0000,0000,,She was a mother who gave her life
Dialogue: 0,0:01:14.49,0:01:18.55,Default,,0000,0000,0000,,trying to get her son a chance at a better life.
Dialogue: 0,0:01:18.55,0:01:21.71,Default,,0000,0000,0000,,But even in parts of the world like the United States
Dialogue: 0,0:01:21.71,0:01:26.06,Default,,0000,0000,0000,,where education is available, it might not be within reach.
Dialogue: 0,0:01:26.06,0:01:28.73,Default,,0000,0000,0000,,There has been much discussed in the last few years
Dialogue: 0,0:01:28.73,0:01:30.72,Default,,0000,0000,0000,,about the rising cost of health care.
Dialogue: 0,0:01:30.72,0:01:33.36,Default,,0000,0000,0000,,What might not be quite as obvious to people
Dialogue: 0,0:01:33.36,0:01:37.39,Default,,0000,0000,0000,,is that during that same period the cost of higher education tuition
Dialogue: 0,0:01:37.39,0:01:39.87,Default,,0000,0000,0000,,has been increasing at almost twice the rate,
Dialogue: 0,0:01:39.87,0:01:44.15,Default,,0000,0000,0000,,for a total of 559 percent since 1985.
Dialogue: 0,0:01:44.15,0:01:48.68,Default,,0000,0000,0000,,This makes education unaffordable for many people.
Dialogue: 0,0:01:48.68,0:01:52.48,Default,,0000,0000,0000,,Finally, even for those who do manage to get the higher education,
Dialogue: 0,0:01:52.48,0:01:55.11,Default,,0000,0000,0000,,the doors of opportunity might not open.
Dialogue: 0,0:01:55.11,0:01:58.31,Default,,0000,0000,0000,,Only a little over half of recent college graduates
Dialogue: 0,0:01:58.31,0:02:00.63,Default,,0000,0000,0000,,in the United States who get a higher education
Dialogue: 0,0:02:00.63,0:02:04.09,Default,,0000,0000,0000,,actually are working in jobs that require that education.
Dialogue: 0,0:02:04.09,0:02:05.93,Default,,0000,0000,0000,,This, of course, is not true for the students
Dialogue: 0,0:02:05.93,0:02:07.88,Default,,0000,0000,0000,,who graduate from the top institutions,
Dialogue: 0,0:02:07.88,0:02:10.51,Default,,0000,0000,0000,,but for many others, they do not get the value
Dialogue: 0,0:02:10.51,0:02:14.05,Default,,0000,0000,0000,,for their time and their effort.
Dialogue: 0,0:02:14.05,0:02:17.08,Default,,0000,0000,0000,,Tom Friedman, in his recent New York Times article,
Dialogue: 0,0:02:17.08,0:02:21.45,Default,,0000,0000,0000,,captured, in the way that no one else could, the spirit behind our effort.
Dialogue: 0,0:02:21.45,0:02:24.57,Default,,0000,0000,0000,,He said the big breakthroughs are what happen
Dialogue: 0,0:02:24.57,0:02:28.47,Default,,0000,0000,0000,,when what is suddenly possible meets what is desperately necessary.
Dialogue: 0,0:02:28.47,0:02:31.09,Default,,0000,0000,0000,,I've talked about what's desperately necessary.
Dialogue: 0,0:02:31.09,0:02:33.60,Default,,0000,0000,0000,,Let's talk about what's suddenly possible.
Dialogue: 0,0:02:33.60,0:02:36.72,Default,,0000,0000,0000,,What's suddenly possible was demonstrated by
Dialogue: 0,0:02:36.72,0:02:38.29,Default,,0000,0000,0000,,three big Stanford classes,
Dialogue: 0,0:02:38.29,0:02:42.17,Default,,0000,0000,0000,,each of which had an enrollment of 100,000 people or more.
Dialogue: 0,0:02:42.17,0:02:45.55,Default,,0000,0000,0000,,So to understand this, let's look at one of those classes,
Dialogue: 0,0:02:45.55,0:02:47.47,Default,,0000,0000,0000,,the Machine Learning class offered by my colleague
Dialogue: 0,0:02:47.47,0:02:49.20,Default,,0000,0000,0000,,and cofounder Andrew Ng.
Dialogue: 0,0:02:49.20,0:02:51.52,Default,,0000,0000,0000,,Andrew teaches one of the bigger Stanford classes.
Dialogue: 0,0:02:51.52,0:02:52.73,Default,,0000,0000,0000,,It's a Machine Learning class,
Dialogue: 0,0:02:52.73,0:02:56.25,Default,,0000,0000,0000,,and it has 400 people enrolled every time it's offered.
Dialogue: 0,0:02:56.25,0:02:59.51,Default,,0000,0000,0000,,When Andrew taught the Machine Learning class to the general public,
Dialogue: 0,0:02:59.51,0:03:02.13,Default,,0000,0000,0000,,it had 100,000 people registered.
Dialogue: 0,0:03:02.13,0:03:04.14,Default,,0000,0000,0000,,So to put that number in perspective,
Dialogue: 0,0:03:04.14,0:03:06.50,Default,,0000,0000,0000,,for Andrew to reach that same size audience
Dialogue: 0,0:03:06.50,0:03:08.32,Default,,0000,0000,0000,,by teaching a Stanford class,
Dialogue: 0,0:03:08.32,0:03:12.25,Default,,0000,0000,0000,,he would have to do that for 250 years.
Dialogue: 0,0:03:12.25,0:03:15.73,Default,,0000,0000,0000,,Of course, he'd get really bored.
Dialogue: 0,0:03:15.73,0:03:18.47,Default,,0000,0000,0000,,So, having seen the impact of this,
Dialogue: 0,0:03:18.47,0:03:21.60,Default,,0000,0000,0000,,Andrew and I decided that we needed to really try and scale this up,
Dialogue: 0,0:03:21.60,0:03:25.72,Default,,0000,0000,0000,,to bring the best quality education to as many people as we could.
Dialogue: 0,0:03:25.72,0:03:27.21,Default,,0000,0000,0000,,So we formed Coursera,
Dialogue: 0,0:03:27.21,0:03:30.35,Default,,0000,0000,0000,,whose goal is to take the best courses
Dialogue: 0,0:03:30.35,0:03:33.67,Default,,0000,0000,0000,,from the best instructors at the best universities
Dialogue: 0,0:03:33.67,0:03:37.70,Default,,0000,0000,0000,,and provide it to everyone around the world for free.
Dialogue: 0,0:03:37.70,0:03:40.30,Default,,0000,0000,0000,,We currently have 43 courses on the platform
Dialogue: 0,0:03:40.30,0:03:43.49,Default,,0000,0000,0000,,from four universities across a range of disciplines,
Dialogue: 0,0:03:43.49,0:03:45.33,Default,,0000,0000,0000,,and let me show you a little bit of an overview
Dialogue: 0,0:03:45.33,0:03:48.60,Default,,0000,0000,0000,,of what that looks like.
Dialogue: 0,0:03:48.60,0:03:49.82,Default,,0000,0000,0000,,(Video) Robert Ghrist: Welcome to Calculus.
Dialogue: 0,0:03:49.82,0:03:51.70,Default,,0000,0000,0000,,Ezekiel Emanuel: Fifty million people are uninsured.
Dialogue: 0,0:03:51.70,0:03:54.97,Default,,0000,0000,0000,,Scott Page: Models help us design more effective institutions and policies.
Dialogue: 0,0:03:54.97,0:03:57.38,Default,,0000,0000,0000,,We get unbelievable segregation.
Dialogue: 0,0:03:57.38,0:03:59.17,Default,,0000,0000,0000,,Scott Klemmer: So Bush imagined that in the future,
Dialogue: 0,0:03:59.17,0:04:01.55,Default,,0000,0000,0000,,you'd wear a camera right in the center of your head.
Dialogue: 0,0:04:01.55,0:04:05.80,Default,,0000,0000,0000,,Mitchell Duneier: Mills wants the student of sociology to develop the quality of mind ...
Dialogue: 0,0:04:05.80,0:04:09.47,Default,,0000,0000,0000,,RG: Hanging cable takes on the form of a hyperbolic cosine.
Dialogue: 0,0:04:09.47,0:04:12.54,Default,,0000,0000,0000,,Nick Parlante: For each pixel in the image, set the red to zero.
Dialogue: 0,0:04:12.54,0:04:15.51,Default,,0000,0000,0000,,Paul Offit: ... Vaccine allowed us to eliminate polio virus.
Dialogue: 0,0:04:15.51,0:04:19.14,Default,,0000,0000,0000,,Dan Jurafsky: Does Lufthansa serve breakfast and San Jose? Well, that sounds funny.
Dialogue: 0,0:04:19.14,0:04:22.75,Default,,0000,0000,0000,,Daphne Koller: So this is which coin you pick, and this is the two tosses.
Dialogue: 0,0:04:22.75,0:04:26.44,Default,,0000,0000,0000,,Andrew Ng: So in large-scale machine learning, we'd like to come up with computational ...
Dialogue: 0,0:04:26.44,0:04:32.05,Default,,0000,0000,0000,,(Applause)
Dialogue: 0,0:04:32.05,0:04:34.32,Default,,0000,0000,0000,,DK: It turns out, maybe not surprisingly,
Dialogue: 0,0:04:34.32,0:04:36.56,Default,,0000,0000,0000,,that students like getting the best content
Dialogue: 0,0:04:36.56,0:04:39.45,Default,,0000,0000,0000,,from the best universities for free.
Dialogue: 0,0:04:39.45,0:04:41.97,Default,,0000,0000,0000,,Since we opened the website in February,
Dialogue: 0,0:04:41.97,0:04:46.33,Default,,0000,0000,0000,,we now have 640,000 students from 190 countries.
Dialogue: 0,0:04:46.33,0:04:48.48,Default,,0000,0000,0000,,We have 1.5 million enrollments,
Dialogue: 0,0:04:48.48,0:04:51.33,Default,,0000,0000,0000,,6 million quizzes in the 15 classes that have launched
Dialogue: 0,0:04:51.33,0:04:56.25,Default,,0000,0000,0000,,so far have been submitted, and 14 million videos have been viewed.
Dialogue: 0,0:04:56.25,0:04:58.76,Default,,0000,0000,0000,,But it's not just about the numbers,
Dialogue: 0,0:04:58.76,0:05:00.40,Default,,0000,0000,0000,,it's also about the people.
Dialogue: 0,0:05:00.40,0:05:03.38,Default,,0000,0000,0000,,Whether it's Akash, who comes from a small town in India
Dialogue: 0,0:05:03.38,0:05:05.56,Default,,0000,0000,0000,,and would never have access in this case
Dialogue: 0,0:05:05.56,0:05:07.04,Default,,0000,0000,0000,,to a Stanford-quality course
Dialogue: 0,0:05:07.04,0:05:09.56,Default,,0000,0000,0000,,and would never be able to afford it.
Dialogue: 0,0:05:09.56,0:05:11.60,Default,,0000,0000,0000,,Or Jenny, who is a single mother of two
Dialogue: 0,0:05:11.60,0:05:13.56,Default,,0000,0000,0000,,and wants to hone her skills
Dialogue: 0,0:05:13.56,0:05:16.70,Default,,0000,0000,0000,,so that she can go back and complete her master's degree.
Dialogue: 0,0:05:16.70,0:05:19.84,Default,,0000,0000,0000,,Or Ryan, who can't go to school,
Dialogue: 0,0:05:19.84,0:05:21.70,Default,,0000,0000,0000,,because his immune deficient daughter
Dialogue: 0,0:05:21.70,0:05:25.08,Default,,0000,0000,0000,,can't be risked to have germs come into the house,
Dialogue: 0,0:05:25.08,0:05:26.92,Default,,0000,0000,0000,,so he couldn't leave the house.
Dialogue: 0,0:05:26.92,0:05:28.56,Default,,0000,0000,0000,,I'm really glad to say --
Dialogue: 0,0:05:28.56,0:05:30.81,Default,,0000,0000,0000,,recently, we've been in correspondence with Ryan --
Dialogue: 0,0:05:30.81,0:05:32.74,Default,,0000,0000,0000,,that this story had a happy ending.
Dialogue: 0,0:05:32.74,0:05:34.64,Default,,0000,0000,0000,,Baby Shannon -- you can see her on the left --
Dialogue: 0,0:05:34.64,0:05:35.99,Default,,0000,0000,0000,,is doing much better now,
Dialogue: 0,0:05:35.99,0:05:40.19,Default,,0000,0000,0000,,and Ryan got a job by taking some of our courses.
Dialogue: 0,0:05:40.19,0:05:42.44,Default,,0000,0000,0000,,So what made these courses so different?
Dialogue: 0,0:05:42.44,0:05:46.16,Default,,0000,0000,0000,,After all, online course content has been available for a while.
Dialogue: 0,0:05:46.16,0:05:49.87,Default,,0000,0000,0000,,What made it different was that this was real course experience.
Dialogue: 0,0:05:49.87,0:05:51.59,Default,,0000,0000,0000,,It started on a given day,
Dialogue: 0,0:05:51.59,0:05:55.23,Default,,0000,0000,0000,,and then the students would watch videos on a weekly basis
Dialogue: 0,0:05:55.23,0:05:57.08,Default,,0000,0000,0000,,and do homework assignments.
Dialogue: 0,0:05:57.08,0:05:58.87,Default,,0000,0000,0000,,And these would be real homework assignments
Dialogue: 0,0:05:58.87,0:06:02.18,Default,,0000,0000,0000,,for a real grade, with a real deadline.
Dialogue: 0,0:06:02.18,0:06:04.23,Default,,0000,0000,0000,,You can see the deadlines and the usage graph.
Dialogue: 0,0:06:04.23,0:06:06.32,Default,,0000,0000,0000,,These are the spikes showing
Dialogue: 0,0:06:06.32,0:06:10.11,Default,,0000,0000,0000,,that procrastination is global phenomenon.
Dialogue: 0,0:06:10.11,0:06:12.69,Default,,0000,0000,0000,,(Laughter)
Dialogue: 0,0:06:12.69,0:06:14.36,Default,,0000,0000,0000,,At the end of the course,
Dialogue: 0,0:06:14.36,0:06:16.22,Default,,0000,0000,0000,,the students got a certificate.
Dialogue: 0,0:06:16.22,0:06:18.38,Default,,0000,0000,0000,,They could present that certificate
Dialogue: 0,0:06:18.38,0:06:20.53,Default,,0000,0000,0000,,to a prospective employer and get a better job,
Dialogue: 0,0:06:20.53,0:06:22.59,Default,,0000,0000,0000,,and we know many students who did.
Dialogue: 0,0:06:22.59,0:06:24.51,Default,,0000,0000,0000,,Some students took their certificate
Dialogue: 0,0:06:24.51,0:06:27.63,Default,,0000,0000,0000,,and presented this to an educational institution at which they were enrolled
Dialogue: 0,0:06:27.63,0:06:29.47,Default,,0000,0000,0000,,for actual college credit.
Dialogue: 0,0:06:29.47,0:06:31.68,Default,,0000,0000,0000,,So these students were really getting something meaningful
Dialogue: 0,0:06:31.68,0:06:34.52,Default,,0000,0000,0000,,for their investment of time and effort.
Dialogue: 0,0:06:34.52,0:06:37.07,Default,,0000,0000,0000,,Let's talk a little bit about some of the components
Dialogue: 0,0:06:37.07,0:06:38.96,Default,,0000,0000,0000,,that go into these courses.
Dialogue: 0,0:06:38.96,0:06:41.59,Default,,0000,0000,0000,,The first component is that when you move away
Dialogue: 0,0:06:41.59,0:06:43.89,Default,,0000,0000,0000,,from the constraints of a physical classroom
Dialogue: 0,0:06:43.89,0:06:46.73,Default,,0000,0000,0000,,and design content explicitly for an online format,
Dialogue: 0,0:06:46.73,0:06:49.26,Default,,0000,0000,0000,,you can break away from, for example,
Dialogue: 0,0:06:49.26,0:06:51.67,Default,,0000,0000,0000,,the monolithic one-hour lecture.
Dialogue: 0,0:06:51.67,0:06:53.46,Default,,0000,0000,0000,,You can break up the material, for example,
Dialogue: 0,0:06:53.46,0:06:56.83,Default,,0000,0000,0000,,into these short, modular units of eight to 12 minutes,
Dialogue: 0,0:06:56.83,0:06:59.81,Default,,0000,0000,0000,,each of which represents a coherent concept.
Dialogue: 0,0:06:59.81,0:07:02.38,Default,,0000,0000,0000,,Students can traverse this material in different ways,
Dialogue: 0,0:07:02.38,0:07:06.08,Default,,0000,0000,0000,,depending on their background, their skills or their interests.
Dialogue: 0,0:07:06.08,0:07:08.60,Default,,0000,0000,0000,,So, for example, some students might benefit
Dialogue: 0,0:07:08.60,0:07:11.36,Default,,0000,0000,0000,,from a little bit of preparatory material
Dialogue: 0,0:07:11.36,0:07:13.43,Default,,0000,0000,0000,,that other students might already have.
Dialogue: 0,0:07:13.43,0:07:15.87,Default,,0000,0000,0000,,Other students might be interested in a particular
Dialogue: 0,0:07:15.87,0:07:18.96,Default,,0000,0000,0000,,enrichment topic that they want to pursue individually.
Dialogue: 0,0:07:18.96,0:07:22.19,Default,,0000,0000,0000,,So this format allows us to break away
Dialogue: 0,0:07:22.19,0:07:25.02,Default,,0000,0000,0000,,from the one-size-fits-all model of education,
Dialogue: 0,0:07:25.02,0:07:29.01,Default,,0000,0000,0000,,and allows students to follow a much more personalized curriculum.
Dialogue: 0,0:07:29.01,0:07:31.35,Default,,0000,0000,0000,,Of course, we all know as educators
Dialogue: 0,0:07:31.35,0:07:34.71,Default,,0000,0000,0000,,that students don't learn by sitting and passively watching videos.
Dialogue: 0,0:07:34.71,0:07:37.66,Default,,0000,0000,0000,,Perhaps one of the biggest components of this effort
Dialogue: 0,0:07:37.66,0:07:40.25,Default,,0000,0000,0000,,is that we need to have students
Dialogue: 0,0:07:40.25,0:07:42.66,Default,,0000,0000,0000,,who practice with the material
Dialogue: 0,0:07:42.66,0:07:45.82,Default,,0000,0000,0000,,in order to really understand it.
Dialogue: 0,0:07:45.82,0:07:49.08,Default,,0000,0000,0000,,There's been a range of studies that demonstrate the importance of this.
Dialogue: 0,0:07:49.08,0:07:51.62,Default,,0000,0000,0000,,This one that appeared in Science last year, for example,
Dialogue: 0,0:07:51.62,0:07:54.45,Default,,0000,0000,0000,,demonstrates that even simple retrieval practice,
Dialogue: 0,0:07:54.45,0:07:57.24,Default,,0000,0000,0000,,where students are just supposed to repeat
Dialogue: 0,0:07:57.24,0:07:58.64,Default,,0000,0000,0000,,what they already learned
Dialogue: 0,0:07:58.64,0:08:00.56,Default,,0000,0000,0000,,gives considerably improved results
Dialogue: 0,0:08:00.56,0:08:02.83,Default,,0000,0000,0000,,on various achievement tests down the line
Dialogue: 0,0:08:02.83,0:08:07.13,Default,,0000,0000,0000,,than many other educational interventions.
Dialogue: 0,0:08:07.13,0:08:10.09,Default,,0000,0000,0000,,We've tried to build in retrieval practice into the platform,
Dialogue: 0,0:08:10.09,0:08:12.35,Default,,0000,0000,0000,,as well as other forms of practice in many ways.
Dialogue: 0,0:08:12.35,0:08:16.49,Default,,0000,0000,0000,,For example, even our videos are not just videos.
Dialogue: 0,0:08:16.49,0:08:18.54,Default,,0000,0000,0000,,Every few minutes, the video pauses
Dialogue: 0,0:08:18.54,0:08:20.69,Default,,0000,0000,0000,,and the students get asked a question.
Dialogue: 0,0:08:20.69,0:08:22.91,Default,,0000,0000,0000,,(Video) SP: ... These four things. Prospect theory, hyperbolic discounting,
Dialogue: 0,0:08:22.91,0:08:25.100,Default,,0000,0000,0000,,status quo bias, base rate bias. They're all well documented.
Dialogue: 0,0:08:25.100,0:08:28.77,Default,,0000,0000,0000,,So they're all well documented deviations from rational behavior.
Dialogue: 0,0:08:28.77,0:08:30.39,Default,,0000,0000,0000,,DK: So here the video pauses,
Dialogue: 0,0:08:30.39,0:08:32.65,Default,,0000,0000,0000,,and the student types in the answer into the box
Dialogue: 0,0:08:32.65,0:08:35.87,Default,,0000,0000,0000,,and submits. Obviously they weren't paying attention.
Dialogue: 0,0:08:35.88,0:08:36.75,Default,,0000,0000,0000,,(Laughter)
Dialogue: 0,0:08:36.75,0:08:38.76,Default,,0000,0000,0000,,So they get to try again,
Dialogue: 0,0:08:38.76,0:08:41.30,Default,,0000,0000,0000,,and this time they got it right.
Dialogue: 0,0:08:41.30,0:08:43.49,Default,,0000,0000,0000,,There's an optional explanation if they want.
Dialogue: 0,0:08:43.49,0:08:47.75,Default,,0000,0000,0000,,And now the video moves on to the next part of the lecture.
Dialogue: 0,0:08:47.75,0:08:49.63,Default,,0000,0000,0000,,This is a kind of simple question
Dialogue: 0,0:08:49.63,0:08:51.71,Default,,0000,0000,0000,,that I as an instructor might ask in class,
Dialogue: 0,0:08:51.71,0:08:54.21,Default,,0000,0000,0000,,but when I ask that kind of a question in class,
Dialogue: 0,0:08:54.21,0:08:55.51,Default,,0000,0000,0000,,80 percent of the students
Dialogue: 0,0:08:55.51,0:08:57.37,Default,,0000,0000,0000,,are still scribbling the last thing I said,
Dialogue: 0,0:08:57.37,0:09:00.70,Default,,0000,0000,0000,,15 percent are zoned out on Facebook,
Dialogue: 0,0:09:00.70,0:09:03.15,Default,,0000,0000,0000,,and then there's the smarty pants in the front row
Dialogue: 0,0:09:03.15,0:09:04.51,Default,,0000,0000,0000,,who blurts out the answer
Dialogue: 0,0:09:04.51,0:09:06.72,Default,,0000,0000,0000,,before anyone else has had a chance to think about it,
Dialogue: 0,0:09:06.72,0:09:09.59,Default,,0000,0000,0000,,and I as the instructor am terribly gratified
Dialogue: 0,0:09:09.59,0:09:11.24,Default,,0000,0000,0000,,that somebody actually knew the answer.
Dialogue: 0,0:09:11.24,0:09:14.03,Default,,0000,0000,0000,,And so the lecture moves on before, really,
Dialogue: 0,0:09:14.03,0:09:17.56,Default,,0000,0000,0000,,most of the students have even noticed that a question had been asked.
Dialogue: 0,0:09:17.56,0:09:20.16,Default,,0000,0000,0000,,Here, every single student
Dialogue: 0,0:09:20.16,0:09:22.95,Default,,0000,0000,0000,,has to engage with the material.
Dialogue: 0,0:09:22.95,0:09:24.88,Default,,0000,0000,0000,,And of course these simple retrieval questions
Dialogue: 0,0:09:24.88,0:09:26.55,Default,,0000,0000,0000,,are not the end of the story.
Dialogue: 0,0:09:26.55,0:09:29.52,Default,,0000,0000,0000,,One needs to build in much more meaningful practice questions,
Dialogue: 0,0:09:29.52,0:09:31.87,Default,,0000,0000,0000,,and one also needs to provide the students with feedback
Dialogue: 0,0:09:31.87,0:09:33.53,Default,,0000,0000,0000,,on those questions.
Dialogue: 0,0:09:33.53,0:09:36.42,Default,,0000,0000,0000,,Now, how do you grade the work of 100,000 students
Dialogue: 0,0:09:36.42,0:09:39.50,Default,,0000,0000,0000,,if you do not have 10,000 TAs?
Dialogue: 0,0:09:39.50,0:09:41.86,Default,,0000,0000,0000,,The answer is, you need to use technology
Dialogue: 0,0:09:41.86,0:09:43.35,Default,,0000,0000,0000,,to do it for you.
Dialogue: 0,0:09:43.35,0:09:46.00,Default,,0000,0000,0000,,Now, fortunately, technology has come a long way,
Dialogue: 0,0:09:46.00,0:09:49.27,Default,,0000,0000,0000,,and we can now grade a range of interesting types of homework.
Dialogue: 0,0:09:49.27,0:09:50.80,Default,,0000,0000,0000,,In addition to multiple choice
Dialogue: 0,0:09:50.80,0:09:53.95,Default,,0000,0000,0000,,and the kinds of short answer questions that you saw in the video,
Dialogue: 0,0:09:53.95,0:09:57.21,Default,,0000,0000,0000,,we can also grade math, mathematical expressions
Dialogue: 0,0:09:57.21,0:09:59.16,Default,,0000,0000,0000,,as well as mathematical derivations.
Dialogue: 0,0:09:59.16,0:10:02.03,Default,,0000,0000,0000,,We can grade models, whether it's
Dialogue: 0,0:10:02.03,0:10:04.21,Default,,0000,0000,0000,,financial models in a business class
Dialogue: 0,0:10:04.21,0:10:07.19,Default,,0000,0000,0000,,or physical models in a science or engineering class
Dialogue: 0,0:10:07.19,0:10:10.94,Default,,0000,0000,0000,,and we can grade some pretty sophisticated programming assignments.
Dialogue: 0,0:10:10.94,0:10:12.86,Default,,0000,0000,0000,,Let me show you one that's actually pretty simple
Dialogue: 0,0:10:12.86,0:10:14.34,Default,,0000,0000,0000,,but fairly visual.
Dialogue: 0,0:10:14.34,0:10:16.81,Default,,0000,0000,0000,,This is from Stanford's Computer Science 101 class,
Dialogue: 0,0:10:16.81,0:10:18.42,Default,,0000,0000,0000,,and the students are supposed to color-correct
Dialogue: 0,0:10:18.42,0:10:20.01,Default,,0000,0000,0000,,that blurry red image.
Dialogue: 0,0:10:20.01,0:10:22.03,Default,,0000,0000,0000,,They're typing their program into the browser,
Dialogue: 0,0:10:22.03,0:10:26.09,Default,,0000,0000,0000,,and you can see they didn't get it quite right, Lady Liberty is still seasick.
Dialogue: 0,0:10:26.09,0:10:29.84,Default,,0000,0000,0000,,And so, the student tries again, and now they got it right, and they're told that,
Dialogue: 0,0:10:29.84,0:10:32.20,Default,,0000,0000,0000,,and they can move on to the next assignment.
Dialogue: 0,0:10:32.20,0:10:35.35,Default,,0000,0000,0000,,This ability to interact actively with the material
Dialogue: 0,0:10:35.35,0:10:37.03,Default,,0000,0000,0000,,and be told when you're right or wrong
Dialogue: 0,0:10:37.03,0:10:40.16,Default,,0000,0000,0000,,is really essential to student learning.
Dialogue: 0,0:10:40.16,0:10:42.43,Default,,0000,0000,0000,,Now, of course we cannot yet grade
Dialogue: 0,0:10:42.43,0:10:45.27,Default,,0000,0000,0000,,the range of work that one needs for all courses.
Dialogue: 0,0:10:45.27,0:10:48.57,Default,,0000,0000,0000,,Specifically, what's lacking is the kind of critical thinking work
Dialogue: 0,0:10:48.57,0:10:50.49,Default,,0000,0000,0000,,that is so essential in such disciplines
Dialogue: 0,0:10:50.49,0:10:54.09,Default,,0000,0000,0000,,as the humanities, the social sciences, business and others.
Dialogue: 0,0:10:54.09,0:10:56.34,Default,,0000,0000,0000,,So we tried to convince, for example,
Dialogue: 0,0:10:56.34,0:10:57.95,Default,,0000,0000,0000,,some of our humanities faculty
Dialogue: 0,0:10:57.95,0:11:00.65,Default,,0000,0000,0000,,that multiple choice was not such a bad strategy.
Dialogue: 0,0:11:00.65,0:11:02.84,Default,,0000,0000,0000,,That didn't go over really well.
Dialogue: 0,0:11:02.84,0:11:05.27,Default,,0000,0000,0000,,So we had to come up with a different solution.
Dialogue: 0,0:11:05.27,0:11:08.35,Default,,0000,0000,0000,,And the solution we ended up using is peer grading.
Dialogue: 0,0:11:08.35,0:11:10.77,Default,,0000,0000,0000,,It turns out that previous studies show,
Dialogue: 0,0:11:10.77,0:11:12.44,Default,,0000,0000,0000,,like this one by Saddler and Good,
Dialogue: 0,0:11:12.44,0:11:14.93,Default,,0000,0000,0000,,that peer grading is a surprisingly effective strategy
Dialogue: 0,0:11:14.93,0:11:18.14,Default,,0000,0000,0000,,for providing reproducible grades.
Dialogue: 0,0:11:18.14,0:11:19.91,Default,,0000,0000,0000,,It was tried only in small classes,
Dialogue: 0,0:11:19.91,0:11:21.40,Default,,0000,0000,0000,,but there it showed, for example,
Dialogue: 0,0:11:21.40,0:11:23.88,Default,,0000,0000,0000,,that these student-assigned grades on the y-axis
Dialogue: 0,0:11:23.88,0:11:25.19,Default,,0000,0000,0000,,are actually very well correlated
Dialogue: 0,0:11:25.19,0:11:27.49,Default,,0000,0000,0000,,with the teacher-assigned grade on the x-axis.
Dialogue: 0,0:11:27.49,0:11:30.65,Default,,0000,0000,0000,,What's even more surprising is that self-grades,
Dialogue: 0,0:11:30.65,0:11:32.96,Default,,0000,0000,0000,,where the students grade their own work critically --
Dialogue: 0,0:11:32.96,0:11:34.70,Default,,0000,0000,0000,,so long as you incentivize them properly
Dialogue: 0,0:11:34.70,0:11:36.64,Default,,0000,0000,0000,,so they can't give themselves a perfect score --
Dialogue: 0,0:11:36.64,0:11:39.83,Default,,0000,0000,0000,,are actually even better correlated with the teacher grades.
Dialogue: 0,0:11:39.83,0:11:41.43,Default,,0000,0000,0000,,And so this is an effective strategy
Dialogue: 0,0:11:41.43,0:11:43.54,Default,,0000,0000,0000,,that can be used for grading at scale,
Dialogue: 0,0:11:43.54,0:11:46.27,Default,,0000,0000,0000,,and is also a useful learning strategy for the students,
Dialogue: 0,0:11:46.27,0:11:48.53,Default,,0000,0000,0000,,because they actually learn from the experience.
Dialogue: 0,0:11:48.53,0:11:53.18,Default,,0000,0000,0000,,So we now have the largest peer-grading pipeline ever devised,
Dialogue: 0,0:11:53.18,0:11:55.68,Default,,0000,0000,0000,,where tens of thousands of students
Dialogue: 0,0:11:55.68,0:11:56.88,Default,,0000,0000,0000,,are grading each other's work,
Dialogue: 0,0:11:56.88,0:11:59.95,Default,,0000,0000,0000,,and quite successfully, I have to say.
Dialogue: 0,0:11:59.95,0:12:02.21,Default,,0000,0000,0000,,But this is not just about students
Dialogue: 0,0:12:02.21,0:12:05.25,Default,,0000,0000,0000,,sitting alone in their living room working through problems.
Dialogue: 0,0:12:05.25,0:12:07.06,Default,,0000,0000,0000,,Around each one of our courses,
Dialogue: 0,0:12:07.06,0:12:09.22,Default,,0000,0000,0000,,a community of students had formed,
Dialogue: 0,0:12:09.22,0:12:11.10,Default,,0000,0000,0000,,a global community of people
Dialogue: 0,0:12:11.10,0:12:13.63,Default,,0000,0000,0000,,around a shared intellectual endeavor.
Dialogue: 0,0:12:13.63,0:12:16.28,Default,,0000,0000,0000,,What you see here is a self-generated map
Dialogue: 0,0:12:16.28,0:12:19.24,Default,,0000,0000,0000,,from students in our Princeton Sociology 101 course,
Dialogue: 0,0:12:19.24,0:12:22.00,Default,,0000,0000,0000,,where they have put themselves on a world map,
Dialogue: 0,0:12:22.00,0:12:24.96,Default,,0000,0000,0000,,and you can really see the global reach of this kind of effort.
Dialogue: 0,0:12:24.96,0:12:29.53,Default,,0000,0000,0000,,Students collaborated in these courses in a variety of different ways.
Dialogue: 0,0:12:29.53,0:12:32.17,Default,,0000,0000,0000,,First of all, there was a question and answer forum,
Dialogue: 0,0:12:32.17,0:12:34.31,Default,,0000,0000,0000,,where students would pose questions,
Dialogue: 0,0:12:34.31,0:12:36.73,Default,,0000,0000,0000,,and other students would answer those questions.
Dialogue: 0,0:12:36.73,0:12:38.45,Default,,0000,0000,0000,,And the really amazing thing is,
Dialogue: 0,0:12:38.45,0:12:40.12,Default,,0000,0000,0000,,because there were so many students,
Dialogue: 0,0:12:40.12,0:12:42.48,Default,,0000,0000,0000,,it means that even if a student posed a question
Dialogue: 0,0:12:42.48,0:12:44.11,Default,,0000,0000,0000,,at 3 o'clock in the morning,
Dialogue: 0,0:12:44.11,0:12:45.70,Default,,0000,0000,0000,,somewhere around the world,
Dialogue: 0,0:12:45.70,0:12:47.77,Default,,0000,0000,0000,,there would be somebody who was awake
Dialogue: 0,0:12:47.77,0:12:50.08,Default,,0000,0000,0000,,and working on the same problem.
Dialogue: 0,0:12:50.08,0:12:52.04,Default,,0000,0000,0000,,And so, in many of our courses,
Dialogue: 0,0:12:52.04,0:12:54.37,Default,,0000,0000,0000,,the median response time for a question
Dialogue: 0,0:12:54.37,0:12:57.79,Default,,0000,0000,0000,,on the question and answer forum was 22 minutes.
Dialogue: 0,0:12:57.79,0:13:02.36,Default,,0000,0000,0000,,Which is not a level of service I have ever offered to my Stanford students.
Dialogue: 0,0:13:02.36,0:13:03.71,Default,,0000,0000,0000,,(Laughter)
Dialogue: 0,0:13:03.71,0:13:05.65,Default,,0000,0000,0000,,And you can see from the student testimonials
Dialogue: 0,0:13:05.65,0:13:07.34,Default,,0000,0000,0000,,that students actually find
Dialogue: 0,0:13:07.34,0:13:09.86,Default,,0000,0000,0000,,that because of this large online community,
Dialogue: 0,0:13:09.86,0:13:12.46,Default,,0000,0000,0000,,they got to interact with each other in many ways
Dialogue: 0,0:13:12.46,0:13:16.65,Default,,0000,0000,0000,,that were deeper than they did in the context of the physical classroom.
Dialogue: 0,0:13:16.65,0:13:18.99,Default,,0000,0000,0000,,Students also self-assembled,
Dialogue: 0,0:13:18.99,0:13:20.86,Default,,0000,0000,0000,,without any kind of intervention from us,
Dialogue: 0,0:13:20.86,0:13:22.76,Default,,0000,0000,0000,,into small study groups.
Dialogue: 0,0:13:22.76,0:13:25.12,Default,,0000,0000,0000,,Some of these were physical study groups
Dialogue: 0,0:13:25.12,0:13:26.95,Default,,0000,0000,0000,,along geographical constraints
Dialogue: 0,0:13:26.95,0:13:29.67,Default,,0000,0000,0000,,and met on a weekly basis to work through problem sets.
Dialogue: 0,0:13:29.67,0:13:31.57,Default,,0000,0000,0000,,This is the San Francisco study group,
Dialogue: 0,0:13:31.57,0:13:33.89,Default,,0000,0000,0000,,but there were ones all over the world.
Dialogue: 0,0:13:33.89,0:13:35.92,Default,,0000,0000,0000,,Others were virtual study groups,
Dialogue: 0,0:13:35.92,0:13:38.91,Default,,0000,0000,0000,,sometimes along language lines or along cultural lines,
Dialogue: 0,0:13:38.91,0:13:40.35,Default,,0000,0000,0000,,and on the bottom left there,
Dialogue: 0,0:13:40.35,0:13:44.15,Default,,0000,0000,0000,,you see our multicultural universal study group
Dialogue: 0,0:13:44.15,0:13:45.91,Default,,0000,0000,0000,,where people explicitly wanted to connect
Dialogue: 0,0:13:45.91,0:13:48.92,Default,,0000,0000,0000,,with people from other cultures.
Dialogue: 0,0:13:48.92,0:13:51.03,Default,,0000,0000,0000,,There are some tremendous opportunities
Dialogue: 0,0:13:51.03,0:13:54.35,Default,,0000,0000,0000,,to be had from this kind of framework.
Dialogue: 0,0:13:54.35,0:13:58.01,Default,,0000,0000,0000,,The first is that it has the potential of giving us
Dialogue: 0,0:13:58.01,0:14:00.44,Default,,0000,0000,0000,,a completely unprecedented look
Dialogue: 0,0:14:00.44,0:14:02.73,Default,,0000,0000,0000,,into understanding human learning.
Dialogue: 0,0:14:02.73,0:14:06.19,Default,,0000,0000,0000,,Because the data that we can collect here is unique.
Dialogue: 0,0:14:06.19,0:14:10.20,Default,,0000,0000,0000,,You can collect every click, every homework submission,
Dialogue: 0,0:14:10.20,0:14:14.56,Default,,0000,0000,0000,,every forum post from tens of thousands of students.
Dialogue: 0,0:14:14.56,0:14:16.91,Default,,0000,0000,0000,,So you can turn the study of human learning
Dialogue: 0,0:14:16.91,0:14:18.84,Default,,0000,0000,0000,,from the hypothesis-driven mode
Dialogue: 0,0:14:18.84,0:14:21.70,Default,,0000,0000,0000,,to the data-driven mode, a transformation that,
Dialogue: 0,0:14:21.70,0:14:24.74,Default,,0000,0000,0000,,for example, has revolutionized biology.
Dialogue: 0,0:14:24.74,0:14:28.16,Default,,0000,0000,0000,,You can use these data to understand fundamental questions
Dialogue: 0,0:14:28.16,0:14:30.04,Default,,0000,0000,0000,,like, what are good learning strategies
Dialogue: 0,0:14:30.04,0:14:32.74,Default,,0000,0000,0000,,that are effective versus ones that are not?
Dialogue: 0,0:14:32.74,0:14:34.98,Default,,0000,0000,0000,,And in the context of particular courses,
Dialogue: 0,0:14:34.98,0:14:36.52,Default,,0000,0000,0000,,you can ask questions
Dialogue: 0,0:14:36.52,0:14:39.77,Default,,0000,0000,0000,,like, what are some of the misconceptions that are more common
Dialogue: 0,0:14:39.77,0:14:41.95,Default,,0000,0000,0000,,and how do we help students fix them?
Dialogue: 0,0:14:41.95,0:14:43.37,Default,,0000,0000,0000,,So here's an example of that,
Dialogue: 0,0:14:43.37,0:14:45.39,Default,,0000,0000,0000,,also from Andrew's Machine Learning class.
Dialogue: 0,0:14:45.39,0:14:47.60,Default,,0000,0000,0000,,This is a distribution of wrong answers
Dialogue: 0,0:14:47.60,0:14:49.21,Default,,0000,0000,0000,,to one of Andrew's assignments.
Dialogue: 0,0:14:49.21,0:14:51.10,Default,,0000,0000,0000,,The answers happen to be pairs of numbers,
Dialogue: 0,0:14:51.10,0:14:53.37,Default,,0000,0000,0000,,so you can draw them on this two-dimensional plot.
Dialogue: 0,0:14:53.37,0:14:57.15,Default,,0000,0000,0000,,Each of the little crosses that you see is a different wrong answer.
Dialogue: 0,0:14:57.15,0:14:59.56,Default,,0000,0000,0000,,The big cross at the top left
Dialogue: 0,0:14:59.56,0:15:01.70,Default,,0000,0000,0000,,is where 2,000 students
Dialogue: 0,0:15:01.70,0:15:04.75,Default,,0000,0000,0000,,gave the exact same wrong answer.
Dialogue: 0,0:15:04.75,0:15:07.08,Default,,0000,0000,0000,,Now, if two students in a class of 100
Dialogue: 0,0:15:07.08,0:15:08.36,Default,,0000,0000,0000,,give the same wrong answer,
Dialogue: 0,0:15:08.36,0:15:09.71,Default,,0000,0000,0000,,you would never notice.
Dialogue: 0,0:15:09.71,0:15:12.27,Default,,0000,0000,0000,,But when 2,000 students give the same wrong answer,
Dialogue: 0,0:15:12.27,0:15:13.97,Default,,0000,0000,0000,,it's kind of hard to miss.
Dialogue: 0,0:15:13.97,0:15:16.16,Default,,0000,0000,0000,,So Andrew and his students went in,
Dialogue: 0,0:15:16.16,0:15:17.68,Default,,0000,0000,0000,,looked at some of those assignments,
Dialogue: 0,0:15:17.68,0:15:21.77,Default,,0000,0000,0000,,understood the root cause of the misconception,
Dialogue: 0,0:15:21.77,0:15:24.29,Default,,0000,0000,0000,,and then they produced a targeted error message
Dialogue: 0,0:15:24.29,0:15:26.54,Default,,0000,0000,0000,,that would be provided to every student
Dialogue: 0,0:15:26.54,0:15:28.72,Default,,0000,0000,0000,,whose answer fell into that bucket,
Dialogue: 0,0:15:28.72,0:15:30.80,Default,,0000,0000,0000,,which means that students who made that same mistake
Dialogue: 0,0:15:30.80,0:15:32.83,Default,,0000,0000,0000,,would now get personalized feedback
Dialogue: 0,0:15:32.83,0:15:37.23,Default,,0000,0000,0000,,telling them how to fix their misconception much more effectively.
Dialogue: 0,0:15:37.23,0:15:41.04,Default,,0000,0000,0000,,So this personalization is something that one can then build
Dialogue: 0,0:15:41.04,0:15:44.18,Default,,0000,0000,0000,,by having the virtue of large numbers.
Dialogue: 0,0:15:44.18,0:15:46.49,Default,,0000,0000,0000,,Personalization is perhaps
Dialogue: 0,0:15:46.49,0:15:48.91,Default,,0000,0000,0000,,one of the biggest opportunities here as well,
Dialogue: 0,0:15:48.91,0:15:51.26,Default,,0000,0000,0000,,because it provides us with the potential
Dialogue: 0,0:15:51.26,0:15:53.95,Default,,0000,0000,0000,,of solving a 30-year-old problem.
Dialogue: 0,0:15:53.95,0:15:57.30,Default,,0000,0000,0000,,Educational researcher Benjamin Bloom, in 1984,
Dialogue: 0,0:15:57.30,0:15:59.55,Default,,0000,0000,0000,,posed what's called the 2 sigma problem,
Dialogue: 0,0:15:59.55,0:16:02.61,Default,,0000,0000,0000,,which he observed by studying three populations.
Dialogue: 0,0:16:02.61,0:16:06.22,Default,,0000,0000,0000,,The first is the population that studied in a lecture-based classroom.
Dialogue: 0,0:16:06.22,0:16:08.100,Default,,0000,0000,0000,,The second is a population of students that studied
Dialogue: 0,0:16:08.100,0:16:10.71,Default,,0000,0000,0000,,using a standard lecture-based classroom,
Dialogue: 0,0:16:10.71,0:16:12.79,Default,,0000,0000,0000,,but with a mastery-based approach,
Dialogue: 0,0:16:12.79,0:16:14.71,Default,,0000,0000,0000,,so the students couldn't move on to the next topic
Dialogue: 0,0:16:14.71,0:16:18.07,Default,,0000,0000,0000,,before demonstrating mastery of the previous one.
Dialogue: 0,0:16:18.07,0:16:20.36,Default,,0000,0000,0000,,And finally, there was a population of students
Dialogue: 0,0:16:20.36,0:16:24.89,Default,,0000,0000,0000,,that were taught in a one-on-one instruction using a tutor.
Dialogue: 0,0:16:24.89,0:16:28.16,Default,,0000,0000,0000,,The mastery-based population was a full standard deviation,
Dialogue: 0,0:16:28.16,0:16:30.45,Default,,0000,0000,0000,,or sigma, in achievement scores better
Dialogue: 0,0:16:30.45,0:16:32.84,Default,,0000,0000,0000,,than the standard lecture-based class,
Dialogue: 0,0:16:32.84,0:16:34.99,Default,,0000,0000,0000,,and the individual tutoring gives you 2 sigma
Dialogue: 0,0:16:34.99,0:16:36.82,Default,,0000,0000,0000,,improvement in performance.
Dialogue: 0,0:16:36.82,0:16:38.28,Default,,0000,0000,0000,,To understand what that means,
Dialogue: 0,0:16:38.28,0:16:40.11,Default,,0000,0000,0000,,let's look at the lecture-based classroom,
Dialogue: 0,0:16:40.11,0:16:43.03,Default,,0000,0000,0000,,and let's pick the median performance as a threshold.
Dialogue: 0,0:16:43.03,0:16:44.37,Default,,0000,0000,0000,,So in a lecture-based class,
Dialogue: 0,0:16:44.37,0:16:48.25,Default,,0000,0000,0000,,half the students are above that level and half are below.
Dialogue: 0,0:16:48.25,0:16:50.35,Default,,0000,0000,0000,,In the individual tutoring instruction,
Dialogue: 0,0:16:50.35,0:16:55.15,Default,,0000,0000,0000,,98 percent of the students are going to be above that threshold.
Dialogue: 0,0:16:55.15,0:16:59.07,Default,,0000,0000,0000,,Imagine if we could teach so that 98 percent of our students
Dialogue: 0,0:16:59.07,0:17:01.27,Default,,0000,0000,0000,,would be above average.
Dialogue: 0,0:17:01.27,0:17:04.69,Default,,0000,0000,0000,,Hence, the 2 sigma problem.
Dialogue: 0,0:17:04.69,0:17:07.09,Default,,0000,0000,0000,,Because we cannot afford, as a society,
Dialogue: 0,0:17:07.09,0:17:10.16,Default,,0000,0000,0000,,to provide every student with an individual human tutor.
Dialogue: 0,0:17:10.16,0:17:12.41,Default,,0000,0000,0000,,But maybe we can afford to provide each student
Dialogue: 0,0:17:12.41,0:17:14.43,Default,,0000,0000,0000,,with a computer or a smartphone.
Dialogue: 0,0:17:14.43,0:17:16.62,Default,,0000,0000,0000,,So the question is, how can we use technology
Dialogue: 0,0:17:16.62,0:17:19.99,Default,,0000,0000,0000,,to push from the left side of the graph, from the blue curve,
Dialogue: 0,0:17:19.99,0:17:22.73,Default,,0000,0000,0000,,to the right side with the green curve?
Dialogue: 0,0:17:22.73,0:17:25.07,Default,,0000,0000,0000,,Mastery is easy to achieve using a computer,
Dialogue: 0,0:17:25.07,0:17:26.47,Default,,0000,0000,0000,,because a computer doesn't get tired
Dialogue: 0,0:17:26.47,0:17:29.55,Default,,0000,0000,0000,,of showing you the same video five times.
Dialogue: 0,0:17:29.55,0:17:32.80,Default,,0000,0000,0000,,And it doesn't even get tired of grading the same work multiple times,
Dialogue: 0,0:17:32.80,0:17:35.83,Default,,0000,0000,0000,,we've seen that in many of the examples that I've shown you.
Dialogue: 0,0:17:35.83,0:17:37.68,Default,,0000,0000,0000,,And even personalization
Dialogue: 0,0:17:37.68,0:17:39.82,Default,,0000,0000,0000,,is something that we're starting to see the beginnings of,
Dialogue: 0,0:17:39.82,0:17:43.01,Default,,0000,0000,0000,,whether it's via the personalized trajectory through the curriculum
Dialogue: 0,0:17:43.01,0:17:46.27,Default,,0000,0000,0000,,or some of the personalized feedback that we've shown you.
Dialogue: 0,0:17:46.27,0:17:48.76,Default,,0000,0000,0000,,So the goal here is to try and push,
Dialogue: 0,0:17:48.76,0:17:52.26,Default,,0000,0000,0000,,and see how far we can get towards the green curve.
Dialogue: 0,0:17:52.26,0:17:57.62,Default,,0000,0000,0000,,So, if this is so great, are universities now obsolete?
Dialogue: 0,0:17:57.62,0:18:00.61,Default,,0000,0000,0000,,Well, Mark Twain certainly thought so.
Dialogue: 0,0:18:00.61,0:18:03.16,Default,,0000,0000,0000,,He said that, "College is a place where a professor's lecture notes
Dialogue: 0,0:18:03.16,0:18:04.86,Default,,0000,0000,0000,,go straight to the students' lecture notes,
Dialogue: 0,0:18:04.86,0:18:07.23,Default,,0000,0000,0000,,without passing through the brains of either."
Dialogue: 0,0:18:07.23,0:18:11.28,Default,,0000,0000,0000,,(Laughter)
Dialogue: 0,0:18:11.28,0:18:13.95,Default,,0000,0000,0000,,I beg to differ with Mark Twain, though.
Dialogue: 0,0:18:13.95,0:18:16.61,Default,,0000,0000,0000,,I think what he was complaining about is not
Dialogue: 0,0:18:16.61,0:18:19.36,Default,,0000,0000,0000,,universities but rather the lecture-based format
Dialogue: 0,0:18:19.36,0:18:22.15,Default,,0000,0000,0000,,that so many universities spend so much time on.
Dialogue: 0,0:18:22.15,0:18:25.31,Default,,0000,0000,0000,,So let's go back even further, to Plutarch,
Dialogue: 0,0:18:25.31,0:18:27.53,Default,,0000,0000,0000,,who said that, "The mind is not a vessel that needs filling,
Dialogue: 0,0:18:27.53,0:18:29.56,Default,,0000,0000,0000,,but wood that needs igniting."
Dialogue: 0,0:18:29.56,0:18:31.75,Default,,0000,0000,0000,,And maybe we should spend less time at universities
Dialogue: 0,0:18:31.75,0:18:34.32,Default,,0000,0000,0000,,filling our students' minds with content
Dialogue: 0,0:18:34.32,0:18:38.12,Default,,0000,0000,0000,,by lecturing at them, and more time igniting their creativity,
Dialogue: 0,0:18:38.12,0:18:41.37,Default,,0000,0000,0000,,their imagination and their problem-solving skills
Dialogue: 0,0:18:41.37,0:18:43.87,Default,,0000,0000,0000,,by actually talking with them.
Dialogue: 0,0:18:43.87,0:18:45.24,Default,,0000,0000,0000,,So how do we do that?
Dialogue: 0,0:18:45.24,0:18:48.67,Default,,0000,0000,0000,,We do that by doing active learning in the classroom.
Dialogue: 0,0:18:48.67,0:18:51.12,Default,,0000,0000,0000,,So there's been many studies, including this one,
Dialogue: 0,0:18:51.12,0:18:53.20,Default,,0000,0000,0000,,that show that if you use active learning,
Dialogue: 0,0:18:53.20,0:18:55.61,Default,,0000,0000,0000,,interacting with your students in the classroom,
Dialogue: 0,0:18:55.61,0:18:58.31,Default,,0000,0000,0000,,performance improves on every single metric --
Dialogue: 0,0:18:58.31,0:19:00.76,Default,,0000,0000,0000,,on attendance, on engagement and on learning
Dialogue: 0,0:19:00.76,0:19:02.81,Default,,0000,0000,0000,,as measured by a standardized test.
Dialogue: 0,0:19:02.81,0:19:04.68,Default,,0000,0000,0000,,You can see, for example, that the achievement score
Dialogue: 0,0:19:04.68,0:19:07.55,Default,,0000,0000,0000,,almost doubles in this particular experiment.
Dialogue: 0,0:19:07.55,0:19:11.95,Default,,0000,0000,0000,,So maybe this is how we should spend our time at universities.
Dialogue: 0,0:19:11.95,0:19:16.53,Default,,0000,0000,0000,,So to summarize, if we could offer a top quality education
Dialogue: 0,0:19:16.53,0:19:18.43,Default,,0000,0000,0000,,to everyone around the world for free,
Dialogue: 0,0:19:18.43,0:19:21.25,Default,,0000,0000,0000,,what would that do? Three things.
Dialogue: 0,0:19:21.25,0:19:24.67,Default,,0000,0000,0000,,First it would establish education as a fundamental human right,
Dialogue: 0,0:19:24.67,0:19:26.04,Default,,0000,0000,0000,,where anyone around the world
Dialogue: 0,0:19:26.04,0:19:27.96,Default,,0000,0000,0000,,with the ability and the motivation
Dialogue: 0,0:19:27.96,0:19:29.91,Default,,0000,0000,0000,,could get the skills that they need
Dialogue: 0,0:19:29.91,0:19:31.49,Default,,0000,0000,0000,,to make a better life for themselves,
Dialogue: 0,0:19:31.49,0:19:33.51,Default,,0000,0000,0000,,their families and their communities.
Dialogue: 0,0:19:33.51,0:19:36.14,Default,,0000,0000,0000,,Second, it would enable lifelong learning.
Dialogue: 0,0:19:36.14,0:19:38.09,Default,,0000,0000,0000,,It's a shame that for so many people,
Dialogue: 0,0:19:38.09,0:19:41.40,Default,,0000,0000,0000,,learning stops when we finish high school or when we finish college.
Dialogue: 0,0:19:41.40,0:19:43.89,Default,,0000,0000,0000,,By having this amazing content be available,
Dialogue: 0,0:19:43.89,0:19:46.63,Default,,0000,0000,0000,,we would be able to learn something new
Dialogue: 0,0:19:46.63,0:19:47.76,Default,,0000,0000,0000,,every time we wanted,
Dialogue: 0,0:19:47.76,0:19:49.09,Default,,0000,0000,0000,,whether it's just to expand our minds
Dialogue: 0,0:19:49.09,0:19:51.05,Default,,0000,0000,0000,,or it's to change our lives.
Dialogue: 0,0:19:51.05,0:19:54.20,Default,,0000,0000,0000,,And finally, this would enable a wave of innovation,
Dialogue: 0,0:19:54.20,0:19:57.27,Default,,0000,0000,0000,,because amazing talent can be found anywhere.
Dialogue: 0,0:19:57.27,0:20:00.28,Default,,0000,0000,0000,,Maybe the next Albert Einstein or the next Steve Jobs
Dialogue: 0,0:20:00.28,0:20:02.89,Default,,0000,0000,0000,,is living somewhere in a remote village in Africa.
Dialogue: 0,0:20:02.89,0:20:05.55,Default,,0000,0000,0000,,And if we could offer that person an education,
Dialogue: 0,0:20:05.55,0:20:07.90,Default,,0000,0000,0000,,they would be able to come up with the next big idea
Dialogue: 0,0:20:07.90,0:20:10.31,Default,,0000,0000,0000,,and make the world a better place for all of us.
Dialogue: 0,0:20:10.31,0:20:11.47,Default,,0000,0000,0000,,Thank you very much.
Dialogue: 0,0:20:11.47,0:20:19.05,Default,,0000,0000,0000,,(Applause)