[Script Info]
Title: 
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:00.39,0:00:03.14,Default,,0000,0000,0000,,I've talked about one very impressive\Nstudy by John Hattie.
Dialogue: 0,0:00:03.14,0:00:07.04,Default,,0000,0000,0000,,He collected data for years where each of\Nhis data points
Dialogue: 0,0:00:07.04,0:00:10.63,Default,,0000,0000,0000,,was itself the result of another study\Nthat took a long time.
Dialogue: 0,0:00:10.63,0:00:11.32,Default,,0000,0000,0000,,That's a lot of work.
Dialogue: 0,0:00:12.63,0:00:14.73,Default,,0000,0000,0000,,I want to explain to you how MOOCs offer\Nthe
Dialogue: 0,0:00:14.73,0:00:18.41,Default,,0000,0000,0000,,opportunity to do all these studies much\Nmore quickly and efficiently.
Dialogue: 0,0:00:19.64,0:00:23.51,Default,,0000,0000,0000,,The first thing to know is every single\Nclick on the major platforms is tracked.
Dialogue: 0,0:00:24.85,0:00:27.22,Default,,0000,0000,0000,,If you were to pause the video now, they\Nwould know.
Dialogue: 0,0:00:27.22,0:00:30.72,Default,,0000,0000,0000,,If you are watching this accelerated, they\Nknow it as well.
Dialogue: 0,0:00:30.72,0:00:34.19,Default,,0000,0000,0000,,They also know how often a student posts\Non the
Dialogue: 0,0:00:34.19,0:00:36.86,Default,,0000,0000,0000,,forum or how many time they try to post\Nquestions.
Dialogue: 0,0:00:38.13,0:00:40.85,Default,,0000,0000,0000,,All these days I analysed, some of the\Nsmartest brain
Dialogue: 0,0:00:40.85,0:00:42.95,Default,,0000,0000,0000,,in the world, actually try to make sense\Nout of it.
Dialogue: 0,0:00:44.46,0:00:47.62,Default,,0000,0000,0000,,The question, the big question is, what\Nworks best for teaching online?
Dialogue: 0,0:00:47.62,0:00:51.89,Default,,0000,0000,0000,,And maybe even what works best for\Nteaching?
Dialogue: 0,0:00:51.89,0:00:54.22,Default,,0000,0000,0000,,A video of a talking head, beamer slides\Nwith
Dialogue: 0,0:00:54.22,0:00:58.79,Default,,0000,0000,0000,,an insert of the instructor, or maybe\Nwithout the instructor.
Dialogue: 0,0:00:58.79,0:01:00.24,Default,,0000,0000,0000,,Some guy's paper cutouts.
Dialogue: 0,0:01:01.37,0:01:01.61,Default,,0000,0000,0000,,Who knows?
Dialogue: 0,0:01:01.61,0:01:05.45,Default,,0000,0000,0000,,This data is analysed, and it's not a\Nsample size of n equals 20.
Dialogue: 0,0:01:05.45,0:01:07.17,Default,,0000,0000,0000,,But, it's more like n equals two million.
Dialogue: 0,0:01:08.85,0:01:11.11,Default,,0000,0000,0000,,I'm tried to give you a flavor of what is\Nalready possible.
Dialogue: 0,0:01:12.22,0:01:14.35,Default,,0000,0000,0000,,Let's start with a concrete situation.
Dialogue: 0,0:01:14.35,0:01:17.41,Default,,0000,0000,0000,,Let's say you have an ad for a cool\Nproject to change the world.
Dialogue: 0,0:01:17.41,0:01:19.19,Default,,0000,0000,0000,,You want people to help you.
Dialogue: 0,0:01:19.19,0:01:22.22,Default,,0000,0000,0000,,So you write a flyer that say, what to\Nchange the world.
Dialogue: 0,0:01:22.22,0:01:23.69,Default,,0000,0000,0000,,Come and join me at this day and place.
Dialogue: 0,0:01:25.09,0:01:26.91,Default,,0000,0000,0000,,You know that that's not enough to attract\Npeople.
Dialogue: 0,0:01:26.91,0:01:28.68,Default,,0000,0000,0000,,So you want to had, to add a hook before.
Dialogue: 0,0:01:28.68,0:01:32.74,Default,,0000,0000,0000,,You don't want, you don't know for sure\Nwhat to put in.
Dialogue: 0,0:01:32.74,0:01:38.48,Default,,0000,0000,0000,,You think maybe, the line, want cookies,\Nor, want pizza, might attract people.
Dialogue: 0,0:01:38.48,0:01:43.04,Default,,0000,0000,0000,,But what will grab people's attention and\Nattract people to your purchase/?
Dialogue: 0,0:01:43.04,0:01:45.91,Default,,0000,0000,0000,,You don't know, And, in the real world,\Nyou wont know.
Dialogue: 0,0:01:45.91,0:01:47.90,Default,,0000,0000,0000,,Unless you try both in parallel, and
Dialogue: 0,0:01:47.90,0:01:51.30,Default,,0000,0000,0000,,see afterwards which one is most suc-,\Nsuccessful.
Dialogue: 0,0:01:51.30,0:01:52.23,Default,,0000,0000,0000,,How do you do that?
Dialogue: 0,0:01:52.23,0:01:54.96,Default,,0000,0000,0000,,Well, by interviewing the people who show\Nup.
Dialogue: 0,0:01:54.96,0:01:56.96,Default,,0000,0000,0000,,This takes time ,and again, it doesn't\Nscale well.
Dialogue: 0,0:01:58.35,0:02:00.71,Default,,0000,0000,0000,,Let's say now your Google, you'll\Nliterally
Dialogue: 0,0:02:00.71,0:02:03.68,Default,,0000,0000,0000,,make millions of dollars of revenue per\Nhour.
Dialogue: 0,0:02:03.68,0:02:06.65,Default,,0000,0000,0000,,Most of it through people clicking on ads\Nin the sidebar.
Dialogue: 0,0:02:08.01,0:02:09.42,Default,,0000,0000,0000,,One of your employees thinks that a
Dialogue: 0,0:02:09.42,0:02:12.22,Default,,0000,0000,0000,,particular shade of green will definitely\Nhelp
Dialogue: 0,0:02:12.22,0:02:16.26,Default,,0000,0000,0000,,highlight the ads, but not too much so\Nthat it doesn't bother the users.
Dialogue: 0,0:02:17.61,0:02:21.99,Default,,0000,0000,0000,,You as Google want to try it, because you\Nknow there is a lot of money there.
Dialogue: 0,0:02:21.99,0:02:24.84,Default,,0000,0000,0000,,But you are afraid of changing something\Nthat works pretty well already.
Dialogue: 0,0:02:24.84,0:02:28.71,Default,,0000,0000,0000,,So what you can do is to pick a random 10%\Nof the users
Dialogue: 0,0:02:28.71,0:02:34.75,Default,,0000,0000,0000,,of a random small country, say, Belgium,\Nand show to them that new green shape.
Dialogue: 0,0:02:35.81,0:02:37.84,Default,,0000,0000,0000,,And then you can compare those users to
Dialogue: 0,0:02:37.84,0:02:40.11,Default,,0000,0000,0000,,other users, where the experiment was not\Nperformed.
Dialogue: 0,0:02:41.14,0:02:42.83,Default,,0000,0000,0000,,Maybe you can also pick another country.
Dialogue: 0,0:02:42.83,0:02:48.37,Default,,0000,0000,0000,,Say, the Netherlands, and do the same\Nexperiment with another color, say orange.
Dialogue: 0,0:02:48.37,0:02:51.47,Default,,0000,0000,0000,,Or you can try changing the size of the\Nads, or all at
Dialogue: 0,0:02:51.47,0:02:53.77,Default,,0000,0000,0000,,the same time, fitting each user into
Dialogue: 0,0:02:53.77,0:02:57.28,Default,,0000,0000,0000,,their own highly individualized blend of\Nexperiments.
Dialogue: 0,0:02:57.28,0:03:00.69,Default,,0000,0000,0000,,As long as you can extract meaningful\Ndata, why wouldn't you do it?
Dialogue: 0,0:03:01.84,0:03:03.23,Default,,0000,0000,0000,,Well that's what Google does.
Dialogue: 0,0:03:03.23,0:03:07.72,Default,,0000,0000,0000,,Every time you go on Google hundreds of\Nexperiments are actually performed on you.
Dialogue: 0,0:03:07.72,0:03:11.01,Default,,0000,0000,0000,,The page you get for a particular search,\Nis slightly different
Dialogue: 0,0:03:11.01,0:03:14.89,Default,,0000,0000,0000,,from the page offered to anyone else for\Nthe same search.
Dialogue: 0,0:03:14.89,0:03:16.25,Default,,0000,0000,0000,,And they try to optimize that page for\Nyou.
Dialogue: 0,0:03:16.25,0:03:22.16,Default,,0000,0000,0000,,This is called A/B testing, and it's used\Nextensively to optimize the web.
Dialogue: 0,0:03:23.28,0:03:24.96,Default,,0000,0000,0000,,I know it sounds silly to talk about this
Dialogue: 0,0:03:24.96,0:03:27.28,Default,,0000,0000,0000,,for education but I don't think it really\Nis silly.
Dialogue: 0,0:03:28.74,0:03:32.59,Default,,0000,0000,0000,,Many blackboards are dyed green because\Nsome tests were performed a long
Dialogue: 0,0:03:32.59,0:03:35.51,Default,,0000,0000,0000,,time ago and people figure out this was\Nbetter for the eyes.
Dialogue: 0,0:03:35.51,0:03:40.00,Default,,0000,0000,0000,,You can see the similarity with Google's\Nexperiment there.
Dialogue: 0,0:03:40.00,0:03:41.65,Default,,0000,0000,0000,,Many more studies have been done since
Dialogue: 0,0:03:41.65,0:03:44.38,Default,,0000,0000,0000,,in education to try and improve other\Nfactors.
Dialogue: 0,0:03:44.38,0:03:46.60,Default,,0000,0000,0000,,My be more meaningful than just a\Nblackboard color.
Dialogue: 0,0:03:46.60,0:03:49.89,Default,,0000,0000,0000,,But this is slow and requires lots of\Nmanual work.
Dialogue: 0,0:03:51.01,0:03:54.20,Default,,0000,0000,0000,,Again, similar studies can be done in a\NMOOC space, but
Dialogue: 0,0:03:54.20,0:03:57.39,Default,,0000,0000,0000,,actually much more is possible, much\Nfaster, and much more efficiently.
Dialogue: 0,0:03:59.02,0:04:01.06,Default,,0000,0000,0000,,For instance, you can alter the material
Dialogue: 0,0:04:01.06,0:04:03.59,Default,,0000,0000,0000,,presented to the students in very subtle\Nways.
Dialogue: 0,0:04:03.59,0:04:05.33,Default,,0000,0000,0000,,And see what has an effect and what does\Nnot.
Dialogue: 0,0:04:06.56,0:04:08.81,Default,,0000,0000,0000,,So let's say you split your class in
Dialogue: 0,0:04:08.81,0:04:11.96,Default,,0000,0000,0000,,two, and measured how effective it\Nactually is to
Dialogue: 0,0:04:11.96,0:04:17.18,Default,,0000,0000,0000,,start a class with a little preview of the\Nproblem that you want to solve at the end.
Dialogue: 0,0:04:17.18,0:04:21.37,Default,,0000,0000,0000,,This could be effortless by the teacher,\Nor someone doing educational research.
Dialogue: 0,0:04:22.93,0:04:26.39,Default,,0000,0000,0000,,The technology to perform these studies\Nexists, and is well understood.
Dialogue: 0,0:04:26.39,0:04:28.69,Default,,0000,0000,0000,,Because it was used extensively in other\Nindustries
Dialogue: 0,0:04:28.69,0:04:31.18,Default,,0000,0000,0000,,before, and is now being applied to\Neducation.
Dialogue: 0,0:04:32.42,0:04:34.87,Default,,0000,0000,0000,,Some conferences are starting on these\Ntopics and releasing
Dialogue: 0,0:04:34.87,0:04:38.59,Default,,0000,0000,0000,,lots of insight into what works and what\Ndoes not.
Dialogue: 0,0:04:38.59,0:04:43.56,Default,,0000,0000,0000,,It's hard to argue when someone comes with\Na study conducted on millions of students.
Dialogue: 0,0:04:43.56,0:04:48.89,Default,,0000,0000,0000,,You ask for a follow up and six months\Nlater, they come back with that follow up.
Dialogue: 0,0:04:48.89,0:04:52.02,Default,,0000,0000,0000,,This is tremendously accelerating for\Neducation, and very exciting.