06 Educational Analytics [Massive Teaching]
-
0:00 - 0:03I've talked about one very impressive
study by John Hattie. -
0:03 - 0:07He collected data for years where each of
his data points -
0:07 - 0:11was itself the result of another study
that took a long time. -
0:11 - 0:11That's a lot of work.
-
0:13 - 0:15I want to explain to you how MOOCs offer
the -
0:15 - 0:18opportunity to do all these studies much
more quickly and efficiently. -
0:20 - 0:24The first thing to know is every single
click on the major platforms is tracked. -
0:25 - 0:27If you were to pause the video now, they
would know. -
0:27 - 0:31If you are watching this accelerated, they
know it as well. -
0:31 - 0:34They also know how often a student posts
on the -
0:34 - 0:37forum or how many time they try to post
questions. -
0:38 - 0:41All these days I analysed, some of the
smartest brain -
0:41 - 0:43in the world, actually try to make sense
out of it. -
0:44 - 0:48The question, the big question is, what
works best for teaching online? -
0:48 - 0:52And maybe even what works best for
teaching? -
0:52 - 0:54A video of a talking head, beamer slides
with -
0:54 - 0:59an insert of the instructor, or maybe
without the instructor. -
0:59 - 1:00Some guy's paper cutouts.
-
1:01 - 1:02Who knows?
-
1:02 - 1:05This data is analysed, and it's not a
sample size of n equals 20. -
1:05 - 1:07But, it's more like n equals two million.
-
1:09 - 1:11I'm tried to give you a flavor of what is
already possible. -
1:12 - 1:14Let's start with a concrete situation.
-
1:14 - 1:17Let's say you have an ad for a cool
project to change the world. -
1:17 - 1:19You want people to help you.
-
1:19 - 1:22So you write a flyer that say, what to
change the world. -
1:22 - 1:24Come and join me at this day and place.
-
1:25 - 1:27You know that that's not enough to attract
people. -
1:27 - 1:29So you want to had, to add a hook before.
-
1:29 - 1:33You don't want, you don't know for sure
what to put in. -
1:33 - 1:38You think maybe, the line, want cookies,
or, want pizza, might attract people. -
1:38 - 1:43But what will grab people's attention and
attract people to your purchase/? -
1:43 - 1:46You don't know, And, in the real world,
you wont know. -
1:46 - 1:48Unless you try both in parallel, and
-
1:48 - 1:51see afterwards which one is most suc-,
successful. -
1:51 - 1:52How do you do that?
-
1:52 - 1:55Well, by interviewing the people who show
up. -
1:55 - 1:57This takes time ,and again, it doesn't
scale well. -
1:58 - 2:01Let's say now your Google, you'll
literally -
2:01 - 2:04make millions of dollars of revenue per
hour. -
2:04 - 2:07Most of it through people clicking on ads
in the sidebar. -
2:08 - 2:09One of your employees thinks that a
-
2:09 - 2:12particular shade of green will definitely
help -
2:12 - 2:16highlight the ads, but not too much so
that it doesn't bother the users. -
2:18 - 2:22You as Google want to try it, because you
know there is a lot of money there. -
2:22 - 2:25But you are afraid of changing something
that works pretty well already. -
2:25 - 2:29So what you can do is to pick a random 10%
of the users -
2:29 - 2:35of a random small country, say, Belgium,
and show to them that new green shape. -
2:36 - 2:38And then you can compare those users to
-
2:38 - 2:40other users, where the experiment was not
performed. -
2:41 - 2:43Maybe you can also pick another country.
-
2:43 - 2:48Say, the Netherlands, and do the same
experiment with another color, say orange. -
2:48 - 2:51Or you can try changing the size of the
ads, or all at -
2:51 - 2:54the same time, fitting each user into
-
2:54 - 2:57their own highly individualized blend of
experiments. -
2:57 - 3:01As long as you can extract meaningful
data, why wouldn't you do it? -
3:02 - 3:03Well that's what Google does.
-
3:03 - 3:08Every time you go on Google hundreds of
experiments are actually performed on you. -
3:08 - 3:11The page you get for a particular search,
is slightly different -
3:11 - 3:15from the page offered to anyone else for
the same search. -
3:15 - 3:16And they try to optimize that page for
you. -
3:16 - 3:22This is called A/B testing, and it's used
extensively to optimize the web. -
3:23 - 3:25I know it sounds silly to talk about this
-
3:25 - 3:27for education but I don't think it really
is silly. -
3:29 - 3:33Many blackboards are dyed green because
some tests were performed a long -
3:33 - 3:36time ago and people figure out this was
better for the eyes. -
3:36 - 3:40You can see the similarity with Google's
experiment there. -
3:40 - 3:42Many more studies have been done since
-
3:42 - 3:44in education to try and improve other
factors. -
3:44 - 3:47My be more meaningful than just a
blackboard color. -
3:47 - 3:50But this is slow and requires lots of
manual work. -
3:51 - 3:54Again, similar studies can be done in a
MOOC space, but -
3:54 - 3:57actually much more is possible, much
faster, and much more efficiently. -
3:59 - 4:01For instance, you can alter the material
-
4:01 - 4:04presented to the students in very subtle
ways. -
4:04 - 4:05And see what has an effect and what does
not. -
4:07 - 4:09So let's say you split your class in
-
4:09 - 4:12two, and measured how effective it
actually is to -
4:12 - 4:17start a class with a little preview of the
problem that you want to solve at the end. -
4:17 - 4:21This could be effortless by the teacher,
or someone doing educational research. -
4:23 - 4:26The technology to perform these studies
exists, and is well understood. -
4:26 - 4:29Because it was used extensively in other
industries -
4:29 - 4:31before, and is now being applied to
education. -
4:32 - 4:35Some conferences are starting on these
topics and releasing -
4:35 - 4:39lots of insight into what works and what
does not. -
4:39 - 4:44It's hard to argue when someone comes with
a study conducted on millions of students. -
4:44 - 4:49You ask for a follow up and six months
later, they come back with that follow up. -
4:49 - 4:52This is tremendously accelerating for
education, and very exciting.
- Title:
- 06 Educational Analytics [Massive Teaching]
- Description:
-
Original description:
Sample video for the course #MassiveTeaching on Coursera
Starts June 23rd 2014https://www.coursera.org/course/massiveteaching
-------
Note:
From Week 1 Lecture Videos of "Teaching goes massive: new skills required"
by Paul-Olivier Dehaye
See
https://etherpad.mozilla.org/pr8ZtLXODg
and
http://www.elearnspace.org/blog/2014/07/09/congrats-to-paul-olivier-dehaye-massiveteaching/ - Video Language:
- English
- Team:
- Captions Requested
- Duration:
- 04:53
Claude Almansi edited English subtitles for 06 Educational Analytics [Massive Teaching] | ||
Claude Almansi edited English subtitles for 06 Educational Analytics [Massive Teaching] | ||
Claude Almansi edited English subtitles for 06 Educational Analytics [Massive Teaching] |