-
Not Synced
So over the past few centuries,
-
Not Synced
microscopes have revolutionized our world.
-
Not Synced
They revealed to us a tiny world
-
Not Synced
of objects, life, and structures
-
Not Synced
that are too small for us
to see with our naked eyes.
-
Not Synced
They are a tremendous contribution
to science and technology.
-
Not Synced
Today I'd like to introduce you
to a new type of microscope,
-
Not Synced
a microscope for changes.
-
Not Synced
It doesn't use optics
like a regular microscope
-
Not Synced
to make small objects bigger,
-
Not Synced
but instead it uses a video camera
-
Not Synced
and image processing
-
Not Synced
to reveal to us the tiniest motions
-
Not Synced
and color changes in objects and people,
-
Not Synced
changes that are impossible
for us to see with our naked eyes,
-
Not Synced
and it lets us look at our world
-
Not Synced
in a completely new way.
-
Not Synced
So what do I mean by color changes?
-
Not Synced
Our skin, for example,
changes its color very slightly
-
Not Synced
when the blood flows under it.
-
Not Synced
That change is incredibly subtle,
-
Not Synced
which is why, when you
look at other people,
-
Not Synced
when you look at the person
sitting next to you,
-
Not Synced
you don't see their skin
or their face changing color.
-
Not Synced
When we look at
this video of Steve here,
-
Not Synced
it appears to us like a static picture,
-
Not Synced
but once we look at this video
through our new, special microscope,
-
Not Synced
suddenly we see
a completely different image.
-
Not Synced
What you see here are small changes
-
Not Synced
in the color of Steve's skin,
-
Not Synced
magnified 100 times
-
Not Synced
so that they become visible.
-
Not Synced
We can actually see a human pulse.
-
Not Synced
We can see how fast
Steve's heart is beating,
-
Not Synced
but we can also see the actual way
-
Not Synced
that the blood flows in his face.
-
Not Synced
And we can do that not just
to visualize the pulse
-
Not Synced
but also to actually
measure our heart rates,
-
Not Synced
and we can do it with regular cameras
-
Not Synced
and without touching the patients.
-
Not Synced
So here you see the pulse and heart rate
-
Not Synced
we extracted from a neonatal baby
-
Not Synced
from a video we took
with a regular DSLR camera,
-
Not Synced
and the heart rate measurement we get
-
Not Synced
is as accurate as the one you'd get
-
Not Synced
with a standard monitor in a hospital.
-
Not Synced
And it doesn't even have to be
a video we recorded.
-
Not Synced
We can do it essentially
with other videos as well.
-
Not Synced
So I just took a short clip
from "Batman Begins" here
-
Not Synced
just to show Christian Bale's pulse.
-
Not Synced
(Laughter)
-
Not Synced
And you know, presumably
he's wearing makeup,
-
Not Synced
the lighting here is kind of challenging,
-
Not Synced
but still, just from the video,
we're able to extract his pulse
-
Not Synced
and show it quite well.
-
Not Synced
So how do we do all that?
-
Not Synced
We basically analyze the changes
-
Not Synced
in the light that's recorded
-
Not Synced
at every pixel in the video over time,
-
Not Synced
and then we crank up those changes.
-
Not Synced
We make them bigger
so that we can see them.
-
Not Synced
The tricky part is that those signals,
-
Not Synced
those changes that we're after,
-
Not Synced
are extremely subtle,
-
Not Synced
so we have to be very careful
when you try to separate them
-
Not Synced
from noise that always exists in videos.
-
Not Synced
So we use some clever
image processing techniques
-
Not Synced
to get a very accurate measurement
of the color at each pixel in the video,
-
Not Synced
and then the way the color
changes over time,
-
Not Synced
and then we amplify those changes.
-
Not Synced
We make them bigger to create those types
of enhanced videos, or magnified videos,
-
Not Synced
that actually show us those changes.
-
Not Synced
But it turns out we can do that
-
Not Synced
not just to show tiny changes in color
-
Not Synced
but also tiny motions,
-
Not Synced
and that's because the light
that gets recorded in our cameras
-
Not Synced
will change not only if the color
of the object changes,
-
Not Synced
but also if the object moves.
-
Not Synced
So this is my daughter
-
Not Synced
when she was about two months old.
-
Not Synced
It's a video I recorded
about three years ago.
-
Not Synced
And as new parents, we all want
to make sure our babies are healthy,
-
Not Synced
that they're breathing,
that they're alive of course.
-
Not Synced
So I too got one of those baby monitors
-
Not Synced
so that I could see my daughter
when she was asleep.
-
Not Synced
And this is pretty much what you'll see
-
Not Synced
with a standard baby monitor.
-
Not Synced
You know, you can see the baby's sleeping,
-
Not Synced
but there's not too much
information there.
-
Not Synced
There's not too much we can see.
-
Not Synced
Wouldn't it be better,
-
Not Synced
or more informative, or more useful,
-
Not Synced
if instead we could look
at the view like this.
-
Not Synced
So here I took the motions
-
Not Synced
and I magnified them 30 times,
-
Not Synced
and then I could clearly see that my
daughter was indeed alive and breathing.
-
Not Synced
(Laughter)
-
Not Synced
Here is a side by side comparison.
-
Not Synced
So again, in the source video,
in the original video,
-
Not Synced
there's not too much we can see,
-
Not Synced
but once we magnify the motions,
-
Not Synced
the breathing becomes much more visible.
-
Not Synced
And it turns out, there's
a lot of phenomena
-
Not Synced
we can reveal and magnify
-
Not Synced
with our new motion microscope.
-
Not Synced
We can see how our veins and arteries
-
Not Synced
are pulsing in our bodies.
-
Not Synced
We can see that our eyes
-
Not Synced
are constantly moving
in this wobbly motion.
-
Not Synced
And that's actually my eye,
-
Not Synced
and again this video was taken
right after my daughter was born,
-
Not Synced
so you can see I was not
getting too much sleep.
-
Not Synced
Even when a person is sitting still,
-
Not Synced
there's a lot of information
we can extract
-
Not Synced
about their breathing patterns,
small facial expressions.
-
Not Synced
Maybe we could use those motions
-
Not Synced
to tell us something about
our thoughts or our emotions.
-
Not Synced
We can also magnify small
mechanical movements,
-
Not Synced
like vibrations in engines,
-
Not Synced
that can help engineers detect
and diagnose machinery problems,
-
Not Synced
or see how our buildings and structures
-
Not Synced
sway in the wind and react to forces.
-
Not Synced
Those are all things that our society
-
Not Synced
knows how to measure in various ways,
-
Not Synced
but measuring those motions is one thing,
-
Not Synced
and actually seeing those
motions as they happen
-
Not Synced
is a whole different thing.
-
Not Synced
And ever since we discovered
this new technology,
-
Not Synced
we made our code available online
-
Not Synced
so that others could use
and experiment with it.
-
Not Synced
It's very simple to use.
-
Not Synced
It can work on your own videos.
-
Not Synced
Our collaborators at Quantum Research
even created this nice website
-
Not Synced
where you can upload your videos
and process them online,
-
Not Synced
so even if you don't have any experience
-
Not Synced
in computer science or programming,
-
Not Synced
you can still very easily experiment
with this new microscope.
-
Not Synced
And I'd like to show you
just a couple of examples
-
Not Synced
of what others have done with it.
-
Not Synced
So this video was made by
a YouTube user called Tamez85.
-
Not Synced
I don't know who that user is,
-
Not Synced
but he, or she, used our code
-
Not Synced
to magnify small belly
movements during pregnancy.
-
Not Synced
It's kind of creepy.
-
Not Synced
(Laughter)
-
Not Synced
People have used it to magnify
-
Not Synced
pulsing veins in their hands,
-
Not Synced
and you know, it's not real science
unless you use guinea pigs,
-
Not Synced
and apparently this guinea pig
is called Tiffany,
-
Not Synced
and this YouTube user claims
it is the first rodent on Earth
-
Not Synced
that was motion-magnified.
-
Not Synced
You can also do some art with it.
-
Not Synced
So this video was sent to me
by a design student at Yale.
-
Not Synced
she wanted to see
if there's any difference
-
Not Synced
in the way her classmates move.
-
Not Synced
She made them all stand still,
-
Not Synced
and then magnified their motions
-
Not Synced
It's like seeing still pictures
-
Not Synced
come to life.
Yasushi Aoki
108
00:05:30,708 --> 00:05:33,901
Our collaborators at Quantum Research
even created this nice website
->
Our collaborators at Quanta Research
even created this nice website
# See https://videoscope.qrilab.com/
114
00:05:48,470 --> 00:05:53,787
So this video was made by
a YouTube user called Tamez85.
->
So this video was made by
a YouTube user called Tomez85.
# See https://www.youtube.com/user/Tomez85
Yasushi Aoki
237
00:12:39,157 --> 00:12:42,176
other possible uses
for this new technology.
->
all the possible uses
for this new technology.