See invisible motion, hear silent sounds. Cool? Creepy? We can't decide

So over the past few centuries,

microscopes have revolutionized our world.

They revealed to us a tiny world

of objects, life, and structures

that are too small for us
to see with our naked eyes.

They are a tremendous contribution
to science and technology.

Today I'd like to introduce you
to a new type of microscope,

a microscope for changes.

It doesn't use optics
like a regular microscope

to make small objects bigger,

but instead it uses a video camera

and image processing

to reveal to us the tiniest motions

and color changes in objects and people,

changes that are impossible
for us to see with our naked eyes,

and it lets us look at our world

in a completely new way.

So what do I mean by color changes?

Our skin, for example,
changes its color very slightly

when the blood flows under it.

That change is incredibly subtle,

which is why, when you
look at other people,

when you look at the person
sitting next to you,

you don't see their skin
or their face changing color.

When we look at
this video of Steve here,

it appears to us like a static picture,

but once we look at this video
through our new, special microscope,

suddenly we see
a completely different image.

What you see here are small changes

in the color of Steve's skin,

magnified 100 times

so that they become visible.

We can actually see a human pulse.

We can see how fast
Steve's heart is beating,

but we can also see the actual way

that the blood flows in his face.

And we can do that not just
to visualize the pulse

but also to actually
measure our heart rates,

and we can do it with regular cameras

and without touching the patients.

So here you see the pulse and heart rate

we extracted from a neonatal baby

from a video we took
with a regular DSLR camera,

and the heart rate measurement we get

is as accurate as the one you'd get

with a standard monitor in a hospital.

And it doesn't even have to be
a video we recorded.

We can do it essentially
with other videos as well.

So I just took a short clip
from "Batman Begins" here

just to show Christian Bale's pulse.

(Laughter)

And you know, presumably
he's wearing makeup,

the lighting here is kind of challenging,

but still, just from the video,
we're able to extract his pulse

and show it quite well.

So how do we do all that?

We basically analyze the changes

in the light that's recorded

at every pixel in the video over time,

and then we crank up those changes.

We make them bigger
so that we can see them.

The tricky part is that those signals,

those changes that we're after,

are extremely subtle,

so we have to be very careful
when you try to separate them

from noise that always exists in videos.

So we use some clever
image processing techniques

to get a very accurate measurement
of the color at each pixel in the video,

and then the way the color
changes over time,

and then we amplify those changes.

We make them bigger to create those types
of enhanced videos, or magnified videos,

that actually show us those changes.

But it turns out we can do that

not just to show tiny changes in color

but also tiny motions,

and that's because the light
that gets recorded in our cameras

will change not only if the color
of the object changes,

but also if the object moves.

So this is my daughter

when she was about two months old.

It's a video I recorded
about three years ago.

And as new parents, we all want
to make sure our babies are healthy,

that they're breathing,
that they're alive of course.

So I too got one of those baby monitors

so that I could see my daughter
when she was asleep.

And this is pretty much what you'll see

with a standard baby monitor.

You know, you can see the baby's sleeping,

but there's not too much
information there.

There's not too much we can see.

Wouldn't it be better,

or more informative, or more useful,

if instead we could look
at the view like this.

So here I took the motions

and I magnified them 30 times,

and then I could clearly see that my
daughter was indeed alive and breathing.

(Laughter)

Here is a side by side comparison.

So again, in the source video,
in the original video,

there's not too much we can see,

but once we magnify the motions,

the breathing becomes much more visible.

And it turns out, there's
a lot of phenomena

we can reveal and magnify

with our new motion microscope.

We can see how our veins and arteries

are pulsing in our bodies.

We can see that our eyes

are constantly moving
in this wobbly motion.

And that's actually my eye,

and again this video was taken
right after my daughter was born,

so you can see I was not
getting too much sleep.

Even when a person is sitting still,

there's a lot of information
we can extract

about their breathing patterns,
small facial expressions.

Maybe we could use those motions

to tell us something about
our thoughts or our emotions.

We can also magnify small
mechanical movements,

like vibrations in engines,

that can help engineers detect
and diagnose machinery problems,

or see how our buildings and structures

sway in the wind and react to forces.

Those are all things that our society

knows how to measure in various ways,

but measuring those motions is one thing,

and actually seeing those
motions as they happen

is a whole different thing.

And ever since we discovered
this new technology,

we made our code available online

so that others could use
and experiment with it.

It's very simple to use.

It can work on your own videos.

Our collaborators at Quantum Research
even created this nice website

where you can upload your videos
and process them online,

so even if you don't have any experience

in computer science or programming,

you can still very easily experiment
with this new microscope.

And I'd like to show you
just a couple of examples

of what others have done with it.

So this video was made by
a YouTube user called Tamez85.

I don't know who that user is,

but he, or she, used our code

to magnify small belly
movements during pregnancy.

It's kind of creepy.

(Laughter)

People have used it to magnify

pulsing veins in their hands,

and you know, it's not real science
unless you use guinea pigs,

and apparently this guinea pig
is called Tiffany,

and this YouTube user claims
it is the first rodent on Earth

that was motion-magnified.

You can also do some art with it.

So this video was sent to me
by a design student at Yale.

she wanted to see
if there's any difference

in the way her classmates move.

She made them all stand still,

and then magnified their motions

It's like seeing still pictures

come to life.