[Script Info]
Title: 
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:01.11,0:00:08.61,Default,,0000,0000,0000,,So over the past few centuries,\Nmicroscopes have revolutionized our world.
Dialogue: 0,0:00:09.04,0:00:14.25,Default,,0000,0000,0000,,They revealed to us a tiny world\Nof objects, life and structures
Dialogue: 0,0:00:14.25,0:00:17.16,Default,,0000,0000,0000,,that are too small for us\Nto see with our naked eyes.
Dialogue: 0,0:00:17.16,0:00:20.18,Default,,0000,0000,0000,,They are a tremendous contribution\Nto science and technology.
Dialogue: 0,0:00:20.18,0:00:23.40,Default,,0000,0000,0000,,Today I'd like to introduce you\Nto a new type of microscope,
Dialogue: 0,0:00:23.40,0:00:25.98,Default,,0000,0000,0000,,a microscope for changes.
Dialogue: 0,0:00:25.98,0:00:28.88,Default,,0000,0000,0000,,It doesn't use optics\Nlike a regular microscope
Dialogue: 0,0:00:28.88,0:00:30.88,Default,,0000,0000,0000,,to make small objects bigger,
Dialogue: 0,0:00:30.88,0:00:35.26,Default,,0000,0000,0000,,but instead it uses a video camera\Nand image processing
Dialogue: 0,0:00:35.26,0:00:40.51,Default,,0000,0000,0000,,to reveal to us the tiniest motions\Nand color changes in objects and people,
Dialogue: 0,0:00:40.51,0:00:44.36,Default,,0000,0000,0000,,changes that are impossible\Nfor us to see with our naked eyes.
Dialogue: 0,0:00:44.36,0:00:48.48,Default,,0000,0000,0000,,And it lets us look at our world\Nin a completely new way.
Dialogue: 0,0:00:48.48,0:00:50.38,Default,,0000,0000,0000,,So what do I mean by color changes?
Dialogue: 0,0:00:50.38,0:00:53.22,Default,,0000,0000,0000,,Our skin, for example,\Nchanges its color very slightly
Dialogue: 0,0:00:53.22,0:00:55.21,Default,,0000,0000,0000,,when the blood flows under it.
Dialogue: 0,0:00:55.21,0:00:57.61,Default,,0000,0000,0000,,That change is incredibly subtle,
Dialogue: 0,0:00:57.61,0:00:59.67,Default,,0000,0000,0000,,which is why, when you\Nlook at other people,
Dialogue: 0,0:00:59.67,0:01:01.92,Default,,0000,0000,0000,,when you look at the person\Nsitting next to you,
Dialogue: 0,0:01:01.92,0:01:05.50,Default,,0000,0000,0000,,you don't see their skin\Nor their face changing color.
Dialogue: 0,0:01:05.50,0:01:09.86,Default,,0000,0000,0000,,When we look at this video of Steve here,\Nit appears to us like a static picture,
Dialogue: 0,0:01:09.86,0:01:13.72,Default,,0000,0000,0000,,but once we look at this video\Nthrough our new, special microscope,
Dialogue: 0,0:01:13.72,0:01:16.32,Default,,0000,0000,0000,,suddenly we see\Na completely different image.
Dialogue: 0,0:01:16.32,0:01:20.25,Default,,0000,0000,0000,,What you see here are small changes\Nin the color of Steve's skin,
Dialogue: 0,0:01:20.25,0:01:24.69,Default,,0000,0000,0000,,magnified 100 times\Nso that they become visible.
Dialogue: 0,0:01:24.69,0:01:27.95,Default,,0000,0000,0000,,We can actually see a human pulse.
Dialogue: 0,0:01:27.95,0:01:31.18,Default,,0000,0000,0000,,We can see how fast\NSteve's heart is beating,
Dialogue: 0,0:01:31.18,0:01:36.54,Default,,0000,0000,0000,,but we can also see the actual way\Nthat the blood flows in his face.
Dialogue: 0,0:01:36.54,0:01:39.18,Default,,0000,0000,0000,,And we can do that not just\Nto visualize the pulse,
Dialogue: 0,0:01:39.18,0:01:42.65,Default,,0000,0000,0000,,but also to actually \Nrecover our heart rates,
Dialogue: 0,0:01:42.65,0:01:44.44,Default,,0000,0000,0000,,and measure our heart rates.
Dialogue: 0,0:01:44.44,0:01:48.89,Default,,0000,0000,0000,,And we can do it with regular cameras\Nand without touching the patients.
Dialogue: 0,0:01:48.89,0:01:54.51,Default,,0000,0000,0000,,So here you see the pulse and heart rate\Nwe extracted from a neonatal baby
Dialogue: 0,0:01:54.51,0:01:57.39,Default,,0000,0000,0000,,from a video we took\Nwith a regular DSLR camera,
Dialogue: 0,0:01:57.39,0:01:59.21,Default,,0000,0000,0000,,and the heart rate measurement we get
Dialogue: 0,0:01:59.21,0:02:04.02,Default,,0000,0000,0000,,is as accurate as the one you'd get\Nwith a standard monitor in a hospital.
Dialogue: 0,0:02:04.02,0:02:06.66,Default,,0000,0000,0000,,And it doesn't even have to be\Na video we recorded.
Dialogue: 0,0:02:06.66,0:02:09.65,Default,,0000,0000,0000,,We can do it essentially\Nwith other videos as well.
Dialogue: 0,0:02:09.65,0:02:13.56,Default,,0000,0000,0000,,So I just took a short clip\Nfrom "Batman Begins" here
Dialogue: 0,0:02:13.56,0:02:15.46,Default,,0000,0000,0000,,just to show Christian Bale's pulse.
Dialogue: 0,0:02:15.46,0:02:17.28,Default,,0000,0000,0000,,(Laughter)
Dialogue: 0,0:02:17.28,0:02:19.40,Default,,0000,0000,0000,,And you know, presumably\Nhe's wearing makeup,
Dialogue: 0,0:02:19.40,0:02:21.36,Default,,0000,0000,0000,,the lighting here is kind of challenging,
Dialogue: 0,0:02:21.36,0:02:24.31,Default,,0000,0000,0000,,but still, just from the video,\Nwe're able to extract his pulse
Dialogue: 0,0:02:24.31,0:02:26.33,Default,,0000,0000,0000,,and show it quite well.
Dialogue: 0,0:02:26.33,0:02:28.25,Default,,0000,0000,0000,,So how do we do all that?
Dialogue: 0,0:02:28.25,0:02:32.84,Default,,0000,0000,0000,,We basically analyze the changes\Nin the light that are recorded
Dialogue: 0,0:02:32.84,0:02:35.12,Default,,0000,0000,0000,,at every pixel in the video over time,
Dialogue: 0,0:02:35.12,0:02:36.91,Default,,0000,0000,0000,,and then we crank up those changes.
Dialogue: 0,0:02:36.91,0:02:39.08,Default,,0000,0000,0000,,We make them bigger\Nso that we can see them.
Dialogue: 0,0:02:39.08,0:02:40.98,Default,,0000,0000,0000,,The tricky part is that those signals,
Dialogue: 0,0:02:40.98,0:02:43.91,Default,,0000,0000,0000,,those changes that we're after,\Nare extremely subtle,
Dialogue: 0,0:02:43.91,0:02:46.69,Default,,0000,0000,0000,,so we have to be very careful\Nwhen you try to separate them
Dialogue: 0,0:02:46.69,0:02:50.52,Default,,0000,0000,0000,,from noise that always exists in videos.
Dialogue: 0,0:02:50.52,0:02:53.52,Default,,0000,0000,0000,,So we use some clever\Nimage processing techniques
Dialogue: 0,0:02:53.52,0:02:57.51,Default,,0000,0000,0000,,to get a very accurate measurement\Nof the color at each pixel in the video,
Dialogue: 0,0:02:57.51,0:03:00.18,Default,,0000,0000,0000,,and then the way the color\Nchanges over time,
Dialogue: 0,0:03:00.18,0:03:02.87,Default,,0000,0000,0000,,and then we amplify those changes.
Dialogue: 0,0:03:02.87,0:03:06.85,Default,,0000,0000,0000,,We make them bigger to create those types\Nof enhanced videos, or magnified videos,
Dialogue: 0,0:03:06.85,0:03:09.02,Default,,0000,0000,0000,,that actually show us those changes.
Dialogue: 0,0:03:09.02,0:03:13.26,Default,,0000,0000,0000,,But it turns out we can do that\Nnot just to show tiny changes in color,
Dialogue: 0,0:03:13.26,0:03:15.50,Default,,0000,0000,0000,,but also tiny motions,
Dialogue: 0,0:03:15.50,0:03:19.08,Default,,0000,0000,0000,,and that's because the light\Nthat gets recorded in our cameras
Dialogue: 0,0:03:19.08,0:03:21.89,Default,,0000,0000,0000,,will change not only if the color\Nof the object changes,
Dialogue: 0,0:03:21.89,0:03:24.26,Default,,0000,0000,0000,,but also if the object moves.
Dialogue: 0,0:03:24.26,0:03:27.89,Default,,0000,0000,0000,,So this is my daughter\Nwhen she was about two months old.
Dialogue: 0,0:03:27.89,0:03:30.89,Default,,0000,0000,0000,,It's a video I recorded\Nabout three years ago.
Dialogue: 0,0:03:30.89,0:03:34.10,Default,,0000,0000,0000,,And as new parents, we all want\Nto make sure our babies are healthy,
Dialogue: 0,0:03:34.10,0:03:36.64,Default,,0000,0000,0000,,that they're breathing,\Nthat they're alive, of course.
Dialogue: 0,0:03:36.64,0:03:38.78,Default,,0000,0000,0000,,So I too got one of those baby monitors
Dialogue: 0,0:03:38.78,0:03:41.25,Default,,0000,0000,0000,,so that I could see my daughter\Nwhen she was asleep.
Dialogue: 0,0:03:41.25,0:03:44.78,Default,,0000,0000,0000,,And this is pretty much what you'll see\Nwith a standard baby monitor.
Dialogue: 0,0:03:44.78,0:03:48.46,Default,,0000,0000,0000,,You can see the baby's sleeping, but \Nthere's not too much information there.
Dialogue: 0,0:03:48.47,0:03:50.08,Default,,0000,0000,0000,,There's not too much we can see.
Dialogue: 0,0:03:50.08,0:03:52.90,Default,,0000,0000,0000,,Wouldn't it be better,\Nor more informative, or more useful,
Dialogue: 0,0:03:52.90,0:03:55.89,Default,,0000,0000,0000,,if instead we could look\Nat the view like this.
Dialogue: 0,0:03:55.89,0:04:02.25,Default,,0000,0000,0000,,So here I took the motions\Nand I magnified them 30 times,
Dialogue: 0,0:04:02.25,0:04:06.07,Default,,0000,0000,0000,,and then I could clearly see that my\Ndaughter was indeed alive and breathing.
Dialogue: 0,0:04:06.07,0:04:08.33,Default,,0000,0000,0000,,(Laughter)
Dialogue: 0,0:04:08.33,0:04:10.25,Default,,0000,0000,0000,,Here is a side-by-side comparison.
Dialogue: 0,0:04:10.25,0:04:12.73,Default,,0000,0000,0000,,So again, in the source video,\Nin the original video,
Dialogue: 0,0:04:12.73,0:04:14.37,Default,,0000,0000,0000,,there's not too much we can see,
Dialogue: 0,0:04:14.37,0:04:18.08,Default,,0000,0000,0000,,but once we magnify the motions,\Nthe breathing becomes much more visible.
Dialogue: 0,0:04:18.08,0:04:20.14,Default,,0000,0000,0000,,And it turns out, there's\Na lot of phenomena
Dialogue: 0,0:04:20.14,0:04:23.77,Default,,0000,0000,0000,,we can reveal and magnify\Nwith our new motion microscope.
Dialogue: 0,0:04:23.77,0:04:28.33,Default,,0000,0000,0000,,We can see how our veins and arteries\Nare pulsing in our bodies.
Dialogue: 0,0:04:28.33,0:04:30.96,Default,,0000,0000,0000,,We can see that our eyes\Nare constantly moving
Dialogue: 0,0:04:30.96,0:04:32.85,Default,,0000,0000,0000,,in this wobbly motion.
Dialogue: 0,0:04:32.85,0:04:34.36,Default,,0000,0000,0000,,And that's actually my eye,
Dialogue: 0,0:04:34.36,0:04:37.42,Default,,0000,0000,0000,,and again this video was taken\Nright after my daughter was born,
Dialogue: 0,0:04:37.42,0:04:41.62,Default,,0000,0000,0000,,so you can see I wasn't getting\Ntoo much sleep. (Laughter)
Dialogue: 0,0:04:41.62,0:04:44.34,Default,,0000,0000,0000,,Even when a person is sitting still,
Dialogue: 0,0:04:44.34,0:04:46.38,Default,,0000,0000,0000,,there's a lot of information\Nwe can extract
Dialogue: 0,0:04:46.38,0:04:49.91,Default,,0000,0000,0000,,about their breathing patterns,\Nsmall facial expressions.
Dialogue: 0,0:04:49.91,0:04:51.54,Default,,0000,0000,0000,,Maybe we could use those motions
Dialogue: 0,0:04:51.54,0:04:54.69,Default,,0000,0000,0000,,to tell us something about\Nour thoughts or our emotions.
Dialogue: 0,0:04:54.69,0:04:57.95,Default,,0000,0000,0000,,We can also magnify small\Nmechanical movements,
Dialogue: 0,0:04:57.95,0:04:59.50,Default,,0000,0000,0000,,like vibrations in engines,
Dialogue: 0,0:04:59.50,0:05:03.19,Default,,0000,0000,0000,,that can help engineers detect\Nand diagnose machinery problems,
Dialogue: 0,0:05:03.19,0:05:07.93,Default,,0000,0000,0000,,or see how our buildings and structures\Nsway in the wind and react to forces.
Dialogue: 0,0:05:07.93,0:05:12.51,Default,,0000,0000,0000,,Those are all things that our society\Nknows how to measure in various ways,
Dialogue: 0,0:05:12.51,0:05:14.96,Default,,0000,0000,0000,,but measuring those motions is one thing,
Dialogue: 0,0:05:14.96,0:05:17.24,Default,,0000,0000,0000,,and actually seeing those\Nmotions as they happen
Dialogue: 0,0:05:17.24,0:05:19.80,Default,,0000,0000,0000,,is a whole different thing.
Dialogue: 0,0:05:19.80,0:05:22.84,Default,,0000,0000,0000,,And ever since we discovered\Nthis new technology,
Dialogue: 0,0:05:22.84,0:05:26.79,Default,,0000,0000,0000,,we made our code available online so that \Nothers could use and experiment with it.
Dialogue: 0,0:05:26.79,0:05:28.66,Default,,0000,0000,0000,,It's very simple to use.
Dialogue: 0,0:05:28.66,0:05:30.71,Default,,0000,0000,0000,,It can work on your own videos.
Dialogue: 0,0:05:30.71,0:05:33.90,Default,,0000,0000,0000,,Our collaborators at Quanta Research\Neven created this nice website
Dialogue: 0,0:05:33.90,0:05:36.58,Default,,0000,0000,0000,,where you can upload your videos\Nand process them online,
Dialogue: 0,0:05:36.58,0:05:40.40,Default,,0000,0000,0000,,so even if you don't have any experience\Nin computer science or programming,
Dialogue: 0,0:05:40.40,0:05:43.33,Default,,0000,0000,0000,,you can still very easily experiment\Nwith this new microscope.
Dialogue: 0,0:05:43.33,0:05:45.74,Default,,0000,0000,0000,,And I'd like to show you\Njust a couple of examples
Dialogue: 0,0:05:45.74,0:05:48.47,Default,,0000,0000,0000,,of what others have done with it.
Dialogue: 0,0:05:48.47,0:05:53.79,Default,,0000,0000,0000,,So this video was made by\Na YouTube user called Tamez85.
Dialogue: 0,0:05:53.79,0:05:55.25,Default,,0000,0000,0000,,I don't know who that user is,
Dialogue: 0,0:05:55.25,0:05:57.60,Default,,0000,0000,0000,,but he, or she, used our code
Dialogue: 0,0:05:57.60,0:06:01.31,Default,,0000,0000,0000,,to magnify small belly\Nmovements during pregnancy.
Dialogue: 0,0:06:01.31,0:06:02.91,Default,,0000,0000,0000,,It's kind of creepy.
Dialogue: 0,0:06:02.91,0:06:04.52,Default,,0000,0000,0000,,(Laughter)
Dialogue: 0,0:06:04.52,0:06:09.49,Default,,0000,0000,0000,,People have used it to magnify\Npulsing veins in their hands.
Dialogue: 0,0:06:09.49,0:06:13.27,Default,,0000,0000,0000,,And you know it's not real science\Nunless you use guinea pigs,
Dialogue: 0,0:06:13.27,0:06:16.66,Default,,0000,0000,0000,,and apparently this guinea pig\Nis called Tiffany,
Dialogue: 0,0:06:16.66,0:06:19.61,Default,,0000,0000,0000,,and this YouTube user claims\Nit is the first rodent on Earth
Dialogue: 0,0:06:19.61,0:06:22.30,Default,,0000,0000,0000,,that was motion-magnified.
Dialogue: 0,0:06:22.30,0:06:24.48,Default,,0000,0000,0000,,You can also do some art with it.
Dialogue: 0,0:06:24.48,0:06:27.50,Default,,0000,0000,0000,,So this video was sent to me\Nby a design student at Yale.
Dialogue: 0,0:06:27.50,0:06:29.64,Default,,0000,0000,0000,,She wanted to see\Nif there's any difference
Dialogue: 0,0:06:29.64,0:06:31.16,Default,,0000,0000,0000,,in the way her classmates move.
Dialogue: 0,0:06:31.16,0:06:35.37,Default,,0000,0000,0000,,She made them all stand still,\Nand then magnified their motions.
Dialogue: 0,0:06:35.37,0:06:38.75,Default,,0000,0000,0000,,It's like seeing \Nstill pictures come to life.
Dialogue: 0,0:06:38.75,0:06:41.18,Default,,0000,0000,0000,,And the nice thing with \Nall those examples
Dialogue: 0,0:06:41.18,0:06:43.48,Default,,0000,0000,0000,,is that we had nothing to do with them.
Dialogue: 0,0:06:43.48,0:06:47.33,Default,,0000,0000,0000,,We just provided this new tool,\Na new way to look at the world,
Dialogue: 0,0:06:47.33,0:06:52.46,Default,,0000,0000,0000,,and then people find other interesting,\Nnew and creative ways of using it.
Dialogue: 0,0:06:52.46,0:06:54.23,Default,,0000,0000,0000,,But we didn't stop there.
Dialogue: 0,0:06:54.23,0:06:57.48,Default,,0000,0000,0000,,This tool not only allows us\Nto look at the world in a new way,
Dialogue: 0,0:06:57.48,0:06:59.84,Default,,0000,0000,0000,,it also redefines what we can do
Dialogue: 0,0:06:59.84,0:07:03.03,Default,,0000,0000,0000,,and pushes the limits of what\Nwe can do with our cameras.
Dialogue: 0,0:07:03.03,0:07:05.26,Default,,0000,0000,0000,,So as scientists, we started wondering,
Dialogue: 0,0:07:05.26,0:07:09.04,Default,,0000,0000,0000,,what other types of physical phenomena\Nproduce tiny motions
Dialogue: 0,0:07:09.04,0:07:11.94,Default,,0000,0000,0000,,that we could now use\Nour cameras to measure?
Dialogue: 0,0:07:11.94,0:07:15.94,Default,,0000,0000,0000,,And one such phenomenon\Nthat we focused on recently is sound.
Dialogue: 0,0:07:15.94,0:07:18.05,Default,,0000,0000,0000,,Sound, as we all know,\Nis basically changes
Dialogue: 0,0:07:18.05,0:07:20.23,Default,,0000,0000,0000,,in air pressure that\Ntravel through the air.
Dialogue: 0,0:07:20.23,0:07:23.85,Default,,0000,0000,0000,,Those pressure waves hit objects\Nand they create small vibrations in them,
Dialogue: 0,0:07:23.85,0:07:26.38,Default,,0000,0000,0000,,which is how we hear\Nand how we record sound.
Dialogue: 0,0:07:26.38,0:07:30.05,Default,,0000,0000,0000,,But it turns out that sound\Nalso produces visual motions.
Dialogue: 0,0:07:30.05,0:07:32.89,Default,,0000,0000,0000,,Those are motions\Nthat are not visible to us
Dialogue: 0,0:07:32.89,0:07:35.89,Default,,0000,0000,0000,,but are visible to a camera\Nwith the right processing.
Dialogue: 0,0:07:35.89,0:07:37.46,Default,,0000,0000,0000,,So here are two examples.
Dialogue: 0,0:07:37.46,0:07:40.07,Default,,0000,0000,0000,,This is me demonstrating\Nmy great singing skills.
Dialogue: 0,0:07:41.06,0:07:42.70,Default,,0000,0000,0000,,(Singing)
Dialogue: 0,0:07:42.70,0:07:44.13,Default,,0000,0000,0000,,(Laughter)
Dialogue: 0,0:07:44.13,0:07:47.12,Default,,0000,0000,0000,,And I took a high-speed video\Nof my throat while I was humming.
Dialogue: 0,0:07:47.12,0:07:48.88,Default,,0000,0000,0000,,Again, if you stare at that video,
Dialogue: 0,0:07:48.88,0:07:50.96,Default,,0000,0000,0000,,there's not too much\Nyou'll be able to see,
Dialogue: 0,0:07:50.96,0:07:55.29,Default,,0000,0000,0000,,but once we magnify the motions 100 times,\Nwe can see all the motions and ripples
Dialogue: 0,0:07:55.29,0:07:58.57,Default,,0000,0000,0000,,in the neck that are involved\Nin producing the sound.
Dialogue: 0,0:07:58.57,0:08:01.31,Default,,0000,0000,0000,,That signal is there in that video.
Dialogue: 0,0:08:01.31,0:08:03.98,Default,,0000,0000,0000,,We also know that singers\Ncan break a wine glass
Dialogue: 0,0:08:03.98,0:08:05.44,Default,,0000,0000,0000,,if they hit the correct note.
Dialogue: 0,0:08:05.44,0:08:07.20,Default,,0000,0000,0000,,So here, we're going to play a note
Dialogue: 0,0:08:07.20,0:08:09.73,Default,,0000,0000,0000,,that's in the resonance\Nfrequency of that glass
Dialogue: 0,0:08:09.73,0:08:11.78,Default,,0000,0000,0000,,through a loudspeaker that's next to it.
Dialogue: 0,0:08:11.78,0:08:16.20,Default,,0000,0000,0000,,Once we play that note\Nand magnify the motions 250 times,
Dialogue: 0,0:08:16.20,0:08:18.54,Default,,0000,0000,0000,,we can very clearly see \Nhow the glass vibrates
Dialogue: 0,0:08:18.54,0:08:22.10,Default,,0000,0000,0000,,and resonates in response to the sound.
Dialogue: 0,0:08:22.10,0:08:24.52,Default,,0000,0000,0000,,It's not something you're used\Nto seeing every day.
Dialogue: 0,0:08:24.52,0:08:28.05,Default,,0000,0000,0000,,But this made us think.\NIt gave us this crazy idea.
Dialogue: 0,0:08:28.05,0:08:33.66,Default,,0000,0000,0000,,Can we actually invert this process\Nand recover sound from video
Dialogue: 0,0:08:33.66,0:08:37.70,Default,,0000,0000,0000,,by analyzing the tiny vibrations\Nthat sound waves create in objects,
Dialogue: 0,0:08:37.70,0:08:42.47,Default,,0000,0000,0000,,and essentially convert those\Nback into the sounds that produced them.
Dialogue: 0,0:08:42.47,0:08:46.93,Default,,0000,0000,0000,,In this way, we can turn\Neveryday objects into microphones.
Dialogue: 0,0:08:46.93,0:08:49.16,Default,,0000,0000,0000,,So that's exactly what we did.
Dialogue: 0,0:08:49.16,0:08:51.98,Default,,0000,0000,0000,,So here's an empty bag of chips\Nthat was lying on a table,
Dialogue: 0,0:08:51.98,0:08:54.80,Default,,0000,0000,0000,,and we're going to turn that \Nbag of chips into a microphone
Dialogue: 0,0:08:54.80,0:08:56.40,Default,,0000,0000,0000,,by filming it with a video camera
Dialogue: 0,0:08:56.40,0:08:59.62,Default,,0000,0000,0000,,and analyzing the tiny motions\Nthat sound waves create in it.
Dialogue: 0,0:08:59.62,0:09:02.42,Default,,0000,0000,0000,,So here's the sound\Nthat we played in the room.
Dialogue: 0,0:09:02.42,0:09:06.85,Default,,0000,0000,0000,,(Music: "Mary Had a Little Lamb")
Dialogue: 0,0:09:10.01,0:09:13.03,Default,,0000,0000,0000,,And this is a high-speed video\Nwe recorded of that bag of chips.
Dialogue: 0,0:09:13.03,0:09:14.31,Default,,0000,0000,0000,,Again it's playing.
Dialogue: 0,0:09:14.31,0:09:17.65,Default,,0000,0000,0000,,There's no chance you'll be able\Nto see anything going on in that video
Dialogue: 0,0:09:17.65,0:09:18.71,Default,,0000,0000,0000,,just by looking at it,
Dialogue: 0,0:09:18.71,0:09:21.69,Default,,0000,0000,0000,,but here's the sound we were able\Nto recover just by analyzing
Dialogue: 0,0:09:21.69,0:09:23.87,Default,,0000,0000,0000,,the tiny motions in that video.
Dialogue: 0,0:09:23.87,0:09:26.68,Default,,0000,0000,0000,,(Music: "Mary Had a Little Lamb")
Dialogue: 0,0:09:40.98,0:09:42.47,Default,,0000,0000,0000,,I call it -- Thank you.
Dialogue: 0,0:09:42.47,0:09:47.70,Default,,0000,0000,0000,,(Applause)
Dialogue: 0,0:09:49.88,0:09:52.22,Default,,0000,0000,0000,,I call it the visual microphone.
Dialogue: 0,0:09:52.22,0:09:55.61,Default,,0000,0000,0000,,We actually extract audio signals\Nfrom video signals.
Dialogue: 0,0:09:55.61,0:09:58.79,Default,,0000,0000,0000,,And just to give you a sense\Nof the scale of the motions here,
Dialogue: 0,0:09:58.80,0:10:04.14,Default,,0000,0000,0000,,a pretty loud sound will cause that bag\Nof chips to move less than a micrometer.
Dialogue: 0,0:10:04.14,0:10:06.87,Default,,0000,0000,0000,,That's one thousandth of a millimeter.
Dialogue: 0,0:10:06.87,0:10:10.44,Default,,0000,0000,0000,,That's how tiny the motions are\Nthat we are now able to pull out
Dialogue: 0,0:10:10.44,0:10:13.68,Default,,0000,0000,0000,,just by observing how light\Nbounces off objects
Dialogue: 0,0:10:13.68,0:10:15.81,Default,,0000,0000,0000,,and gets recorded by our cameras.
Dialogue: 0,0:10:15.81,0:10:19.06,Default,,0000,0000,0000,,We can recover sounds\Nfrom other objects, like plants.
Dialogue: 0,0:10:19.06,0:10:25.38,Default,,0000,0000,0000,,(Music: "Mary Had a Little Lamb")
Dialogue: 0,0:10:27.21,0:10:29.21,Default,,0000,0000,0000,,And we can recover speech as well.
Dialogue: 0,0:10:29.21,0:10:31.79,Default,,0000,0000,0000,,So here's a person speaking in a room.
Dialogue: 0,0:10:31.79,0:10:35.99,Default,,0000,0000,0000,,Voice: Mary had a little lamb\Nwhose fleece was white as snow,
Dialogue: 0,0:10:35.99,0:10:40.22,Default,,0000,0000,0000,,and everywhere that Mary went,\Nthat lamb was sure to go.
Dialogue: 0,0:10:40.22,0:10:42.98,Default,,0000,0000,0000,,Michael Rubinstein: And here's\Nthat speech again recovered
Dialogue: 0,0:10:42.98,0:10:46.25,Default,,0000,0000,0000,,just from this video\Nof that same bag of chips.
Dialogue: 0,0:10:46.25,0:10:51.08,Default,,0000,0000,0000,,Voice: Mary had a little lamb\Nwhose fleece was white as snow,
Dialogue: 0,0:10:51.08,0:10:55.94,Default,,0000,0000,0000,,and everywhere that Mary went,\Nthat lamb was sure to go.
Dialogue: 0,0:10:55.94,0:10:58.29,Default,,0000,0000,0000,,MR: We used "Mary Had a Little Lamb"
Dialogue: 0,0:10:58.29,0:11:00.41,Default,,0000,0000,0000,,because those are said to be\Nthe first words
Dialogue: 0,0:11:00.41,0:11:04.57,Default,,0000,0000,0000,,that Thomas Edison spoke \Ninto his phonograph in 1877.
Dialogue: 0,0:11:04.57,0:11:07.80,Default,,0000,0000,0000,,It was one of the first sound\Nrecording devices in history.
Dialogue: 0,0:11:07.80,0:11:11.13,Default,,0000,0000,0000,,It basically directed the sounds\Nonto a diaphragm
Dialogue: 0,0:11:11.13,0:11:15.21,Default,,0000,0000,0000,,that vibrated a needle that essentially\Nengraved the sound on tinfoil
Dialogue: 0,0:11:15.21,0:11:17.48,Default,,0000,0000,0000,,that was wrapped around the cylinder.
Dialogue: 0,0:11:17.48,0:11:23.43,Default,,0000,0000,0000,,Here's a demonstration of recording and \Nreplaying sound with Edison's phonograph.
Dialogue: 0,0:11:23.43,0:11:26.45,Default,,0000,0000,0000,,(Video) Voice: Testing,\Ntesting, one two three.
Dialogue: 0,0:11:26.45,0:11:29.86,Default,,0000,0000,0000,,Mary had a little lamb\Nwhose fleece was white as snow,
Dialogue: 0,0:11:29.86,0:11:33.53,Default,,0000,0000,0000,,and everywhere that Mary went,\Nthe lamb was sure to go.
Dialogue: 0,0:11:33.53,0:11:36.27,Default,,0000,0000,0000,,Testing, testing, one two three.
Dialogue: 0,0:11:36.27,0:11:40.42,Default,,0000,0000,0000,,Mary had a little lamb\Nwhose fleece was white as snow,
Dialogue: 0,0:11:40.42,0:11:45.65,Default,,0000,0000,0000,,and everywhere that Mary went,\Nthe lamb was sure to go.
Dialogue: 0,0:11:45.65,0:11:49.66,Default,,0000,0000,0000,,MR: And now, 137 years later,
Dialogue: 0,0:11:49.66,0:11:53.75,Default,,0000,0000,0000,,we're able to get sound\Nin pretty much similar quality
Dialogue: 0,0:11:53.75,0:11:57.83,Default,,0000,0000,0000,,but by just watching objects\Nvibrate to sound with cameras,
Dialogue: 0,0:11:57.83,0:11:59.76,Default,,0000,0000,0000,,and we can even do that when the camera
Dialogue: 0,0:11:59.76,0:12:03.100,Default,,0000,0000,0000,,is 15 feet away from the object,\Nbehind soundproof glass.
Dialogue: 0,0:12:03.100,0:12:07.22,Default,,0000,0000,0000,,So this is the sound that we were \Nable to recover in that case.
Dialogue: 0,0:12:07.22,0:12:12.51,Default,,0000,0000,0000,,Voice: Mary had a little lamb\Nwhose fleece was white as snow,
Dialogue: 0,0:12:12.51,0:12:17.27,Default,,0000,0000,0000,,and everywhere that Mary went,\Nthe lamb was sure to go.
Dialogue: 0,0:12:17.40,0:12:21.03,Default,,0000,0000,0000,,MR: And of course, surveillance is\Nthe first application that comes to mind.
Dialogue: 0,0:12:21.03,0:12:24.03,Default,,0000,0000,0000,,(Laughter)
Dialogue: 0,0:12:24.03,0:12:28.08,Default,,0000,0000,0000,,But it might actually be useful\Nfor other things as well.
Dialogue: 0,0:12:28.08,0:12:30.92,Default,,0000,0000,0000,,Maybe in the future, we'll be able\Nto use it, for example,
Dialogue: 0,0:12:30.92,0:12:33.18,Default,,0000,0000,0000,,to recover sound across space,
Dialogue: 0,0:12:33.18,0:12:36.75,Default,,0000,0000,0000,,because sound can't travel\Nin space, but light can.
Dialogue: 0,0:12:36.75,0:12:39.16,Default,,0000,0000,0000,,We've only just begun exploring
Dialogue: 0,0:12:39.16,0:12:42.18,Default,,0000,0000,0000,,other possible uses\Nfor this new technology.
Dialogue: 0,0:12:42.18,0:12:45.01,Default,,0000,0000,0000,,It lets us see physical processes\Nthat we know are there
Dialogue: 0,0:12:45.01,0:12:48.56,Default,,0000,0000,0000,,but that we've never been able\Nto see with our own eyes until now.
Dialogue: 0,0:12:48.56,0:12:49.77,Default,,0000,0000,0000,,This is our team.
Dialogue: 0,0:12:49.77,0:12:52.65,Default,,0000,0000,0000,,Everything I showed you today\Nis a result of a collaboration
Dialogue: 0,0:12:52.65,0:12:54.84,Default,,0000,0000,0000,,with this great group\Nof people you see here,
Dialogue: 0,0:12:54.84,0:12:58.00,Default,,0000,0000,0000,,and I encourage you and welcome you\Nto check out our website,
Dialogue: 0,0:12:58.00,0:12:59.45,Default,,0000,0000,0000,,try it out yourself,
Dialogue: 0,0:12:59.45,0:13:02.42,Default,,0000,0000,0000,,and join us in exploring\Nthis world of tiny motions.
Dialogue: 0,0:13:02.42,0:13:04.05,Default,,0000,0000,0000,,Thank you.
Dialogue: 0,0:13:04.05,0:13:05.30,Default,,0000,0000,0000,,(Applause)