Return to Video

The world is one big dataset. Now, how to photograph it ...

  • 0:01 - 0:03
    Five years ago, I was a Ph.D student
  • 0:03 - 0:05
    living two lives.
  • 0:05 - 0:07
    In one, I used NASA supercomputers
  • 0:07 - 0:10
    to design next generation spacecraft,
  • 0:10 - 0:12
    and in the other I was a data scientist
  • 0:12 - 0:15
    looking for potential smugglers
  • 0:15 - 0:18
    of sensitive nuclear technologies.
  • 0:18 - 0:21
    As a data scientist, I did a lot of analyses,
  • 0:21 - 0:23
    mostly of facilities,
  • 0:23 - 0:25
    industrial facilities around the world.
  • 0:25 - 0:28
    And I was always looking for a better canvas
  • 0:28 - 0:30
    to tie these all together.
  • 0:30 - 0:32
    And one day, I was thinking about how
  • 0:32 - 0:34
    all data has a location,
  • 0:34 - 0:35
    and I realized that the answer
  • 0:35 - 0:37
    had been staring me in the face.
  • 0:37 - 0:40
    Although I was a satellite engineer,
  • 0:40 - 0:43
    I hadn't thought about using satellite imagery
  • 0:43 - 0:45
    in my work.
  • 0:45 - 0:46
    Now like most of us, I'd been online,
  • 0:46 - 0:48
    I'd see my house, so I thought,
  • 0:48 - 0:50
    I'll hop in there and I'll start looking up
  • 0:50 - 0:52
    some of these facilities.
  • 0:52 - 0:54
    And what I found really surprised me.
  • 0:54 - 0:56
    The pictures that I was finding
  • 0:56 - 0:58
    were years out of date,
  • 0:58 - 0:59
    and because of that,
  • 0:59 - 1:00
    it had relatively little relevance
  • 1:00 - 1:03
    to the work that I was doing today.
  • 1:03 - 1:04
    But I was intrigued.
  • 1:04 - 1:07
    I mean, satellite imagery is pretty amazing stuff.
  • 1:07 - 1:10
    There are millions and millions of sensors
  • 1:10 - 1:11
    surrounding us today,
  • 1:11 - 1:14
    but there's still so much we
    don't know on a daily basis.
  • 1:14 - 1:18
    How much oil is stored in all of China?
  • 1:18 - 1:21
    How much corn is being produced?
  • 1:21 - 1:25
    How many ships are in all of our world's ports?
  • 1:25 - 1:27
    Now, in theory, all of these questions
  • 1:27 - 1:29
    could be answered by imagery,
  • 1:29 - 1:31
    but not if it's old.
  • 1:31 - 1:34
    And if this data was so valuable,
  • 1:34 - 1:36
    then how come I couldn't get my hands
  • 1:36 - 1:38
    on more recent pictures?
  • 1:38 - 1:42
    So the story begins over 50 years ago
  • 1:42 - 1:43
    with the launch of the first generation
  • 1:43 - 1:47
    of U.S. government photo reconnaissance satellites.
  • 1:47 - 1:48
    And today, there's a handful
  • 1:48 - 1:51
    of the great, great grandchildren
  • 1:51 - 1:52
    of these early cold war machines
  • 1:52 - 1:54
    which are now operated by private companies
  • 1:54 - 1:57
    and from which the vast majority of satellite imagery
  • 1:57 - 2:00
    that you and I see on a daily basis comes.
  • 2:00 - 2:03
    During this period, launching things into space,
  • 2:03 - 2:06
    just the rocket to get the satellite up there,
  • 2:06 - 2:10
    has cost hundreds of millions of dollars each,
  • 2:10 - 2:12
    and that's created tremendous pressure
  • 2:12 - 2:14
    to launch things infrequently
  • 2:14 - 2:16
    and to make sure that when you do,
  • 2:16 - 2:19
    you cram as much functionality in there as possible.
  • 2:19 - 2:21
    All of this has only made satellites
  • 2:21 - 2:23
    bigger and bigger and bigger
  • 2:23 - 2:25
    and more expensive,
  • 2:25 - 2:30
    now nearly a billion, with a b, dollars per copy.
  • 2:30 - 2:32
    Because they are so expensive,
  • 2:32 - 2:33
    there aren't very many of them.
  • 2:33 - 2:34
    Because there aren't very many of them,
  • 2:34 - 2:37
    the pictures that we see on a daily basis
  • 2:37 - 2:38
    tend to be old.
  • 2:38 - 2:42
    I think a lot of people actually
    understand this anecdotally,
  • 2:42 - 2:44
    but in order to visualize just how sparsely
  • 2:44 - 2:46
    our planet is collected,
  • 2:46 - 2:48
    some friends and I put together a data set
  • 2:48 - 2:51
    of the 30 million pictures that have been gathered
  • 2:51 - 2:54
    by these satellites between 2000 and 2010.
  • 2:54 - 2:57
    As you can see in blue, huge areas of our world
  • 2:57 - 3:00
    are barely seen, less than once a year,
  • 3:00 - 3:02
    and even the areas that are seen most frequently,
  • 3:02 - 3:06
    those in red, are seen at best once a quarter.
  • 3:06 - 3:09
    Now as aerospace engineering grad students,
  • 3:09 - 3:12
    this chart cried out to us as a challenge.
  • 3:12 - 3:16
    Why do these things have to be so expensive?
  • 3:16 - 3:18
    Does a single satellite really have to cost
  • 3:18 - 3:23
    the equivalent of three 747 jumbo jets?
  • 3:23 - 3:25
    Wasn't there a way to build a smaller,
  • 3:25 - 3:28
    simpler, new satellite design that could enable
  • 3:28 - 3:30
    more timely imaging?
  • 3:30 - 3:34
    Now I realize that it does sound a little bit crazy
  • 3:34 - 3:36
    that we were going to go out and just
  • 3:36 - 3:37
    begin designing satellites,
  • 3:37 - 3:39
    but fortunately we had help.
  • 3:39 - 3:42
    In the late 1990s, a couple of professors
  • 3:42 - 3:46
    proposed a concept for radically reducing the price
  • 3:46 - 3:47
    of putting things in space.
  • 3:47 - 3:49
    This was hitchhiking small satellites
  • 3:49 - 3:52
    alongside much larger satellite.
  • 3:52 - 3:56
    This dropped the cost of putting objects up there
  • 3:56 - 3:57
    by over a factor of 100,
  • 3:57 - 4:01
    and suddenly we could afford to experiment,
  • 4:01 - 4:02
    to take a little bit of risk,
  • 4:02 - 4:04
    and to realize a lot of innovation.
  • 4:04 - 4:07
    And a new generation of engineers and scientists,
  • 4:07 - 4:09
    mostly out of universities,
  • 4:09 - 4:11
    began launching these very small,
  • 4:11 - 4:14
    breadbox-sized satellites called CubeSats.
  • 4:14 - 4:16
    And these were built with electronics obtained
  • 4:16 - 4:20
    from RadioShack instead of Lockheed Martin.
  • 4:20 - 4:23
    Now it was using the lessons
    learned from these early missions
  • 4:23 - 4:26
    that my friends and I began a series of sketches
  • 4:26 - 4:27
    of our own satellite design.
  • 4:27 - 4:30
    And, you know, I can't remember a specific day
  • 4:30 - 4:32
    where we made, like, a conscious decision
  • 4:32 - 4:35
    that we were actually going to
    go out and build these things,
  • 4:35 - 4:37
    but it was just, once we got that idea in our minds
  • 4:37 - 4:39
    of the world as a data set,
  • 4:39 - 4:42
    of being able to capture millions of data points
  • 4:42 - 4:44
    on a daily basis, describing the global economy,
  • 4:44 - 4:47
    of being able to unearth billions of connections
  • 4:47 - 4:50
    between them that had never before been found,
  • 4:50 - 4:52
    it just seemed boring
  • 4:52 - 4:55
    to go work on anything else.
  • 4:55 - 4:58
    And so we moved into a cramped,
  • 4:58 - 5:01
    windowless office in Palo Alto,
  • 5:01 - 5:03
    and began working to take our design
  • 5:03 - 5:06
    from the drawing board into the lab.
  • 5:06 - 5:09
    Now the first major question we had to tackle
  • 5:09 - 5:11
    was just how big to build this thing.
  • 5:11 - 5:14
    In space, size drives cost,
  • 5:14 - 5:16
    and we had worked with these very small,
  • 5:16 - 5:18
    breadbox-sized satellites in school,
  • 5:18 - 5:21
    but as we began to better
    understand the laws of physics,
  • 5:21 - 5:23
    we found that the quality of pictures
  • 5:23 - 5:26
    those satellites could take was very limited,
  • 5:26 - 5:28
    because the laws of physics dictate
  • 5:28 - 5:31
    that the best picture you
    can take through a telescope
  • 5:31 - 5:33
    is a function of the diameter of that telescope,
  • 5:33 - 5:35
    and these satellites had a very small,
  • 5:35 - 5:37
    very constrained volume.
  • 5:37 - 5:38
    And we found that the best picture we would
  • 5:38 - 5:40
    have been able to get looked something like this.
  • 5:40 - 5:43
    And although this was the low-cost option,
  • 5:43 - 5:44
    quite frankly it was just too blurry
  • 5:44 - 5:48
    to see the things that make
    satellite imagery valuable.
  • 5:48 - 5:50
    So about three or four weeks later,
  • 5:50 - 5:53
    we met a group of engineers randomly
  • 5:53 - 5:55
    who had worked on the first
  • 5:55 - 5:57
    private imaging satellite ever developed,
  • 5:57 - 5:59
    and they told us that back in the 1970s,
  • 5:59 - 6:01
    the U.S. government had found a powerful
  • 6:01 - 6:03
    optimal tradeoff,
  • 6:03 - 6:06
    that in taking pictures at right
    about one meter resolution,
  • 6:06 - 6:09
    being able to see objects one meter in size,
  • 6:09 - 6:12
    they found that they could not
    just get very high quality images,
  • 6:12 - 6:15
    but get a lot of them at an affordable price.
  • 6:15 - 6:16
    From our own computer simulations,
  • 6:16 - 6:19
    we quickly found that one meter really was
  • 6:19 - 6:20
    the minimum viable product
  • 6:20 - 6:23
    to be able to see the drivers of our global economy,
  • 6:23 - 6:25
    for the first time, being able to count
  • 6:25 - 6:28
    the ships and cars and shipping
    containers and trucks
  • 6:28 - 6:31
    that move around our world on a daily basis,
  • 6:31 - 6:34
    while conveniently still not
    being able to see individuals.
  • 6:34 - 6:36
    We had found our compromise.
  • 6:36 - 6:38
    We would have to build something larger
  • 6:38 - 6:39
    than the original breadbox,
  • 6:39 - 6:41
    now more like a mini-fridge,
  • 6:41 - 6:44
    but we still wouldn't have to build a pickup truck.
  • 6:44 - 6:46
    So now we had our constraint.
  • 6:46 - 6:48
    The laws of physics dictated
  • 6:48 - 6:51
    the absolute minimum-sized
    telescope that we could build.
  • 6:51 - 6:54
    What came next was making the rest of the satellite
  • 6:54 - 6:56
    as small and as simple as possible,
  • 6:56 - 6:59
    basically a flying telescope with four walls
  • 6:59 - 7:02
    and a set of electronics smaller than a phone book
  • 7:02 - 7:05
    that used less power than a 100 watt light bulb.
  • 7:05 - 7:07
    The big challenge became actually taking
  • 7:07 - 7:09
    the pictures through that telescope.
  • 7:09 - 7:12
    Traditional imaging satellites use a line scanner,
  • 7:12 - 7:14
    similar to a Xerox machine,
  • 7:14 - 7:16
    and as they traverse the earth, they take pictures,
  • 7:16 - 7:19
    scanning row by row by row
  • 7:19 - 7:20
    to build the complete image.
  • 7:20 - 7:23
    Now people use these because they get a lot of light,
  • 7:23 - 7:25
    which means less of the noise you see
  • 7:25 - 7:28
    in a low-cost cell phone image.
  • 7:28 - 7:30
    The problem with them is they require
  • 7:30 - 7:32
    very sophisticated pointing.
  • 7:32 - 7:35
    You have to stay focused on a 50-centimeter target
  • 7:35 - 7:37
    from over 600 miles away
  • 7:37 - 7:39
    while moving at more than
    seven kilometers a second,
  • 7:39 - 7:42
    which requires an awesome degree of complexity.
  • 7:42 - 7:45
    So instead, we turned to a new
    generation of video sensors,
  • 7:45 - 7:48
    originally created for use in night vision goggles.
  • 7:48 - 7:51
    Instead of taking a single, high quality image,
  • 7:51 - 7:52
    we could take a videostream
  • 7:52 - 7:56
    of individually noisier frames,
  • 7:56 - 7:57
    but then we could recombine
  • 7:57 - 7:59
    all of those frames together
  • 7:59 - 8:01
    into very high quality images
  • 8:01 - 8:03
    using sophisticated pixel processing techniques
  • 8:03 - 8:05
    here on the ground,
  • 8:05 - 8:08
    at a cost of one one-hundredth a traditional system.
  • 8:08 - 8:09
    And we applied this technique
  • 8:09 - 8:12
    to many of the other systems on the satellite as well,
  • 8:12 - 8:15
    and day by day, our design evolved
  • 8:15 - 8:18
    from cad to prototypes
  • 8:18 - 8:21
    to production units.
  • 8:21 - 8:23
    A few short weeks ago,
  • 8:23 - 8:25
    we packed up SkySat 1,
  • 8:25 - 8:27
    put our signatures on it,
  • 8:27 - 8:29
    and waved goodbye for the last time on earth.
  • 8:29 - 8:32
    Today, it's sitting in its final launch configuration
  • 8:32 - 8:36
    ready to blast off in a few short weeks.
  • 8:36 - 8:38
    And soon, we'll turn our attention to launching
  • 8:38 - 8:41
    a constellation of 24 or more of these satellites
  • 8:41 - 8:43
    and beginning to build the scalable analytics
  • 8:43 - 8:46
    that will allow us to unearth the insights
  • 8:46 - 8:49
    in the pedabytes of data we will collect.
  • 8:49 - 8:53
    So why do all of this? Why build these satellites?
  • 8:53 - 8:55
    Well, it turns out imaging satellites
  • 8:55 - 8:59
    have a unique ability to provide global transparency,
  • 8:59 - 9:02
    and providing that transparency on a timely basis
  • 9:02 - 9:05
    is simply an idea whose time has come.
  • 9:05 - 9:08
    We see ourselves as pioneers of a new frontier,
  • 9:08 - 9:11
    and beyond economic data,
  • 9:11 - 9:14
    unlocking the human story, moment by moment.
  • 9:14 - 9:16
    For a data scientist
  • 9:16 - 9:18
    that just happened to go to space camp as a kid,
  • 9:18 - 9:21
    it just doesn't get much better than that.
  • 9:21 - 9:23
    Thank you.
  • 9:23 - 9:27
    (Applause)
Title:
The world is one big dataset. Now, how to photograph it ...
Speaker:
Dan Berkenstock
Description:

more » « less
Video Language:
English
Team:
closed TED
Project:
TEDTalks
Duration:
09:44

English subtitles

Revisions Compare revisions