[Script Info]
Title: 
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:01.04,0:00:02.68,Default,,0000,0000,0000,,Hello, I'm Joy,
Dialogue: 0,0:00:02.68,0:00:04.20,Default,,0000,0000,0000,,a poet of code
Dialogue: 0,0:00:04.20,0:00:06.58,Default,,0000,0000,0000,,on a mission to stop
Dialogue: 0,0:00:06.58,0:00:09.22,Default,,0000,0000,0000,,an unseen force that's rising,
Dialogue: 0,0:00:09.22,0:00:12.10,Default,,0000,0000,0000,,a force that I called the coded gaze,
Dialogue: 0,0:00:12.10,0:00:15.43,Default,,0000,0000,0000,,my term for algorithmic bias.
Dialogue: 0,0:00:15.43,0:00:17.84,Default,,0000,0000,0000,,Algorithmic bias, like human bias,
Dialogue: 0,0:00:17.84,0:00:20.23,Default,,0000,0000,0000,,results in unfairness.
Dialogue: 0,0:00:20.23,0:00:22.60,Default,,0000,0000,0000,,However, algorithms, like viruses,
Dialogue: 0,0:00:22.60,0:00:25.80,Default,,0000,0000,0000,,can spread bias on a massive scale
Dialogue: 0,0:00:25.80,0:00:28.12,Default,,0000,0000,0000,,at a rapid pace.
Dialogue: 0,0:00:28.12,0:00:32.53,Default,,0000,0000,0000,,Algorithmic bias can also lead\Nto exclusionary experiences,
Dialogue: 0,0:00:32.53,0:00:34.60,Default,,0000,0000,0000,,and discriminatory practices.
Dialogue: 0,0:00:34.60,0:00:38.38,Default,,0000,0000,0000,,Let me show you what I mean.
Dialogue: 0,0:00:38.38,0:00:40.51,Default,,0000,0000,0000,,(Video) Joy Boulamwini: Camera.\NI've got a face.
Dialogue: 0,0:00:40.51,0:00:42.70,Default,,0000,0000,0000,,Can you see my face?
Dialogue: 0,0:00:42.70,0:00:45.63,Default,,0000,0000,0000,,No glasses face.
Dialogue: 0,0:00:45.63,0:00:48.34,Default,,0000,0000,0000,,You can see her face.
Dialogue: 0,0:00:48.34,0:00:51.02,Default,,0000,0000,0000,,What about my face?
Dialogue: 0,0:00:53.82,0:00:54.70,Default,,0000,0000,0000,,(Laughter)
Dialogue: 0,0:00:54.70,0:00:58.89,Default,,0000,0000,0000,,I've got a mask. Can you see my mask?
Dialogue: 0,0:00:58.89,0:01:02.20,Default,,0000,0000,0000,,Joy Boulamwini: So how did this happen?
Dialogue: 0,0:01:02.20,0:01:04.71,Default,,0000,0000,0000,,Why am I sitting in front of a computer
Dialogue: 0,0:01:04.71,0:01:06.16,Default,,0000,0000,0000,,in a white mask
Dialogue: 0,0:01:06.16,0:01:09.83,Default,,0000,0000,0000,,trying to be detected by a cheap webcam?
Dialogue: 0,0:01:09.83,0:01:12.14,Default,,0000,0000,0000,,Well, when I'm not fighting the coded gaze
Dialogue: 0,0:01:12.14,0:01:13.55,Default,,0000,0000,0000,,as a poet of code,
Dialogue: 0,0:01:13.55,0:01:16.84,Default,,0000,0000,0000,,I'm a graduate student\Nat the MIT Media Lab,
Dialogue: 0,0:01:16.84,0:01:19.06,Default,,0000,0000,0000,,and there I have the opportunity
Dialogue: 0,0:01:19.06,0:01:21.79,Default,,0000,0000,0000,,to work on all sorts\Nof whimsical projects,
Dialogue: 0,0:01:21.79,0:01:24.10,Default,,0000,0000,0000,,including the Aspire Mirror,
Dialogue: 0,0:01:24.10,0:01:28.100,Default,,0000,0000,0000,,a project I did so I could project\Ndigital masks onto my reflection.
Dialogue: 0,0:01:28.100,0:01:31.37,Default,,0000,0000,0000,,So in the morning, if I wanted\Nto feel powerful,
Dialogue: 0,0:01:31.37,0:01:32.83,Default,,0000,0000,0000,,I could put on a lion.
Dialogue: 0,0:01:32.83,0:01:36.35,Default,,0000,0000,0000,,If I wanted to be uplifted,\NI might have a quote.
Dialogue: 0,0:01:36.35,0:01:39.43,Default,,0000,0000,0000,,So I used generic facial\Nrecognition software
Dialogue: 0,0:01:39.43,0:01:40.74,Default,,0000,0000,0000,,to build the system,
Dialogue: 0,0:01:40.74,0:01:43.62,Default,,0000,0000,0000,,but found that it was\Nreally hard to test it
Dialogue: 0,0:01:43.62,0:01:46.66,Default,,0000,0000,0000,,unless I wore a white mask.
Dialogue: 0,0:01:46.66,0:01:51.09,Default,,0000,0000,0000,,Unfortunately, I've run\Ninto this issue before.
Dialogue: 0,0:01:51.09,0:01:55.52,Default,,0000,0000,0000,,When I was an undergraduate\Nat Georgia Tech studying computer science,
Dialogue: 0,0:01:55.52,0:01:57.60,Default,,0000,0000,0000,,I used to work on social robots,
Dialogue: 0,0:01:57.60,0:01:59.97,Default,,0000,0000,0000,,and one of my tasks was to get a robot
Dialogue: 0,0:01:59.97,0:02:01.40,Default,,0000,0000,0000,,to play peek-a-boo,
Dialogue: 0,0:02:01.40,0:02:03.27,Default,,0000,0000,0000,,a simple turn-taking game
Dialogue: 0,0:02:03.27,0:02:07.31,Default,,0000,0000,0000,,where partners cover their face\Nand then uncover it saying "Peek-a-boo."
Dialogue: 0,0:02:07.31,0:02:12.09,Default,,0000,0000,0000,,The problem is, peek-a-boo\Ndoesn't really work if I can't see you,
Dialogue: 0,0:02:12.09,0:02:14.43,Default,,0000,0000,0000,,and my robot couldn't see me.
Dialogue: 0,0:02:14.43,0:02:18.40,Default,,0000,0000,0000,,But I borrowed my roommate's face\Nto get the project done,
Dialogue: 0,0:02:18.40,0:02:20.37,Default,,0000,0000,0000,,submitted the assignment, and figured,
Dialogue: 0,0:02:20.37,0:02:24.41,Default,,0000,0000,0000,,you know what? Somebody else\Nwill solve this problem.
Dialogue: 0,0:02:24.41,0:02:26.30,Default,,0000,0000,0000,,Not too longer after,
Dialogue: 0,0:02:26.30,0:02:30.96,Default,,0000,0000,0000,,I was in Hong Kong\Nfor an entrepreneurship competition.
Dialogue: 0,0:02:30.96,0:02:33.51,Default,,0000,0000,0000,,The organizers decided\Nto take participants
Dialogue: 0,0:02:33.51,0:02:35.99,Default,,0000,0000,0000,,on a tour of local start-ups.
Dialogue: 0,0:02:35.99,0:02:38.73,Default,,0000,0000,0000,,One of the start-ups had a social robot,
Dialogue: 0,0:02:38.73,0:02:40.67,Default,,0000,0000,0000,,and they decided to do a demo.
Dialogue: 0,0:02:40.67,0:02:43.67,Default,,0000,0000,0000,,The demo worked on everybody\Nuntil it got to me,
Dialogue: 0,0:02:43.67,0:02:45.74,Default,,0000,0000,0000,,and you can probably guess it.
Dialogue: 0,0:02:45.74,0:02:48.61,Default,,0000,0000,0000,,It couldn't detect my face.
Dialogue: 0,0:02:48.61,0:02:51.14,Default,,0000,0000,0000,,I asked the developers\Nwhat was going on,
Dialogue: 0,0:02:51.14,0:02:52.35,Default,,0000,0000,0000,,and it turned out
Dialogue: 0,0:02:52.35,0:02:56.73,Default,,0000,0000,0000,,we had used the same generic\Nfacial recognition software.
Dialogue: 0,0:02:56.73,0:02:58.40,Default,,0000,0000,0000,,Halfway around the world,
Dialogue: 0,0:02:58.40,0:03:01.100,Default,,0000,0000,0000,,I learned that algorithmic bias\Ncan travel as quickly
Dialogue: 0,0:03:01.100,0:03:05.26,Default,,0000,0000,0000,,as it takes to download\Nsome files off of the Internet.
Dialogue: 0,0:03:05.26,0:03:07.41,Default,,0000,0000,0000,,So what's going on?\NWhy isn't my face being detected?
Dialogue: 0,0:03:07.41,0:03:12.76,Default,,0000,0000,0000,,Well, we have to look at\Nhow we give machines sight.
Dialogue: 0,0:03:12.76,0:03:16.20,Default,,0000,0000,0000,,Computer vision uses\Nmachine learning techniques
Dialogue: 0,0:03:16.20,0:03:18.38,Default,,0000,0000,0000,,to do facial recognition.
Dialogue: 0,0:03:18.38,0:03:20.66,Default,,0000,0000,0000,,So how this works is\Nyou create a training set
Dialogue: 0,0:03:20.66,0:03:22.02,Default,,0000,0000,0000,,with examples of faces.
Dialogue: 0,0:03:22.02,0:03:24.93,Default,,0000,0000,0000,,This is face. This is face.\NThis is not a face.
Dialogue: 0,0:03:24.93,0:03:29.46,Default,,0000,0000,0000,,And over time, you can teach\Na computer how to recognize other faces.
Dialogue: 0,0:03:29.46,0:03:33.26,Default,,0000,0000,0000,,However, if the training sets\Naren't really that diverse,
Dialogue: 0,0:03:33.26,0:03:36.46,Default,,0000,0000,0000,,any face that deviates too much\Nfrom the established norm
Dialogue: 0,0:03:36.46,0:03:38.47,Default,,0000,0000,0000,,will be harder to detect,
Dialogue: 0,0:03:38.47,0:03:40.45,Default,,0000,0000,0000,,which is what was happening to me.
Dialogue: 0,0:03:40.45,0:03:42.70,Default,,0000,0000,0000,,But don't worry, there's some good news.
Dialogue: 0,0:03:42.70,0:03:45.73,Default,,0000,0000,0000,,Training sets don't just\Nmaterialize out of nowhere.
Dialogue: 0,0:03:45.73,0:03:47.47,Default,,0000,0000,0000,,We actually can create them.
Dialogue: 0,0:03:47.47,0:03:51.55,Default,,0000,0000,0000,,So there's an opportunity to create\Nfull spectrum training sets
Dialogue: 0,0:03:51.55,0:03:55.52,Default,,0000,0000,0000,,that reflect a richer\Nportrait of humanity.
Dialogue: 0,0:03:55.52,0:03:57.80,Default,,0000,0000,0000,,Now you've seen in my examples
Dialogue: 0,0:03:57.80,0:03:59.55,Default,,0000,0000,0000,,how social robots
Dialogue: 0,0:03:59.55,0:04:04.25,Default,,0000,0000,0000,,was how I found out about exclusion\Nwith algorithmic bias,
Dialogue: 0,0:04:04.25,0:04:10.16,Default,,0000,0000,0000,,but algorithmic bias can also lead\Nto discriminatory practices.
Dialogue: 0,0:04:10.16,0:04:13.96,Default,,0000,0000,0000,,Across the U.S., police departments\Nare starting to use
Dialogue: 0,0:04:13.96,0:04:15.68,Default,,0000,0000,0000,,facial recognition software
Dialogue: 0,0:04:15.68,0:04:18.29,Default,,0000,0000,0000,,in their crime-fighting arsenal.
Dialogue: 0,0:04:18.29,0:04:18.80,Default,,0000,0000,0000,,Georgetown Law published a report\Nshowing that one in two
Dialogue: 0,0:04:18.80,0:04:19.05,Default,,0000,0000,0000,,adults in the U.S. --\Nthat's 117 million people --
Dialogue: 0,0:04:19.05,0:04:30.18,Default,,0000,0000,0000,,have their faces\Nin facial recognition networks.
Dialogue: 0,0:04:30.18,0:04:35.12,Default,,0000,0000,0000,,Police departments can currently look\Nat these networks unregulated
Dialogue: 0,0:04:35.12,0:04:39.48,Default,,0000,0000,0000,,using algorithms that have not\Nbeen audited for accuracy.
Dialogue: 0,0:04:39.48,0:04:41.69,Default,,0000,0000,0000,,Yet we know facial recognition
Dialogue: 0,0:04:41.69,0:04:43.23,Default,,0000,0000,0000,,is not failproof,
Dialogue: 0,0:04:43.23,0:04:47.52,Default,,0000,0000,0000,,and labeling faces consistently\Nremains a challenge.
Dialogue: 0,0:04:47.52,0:04:49.28,Default,,0000,0000,0000,,You might have seen this on Facebook.
Dialogue: 0,0:04:49.28,0:04:52.32,Default,,0000,0000,0000,,My friends and I laugh all the time\Nwhen we see other people
Dialogue: 0,0:04:52.32,0:04:54.92,Default,,0000,0000,0000,,mislabeled in our photos.
Dialogue: 0,0:04:54.92,0:04:58.41,Default,,0000,0000,0000,,But misidentifying a suspected criminal
Dialogue: 0,0:04:58.41,0:05:00.55,Default,,0000,0000,0000,,is no laughing matter,
Dialogue: 0,0:05:00.55,0:05:03.36,Default,,0000,0000,0000,,nor is breaching civil liberties.
Dialogue: 0,0:05:03.36,0:05:06.41,Default,,0000,0000,0000,,Machine learning is being used\Nfor facial recognition,
Dialogue: 0,0:05:06.41,0:05:09.08,Default,,0000,0000,0000,,but it's also extending beyond the realm
Dialogue: 0,0:05:09.08,0:05:11.93,Default,,0000,0000,0000,,of computer vision.
Dialogue: 0,0:05:11.93,0:05:15.86,Default,,0000,0000,0000,,In her book\N"Weapons of Math Destruction,"
Dialogue: 0,0:05:15.86,0:05:18.18,Default,,0000,0000,0000,,data scientist Cathy O'Neil
Dialogue: 0,0:05:18.18,0:05:22.72,Default,,0000,0000,0000,,talks about the rising new WMDs --
Dialogue: 0,0:05:22.72,0:05:26.81,Default,,0000,0000,0000,,widespread, mysterious,\Nand destructive algorithms
Dialogue: 0,0:05:26.81,0:05:29.67,Default,,0000,0000,0000,,that are increasingly being used\Nto make decisions
Dialogue: 0,0:05:29.67,0:05:32.88,Default,,0000,0000,0000,,that impact more aspects of our lives.
Dialogue: 0,0:05:32.88,0:05:35.32,Default,,0000,0000,0000,,So who gets hired or fired?
Dialogue: 0,0:05:35.32,0:05:37.14,Default,,0000,0000,0000,,Do you get that loan?\NDo you get insurance?
Dialogue: 0,0:05:37.14,0:05:40.73,Default,,0000,0000,0000,,Are you admitted into the college\Nthat you wanted to get into?
Dialogue: 0,0:05:40.73,0:05:44.21,Default,,0000,0000,0000,,Do you and I pay the same price\Nfor the same product
Dialogue: 0,0:05:44.21,0:05:46.75,Default,,0000,0000,0000,,purchased on the same platform?
Dialogue: 0,0:05:46.75,0:05:50.50,Default,,0000,0000,0000,,Law enforcement is also starting\Nto use machine learning
Dialogue: 0,0:05:50.50,0:05:52.77,Default,,0000,0000,0000,,for predictive policing.
Dialogue: 0,0:05:52.77,0:05:56.29,Default,,0000,0000,0000,,Some judges use machine-generated\Nrisk scores to determine
Dialogue: 0,0:05:56.29,0:06:00.73,Default,,0000,0000,0000,,how long an individual\Nis going to spend in prison.
Dialogue: 0,0:06:00.73,0:06:03.22,Default,,0000,0000,0000,,So we really have to think\Nabout these decisions.
Dialogue: 0,0:06:03.22,0:06:04.40,Default,,0000,0000,0000,,Are they fair?
Dialogue: 0,0:06:04.40,0:06:07.22,Default,,0000,0000,0000,,And we've seen that algorithmic bias
Dialogue: 0,0:06:07.22,0:06:10.71,Default,,0000,0000,0000,,doesn't necessarily always\Nlead to fair outcomes.
Dialogue: 0,0:06:10.71,0:06:12.70,Default,,0000,0000,0000,,So what can we do about it?
Dialogue: 0,0:06:12.70,0:06:16.40,Default,,0000,0000,0000,,Well, we can start thinking about\Nhow we create more inclusive code
Dialogue: 0,0:06:16.40,0:06:19.42,Default,,0000,0000,0000,,and employ inclusive coding practices.
Dialogue: 0,0:06:19.42,0:06:22.09,Default,,0000,0000,0000,,It really starts with people.
Dialogue: 0,0:06:22.09,0:06:24.38,Default,,0000,0000,0000,,So who codes matters.
Dialogue: 0,0:06:24.38,0:06:28.29,Default,,0000,0000,0000,,Are we creating full spectrum teams\Nwith diverse individuals
Dialogue: 0,0:06:28.29,0:06:30.81,Default,,0000,0000,0000,,who can check each other's blind spots?
Dialogue: 0,0:06:30.81,0:06:32.51,Default,,0000,0000,0000,,On the technical side,
Dialogue: 0,0:06:32.51,0:06:34.38,Default,,0000,0000,0000,,how we code matters.
Dialogue: 0,0:06:34.38,0:06:38.06,Default,,0000,0000,0000,,Are we factoring in fairness\Nas we're developing systems?
Dialogue: 0,0:06:38.06,0:06:41.45,Default,,0000,0000,0000,,And finally, why we code matters.
Dialogue: 0,0:06:41.45,0:06:44.16,Default,,0000,0000,0000,,We've used tools of computational creation
Dialogue: 0,0:06:44.16,0:06:46.34,Default,,0000,0000,0000,,to unlock immense wealth.
Dialogue: 0,0:06:46.34,0:06:48.39,Default,,0000,0000,0000,,We now have the opportunity
Dialogue: 0,0:06:48.39,0:06:51.09,Default,,0000,0000,0000,,to unlock even greater equality
Dialogue: 0,0:06:51.09,0:06:53.56,Default,,0000,0000,0000,,if we make social change a priority
Dialogue: 0,0:06:53.56,0:06:56.73,Default,,0000,0000,0000,,and not an afterthought.
Dialogue: 0,0:06:56.73,0:07:00.99,Default,,0000,0000,0000,,And so these are the three tenets\Nthat will make up the incoding movement.
Dialogue: 0,0:07:00.99,0:07:02.68,Default,,0000,0000,0000,,Who codes matters,
Dialogue: 0,0:07:02.68,0:07:04.34,Default,,0000,0000,0000,,how we code matters,
Dialogue: 0,0:07:04.34,0:07:06.50,Default,,0000,0000,0000,,and why we code matters.
Dialogue: 0,0:07:06.50,0:07:09.51,Default,,0000,0000,0000,,So to go towards incoding,\Nwe can start thinking about
Dialogue: 0,0:07:09.51,0:07:12.59,Default,,0000,0000,0000,,building platforms that can identify bias
Dialogue: 0,0:07:12.59,0:07:15.91,Default,,0000,0000,0000,,by collecting people's experiences\Nlike the ones I shared,
Dialogue: 0,0:07:15.91,0:07:18.89,Default,,0000,0000,0000,,but also auditing existing software.
Dialogue: 0,0:07:18.89,0:07:22.68,Default,,0000,0000,0000,,We can also start to create\Nmore inclusive training sets.
Dialogue: 0,0:07:22.68,0:07:25.58,Default,,0000,0000,0000,,Imagine a selfies for inclusion campaign
Dialogue: 0,0:07:25.58,0:07:27.92,Default,,0000,0000,0000,,where you and I can help developers
Dialogue: 0,0:07:27.92,0:07:31.38,Default,,0000,0000,0000,,test and create more\Ninclusive training sets.
Dialogue: 0,0:07:31.38,0:07:34.74,Default,,0000,0000,0000,,And we can also start\Nthinking more conscientiously
Dialogue: 0,0:07:34.74,0:07:40.19,Default,,0000,0000,0000,,about the social impact\Nof the technology that we're developing.
Dialogue: 0,0:07:40.19,0:07:42.53,Default,,0000,0000,0000,,To get the incoding movement started,
Dialogue: 0,0:07:42.53,0:07:45.47,Default,,0000,0000,0000,,I've launched the Algorithmic\NJustice League,
Dialogue: 0,0:07:45.47,0:07:48.49,Default,,0000,0000,0000,,where anyone who cares about fairness
Dialogue: 0,0:07:48.49,0:07:51.37,Default,,0000,0000,0000,,can help fight the coded gaze.
Dialogue: 0,0:07:51.37,0:07:54.16,Default,,0000,0000,0000,,On codedgaze.com, you can report bias,
Dialogue: 0,0:07:54.16,0:07:56.07,Default,,0000,0000,0000,,request audits, become a tester,
Dialogue: 0,0:07:56.07,0:07:59.88,Default,,0000,0000,0000,,and join the ongoing conversation,
Dialogue: 0,0:07:59.88,0:08:03.33,Default,,0000,0000,0000,,#codedgaze.
Dialogue: 0,0:08:03.33,0:08:05.92,Default,,0000,0000,0000,,So I invite you to join me
Dialogue: 0,0:08:05.92,0:08:09.62,Default,,0000,0000,0000,,in creating a world where technology\Nworks for all of us,
Dialogue: 0,0:08:09.62,0:08:11.68,Default,,0000,0000,0000,,not just some of us,
Dialogue: 0,0:08:11.68,0:08:16.07,Default,,0000,0000,0000,,a world where we value inclusion\Nand center social change.
Dialogue: 0,0:08:16.07,0:08:18.26,Default,,0000,0000,0000,,Thank you.
Dialogue: 0,0:08:18.26,0:08:23.00,Default,,0000,0000,0000,,(Applause)
Dialogue: 0,0:08:23.53,0:08:26.93,Default,,0000,0000,0000,,But I have one question.
Dialogue: 0,0:08:26.93,0:08:28.78,Default,,0000,0000,0000,,Will you join me in the fight?
Dialogue: 0,0:08:28.78,0:08:30.99,Default,,0000,0000,0000,,(Laughter)
Dialogue: 0,0:08:30.99,0:08:33.35,Default,,0000,0000,0000,,(Applause)