1 00:00:24,767 --> 00:00:29,430 Each week I come across an article or a report 2 00:00:29,430 --> 00:00:33,476 that asserts that data is the new oil, 3 00:00:33,476 --> 00:00:36,702 that the use of data will lead to a new era of knowledge, 4 00:00:37,372 --> 00:00:39,300 or even that it can predict the future. 5 00:00:39,700 --> 00:00:43,504 This has been particularly true since everyone started talking about big data. 6 00:00:43,504 --> 00:00:46,804 You know, the use of large-scale data, mega data. 7 00:00:47,723 --> 00:00:50,673 For example, Sergei Brin, the founder of Google, 8 00:00:50,673 --> 00:00:53,490 who is focusing on the use of medical data 9 00:00:53,490 --> 00:00:56,290 to cure Parkinson's disease, for which he is at risk. 10 00:00:57,044 --> 00:01:00,014 During the World Cup, many people said 11 00:01:00,014 --> 00:01:03,673 that the German team was able to beat the Brazilian team 7-1 12 00:01:03,673 --> 00:01:06,033 thanks to the use of match data. 13 00:01:07,263 --> 00:01:08,263 It's clear 14 00:01:08,263 --> 00:01:11,525 that there is no field or type of organization 15 00:01:11,525 --> 00:01:13,082 for which Big Data 16 00:01:13,082 --> 00:01:16,352 isn't supposed to be a magic wand that will enable 17 00:01:16,352 --> 00:01:18,642 the resolution of extremely complex problems. 18 00:01:19,741 --> 00:01:22,741 And I must admit that I feel uneasy 19 00:01:22,743 --> 00:01:25,537 about these kinds of simplistic statements, 20 00:01:25,537 --> 00:01:29,187 which I see as overshadowing a number of issues, including the economy, 21 00:01:29,195 --> 00:01:30,505 the environment, 22 00:01:30,507 --> 00:01:31,402 politics, 23 00:01:31,402 --> 00:01:33,802 and the ethics of the massive production of data. 24 00:01:35,233 --> 00:01:37,638 Please don't think that I am skeptical 25 00:01:37,638 --> 00:01:39,918 or doubtful about data, 26 00:01:39,925 --> 00:01:42,505 or that I am opposed to all forms of quantification. 27 00:01:42,803 --> 00:01:43,803 On the contrary, 28 00:01:43,803 --> 00:01:45,912 I live surrounded by data. 29 00:01:45,912 --> 00:01:49,870 During the day, I'm working on a thesis in sociology at Telecom ParisTech 30 00:01:49,870 --> 00:01:51,102 where I study Open Data. 31 00:01:51,102 --> 00:01:54,186 The important effort to provide open access to public data. 32 00:01:54,186 --> 00:01:56,496 And I study the consequences of Open Data 33 00:01:56,496 --> 00:01:58,772 for the operation of government. 34 00:01:58,772 --> 00:02:01,627 At night, I am the administrator for an association, 35 00:02:01,627 --> 00:02:03,653 Open Knowledge Foundation France, 36 00:02:03,653 --> 00:02:08,310 which campaigns for open knowledge and for data that benefits everyone. 37 00:02:08,310 --> 00:02:10,227 Today, I would like to persuade you 38 00:02:10,227 --> 00:02:13,114 that, at this time, when data is becoming obtrusive, 39 00:02:13,114 --> 00:02:15,583 we need to take a step back. 40 00:02:15,583 --> 00:02:17,574 This coronation of data that we are witnessing 41 00:02:17,574 --> 00:02:19,548 during the era of Open Data and Big Data 42 00:02:19,548 --> 00:02:22,364 demands a new culture of critical thought about data. 43 00:02:22,364 --> 00:02:26,784 We must be able to understand how it is produced and used, 44 00:02:26,784 --> 00:02:28,999 and how we can become independent from it. 45 00:02:28,999 --> 00:02:32,468 I also want to share the results of an experiment 46 00:02:32,468 --> 00:02:35,279 that we did at Open Knowledge Foundation France 47 00:02:35,279 --> 00:02:37,246 called "the School of Data." 48 00:02:37,246 --> 00:02:40,468 I hope to show that, through the use of data, 49 00:02:40,468 --> 00:02:43,528 we can manage to develop this culture of critical thought 50 00:02:43,533 --> 00:02:46,513 and that we can develop new checks and balances. 51 00:02:46,513 --> 00:02:49,291 So, what are the problems with data? 52 00:02:50,659 --> 00:02:53,711 The first problem is that data is always right. 53 00:02:53,711 --> 00:02:56,858 Now, don't believe that this is anything new. 54 00:02:56,858 --> 00:03:00,511 Historically, the word 'data' comes from the Latin word "datum" 55 00:03:00,511 --> 00:03:03,791 which, in mathematics and theology 56 00:03:03,791 --> 00:03:05,534 in the 15th century, referred to 57 00:03:05,534 --> 00:03:07,689 the facts taken as given in an argument 58 00:03:07,689 --> 00:03:09,919 and which were not to be called into question. 59 00:03:09,919 --> 00:03:12,311 Today, as you know, data refers 60 00:03:12,321 --> 00:03:14,331 to everything that flows in your computer. 61 00:03:14,331 --> 00:03:17,830 That is to say, the 1's and 0's that pass from USB stick to hard disk 62 00:03:17,830 --> 00:03:18,830 are considered data. 63 00:03:19,774 --> 00:03:20,802 On the other hand, 64 00:03:20,802 --> 00:03:22,432 the sense that data is a given, 65 00:03:22,432 --> 00:03:23,598 that it is factual, 66 00:03:23,598 --> 00:03:25,307 that it is not to be questioned, 67 00:03:25,307 --> 00:03:26,007 has remained. 68 00:03:27,825 --> 00:03:29,865 The second problem with data 69 00:03:29,865 --> 00:03:32,407 is that we don't really know where it comes from. 70 00:03:32,574 --> 00:03:34,885 In general, when someone uses data, 71 00:03:34,885 --> 00:03:37,418 he or she has very little information about the way 72 00:03:37,418 --> 00:03:38,918 in which it was produced. 73 00:03:38,918 --> 00:03:41,068 At best, you will have access to metadata, 74 00:03:41,068 --> 00:03:43,094 that is to say, data about the data, 75 00:03:43,094 --> 00:03:46,984 which will tell you the contents of the file and, occasionally, 76 00:03:46,984 --> 00:03:49,077 how the data was produced. 77 00:03:49,938 --> 00:03:52,458 However, that data has a long history. 78 00:03:53,494 --> 00:03:54,744 It was collected. 79 00:03:54,744 --> 00:03:57,073 It was processed, formatted, 80 00:03:57,073 --> 00:03:59,871 aggregated, processed by algorithms, 81 00:03:59,871 --> 00:04:03,083 and visualized before reaching you. 82 00:04:03,083 --> 00:04:05,383 This is why sociologist Bruno Latour asserts 83 00:04:05,393 --> 00:04:07,833 that we should say 'obtaineds' instead of data 84 00:04:07,833 --> 00:04:10,167 to accurately reflect this long history 85 00:04:10,167 --> 00:04:12,557 which will constrain a number of uses. 86 00:04:13,268 --> 00:04:15,939 Finally, the third problem with data 87 00:04:15,939 --> 00:04:17,869 is that we can't really see it. 88 00:04:17,869 --> 00:04:19,915 Have you ever seen a data center, 89 00:04:19,915 --> 00:04:22,871 even if only from outside, or from the road? 90 00:04:22,871 --> 00:04:25,840 Do you have any idea of where your data is stored? 91 00:04:25,840 --> 00:04:28,521 I mean, physically, where it is stored? 92 00:04:28,521 --> 00:04:31,512 Do you have any idea what will happen to it in 10 years? 93 00:04:31,512 --> 00:04:34,483 In any case, I have no answer for these three questions. 94 00:04:34,483 --> 00:04:38,173 However, even if we can't see our data, we can measure its effects. 95 00:04:38,173 --> 00:04:41,251 At the individual level, 96 00:04:41,251 --> 00:04:43,771 when Facebook changes its terms of service 97 00:04:43,771 --> 00:04:47,685 or modifies its algorithm, it has consequences for your private life 98 00:04:47,685 --> 00:04:50,720 and for the way in which you present yourself as an individual. 99 00:04:50,720 --> 00:04:53,620 And on the most macroscopic level, the Snowden affair has shown 100 00:04:53,620 --> 00:04:56,120 that the massive production of data 101 00:04:56,120 --> 00:04:58,943 can have consequences for the sovereignty of the State 102 00:04:58,943 --> 00:05:00,433 or for diplomacy. 103 00:05:01,509 --> 00:05:03,699 This is why we must develop a culture 104 00:05:03,699 --> 00:05:05,465 of critical thought about data. 105 00:05:05,465 --> 00:05:06,715 To encourage myself, 106 00:05:06,715 --> 00:05:11,675 I was inspired by a book called "Statactivism." 107 00:05:11,675 --> 00:05:13,811 Statactivism is a neologism 108 00:05:13,811 --> 00:05:16,811 proposed by researchers and artists 109 00:05:16,811 --> 00:05:21,273 that refers to those experiences that permit one to liberate oneself 110 00:05:21,273 --> 00:05:22,989 from the power of data. 111 00:05:22,989 --> 00:05:25,268 The fundamental basis of statactivism 112 00:05:25,268 --> 00:05:27,456 is that data controls us, 113 00:05:27,456 --> 00:05:30,379 and that it imposes on us like an argument from authority. 114 00:05:30,379 --> 00:05:33,787 The goal of statactivism is almost revolutionary. 115 00:05:33,787 --> 00:05:36,293 It asserts that other kinds of data must be possible. 116 00:05:36,293 --> 00:05:38,697 It is not necessary to be opposed to all data. 117 00:05:38,697 --> 00:05:41,197 Instead, we should use the power of data 118 00:05:41,197 --> 00:05:42,728 to propose other realities 119 00:05:42,730 --> 00:05:44,557 to critique data more effectively, 120 00:05:44,557 --> 00:05:46,744 or to propose other measures. 121 00:05:46,744 --> 00:05:49,054 In short, to propose other data. 122 00:05:49,056 --> 00:05:52,516 There is a motif in the book which I find particularly meaningful, 123 00:05:52,520 --> 00:05:53,950 that of the judoka. 124 00:05:54,947 --> 00:05:58,617 Judoka use the strength of their opponents in order to turn it back on them. 125 00:05:59,490 --> 00:06:02,273 That is what I want to invite you to do today: 126 00:06:02,273 --> 00:06:06,723 think about how to use data to better analyze it. 127 00:06:08,372 --> 00:06:11,529 I think, precisely at this moment in the development of Open Data, 128 00:06:11,529 --> 00:06:14,413 the need to develop a culture of critical thought about data 129 00:06:14,413 --> 00:06:16,633 is increasingly crucial. 130 00:06:17,462 --> 00:06:20,982 Don't be misled: Open Data represents an extraordinary opportunity. 131 00:06:20,987 --> 00:06:23,027 The volume of data is exploding 132 00:06:23,027 --> 00:06:25,906 and data is no longer the privilege of the powerful. 133 00:06:25,906 --> 00:06:28,141 Today, you can use data 134 00:06:28,141 --> 00:06:30,119 without asking anyone's permission. 135 00:06:30,119 --> 00:06:33,727 And this is a good idea, because public data is available. 136 00:06:33,727 --> 00:06:35,381 But I think that there is a risk 137 00:06:35,381 --> 00:06:38,066 to thinking that the simple diffusion of data 138 00:06:38,066 --> 00:06:40,106 will be enough to emancipate society, 139 00:06:40,112 --> 00:06:43,539 that individuals can emancipate themselves from the power of data 140 00:06:43,539 --> 00:06:45,510 just because they have access to data. 141 00:06:46,390 --> 00:06:49,253 There is a Canadian sociologist named Michael Gurstein 142 00:06:49,253 --> 00:06:53,473 who has proposed an expression that sums up a risk of Open data, 143 00:06:53,477 --> 00:06:56,587 namely, "Empower the Empowered," 144 00:06:56,587 --> 00:06:59,475 meaning to give more power to those who already have it. 145 00:06:59,475 --> 00:07:02,938 That is why it's crucial to develop a culture of critical thought 146 00:07:02,938 --> 00:07:05,578 to be able to understand how data is produced, 147 00:07:05,578 --> 00:07:09,267 used, and how you can use it to take a step back. 148 00:07:10,005 --> 00:07:11,360 Well, that's the theory. 149 00:07:11,360 --> 00:07:14,550 I would like to share with you the first results from an experiment 150 00:07:14,550 --> 00:07:18,254 that we did in my association: Open Knowledge Foundation France. 151 00:07:18,254 --> 00:07:22,028 We are part of a worldwide network dedicated to open knowledge and open data. 152 00:07:22,028 --> 00:07:24,005 We have groups in more than 50 countries. 153 00:07:24,005 --> 00:07:26,926 And the idea of our association and of this worldwide movement 154 00:07:26,926 --> 00:07:29,483 is that each person can benefit, can profit, 155 00:07:29,483 --> 00:07:33,483 from works, scientific articles, and content, 156 00:07:33,483 --> 00:07:37,344 to create, play, educate, or to start up a business. 157 00:07:38,225 --> 00:07:40,913 Open Knowledge has a large number of projects. 158 00:07:40,913 --> 00:07:43,909 I'm going to talk about one project, the "School of Data." 159 00:07:43,909 --> 00:07:47,433 We participated together in the translation of this project, 160 00:07:47,433 --> 00:07:48,885 this "School of Data." 161 00:07:48,885 --> 00:07:51,744 The School of Data consists of online resources 162 00:07:51,744 --> 00:07:53,834 that are free and accessible to all, 163 00:07:53,834 --> 00:07:55,339 and also events. 164 00:07:56,306 --> 00:07:58,097 We first proposed classes. 165 00:07:58,603 --> 00:08:02,016 In these classes, you do not even have to know what data is. 166 00:08:02,016 --> 00:08:05,162 Or how to use a spreadsheet, which is really the tool of choice. 167 00:08:05,162 --> 00:08:07,444 You will be taught about that in our class. 168 00:08:07,931 --> 00:08:10,159 No expertise is required, 169 00:08:10,159 --> 00:08:14,519 you are guided step by step in the use of data. 170 00:08:14,519 --> 00:08:17,739 We also use another format which is particularly educational, 171 00:08:17,739 --> 00:08:19,279 namely, the recipe. 172 00:08:19,287 --> 00:08:22,290 Recipes are just like in cooking - you have ingredients 173 00:08:22,290 --> 00:08:23,293 and steps. 174 00:08:23,293 --> 00:08:25,284 The ingredients will be data, 175 00:08:25,284 --> 00:08:27,994 software - free if possible, 176 00:08:27,994 --> 00:08:31,329 so that you can use data. 177 00:08:31,329 --> 00:08:34,440 The idea is that making a map of electoral results, 178 00:08:34,440 --> 00:08:36,879 or a graph of results of the French soccer team 179 00:08:36,879 --> 00:08:40,142 should be as easy to do as making a tarte Tatin or Bechamel sauce. 180 00:08:40,142 --> 00:08:41,895 You find the resources online 181 00:08:41,895 --> 00:08:44,595 and we walk you through the project step by step. 182 00:08:44,595 --> 00:08:48,040 We also have tried to develop another format for in-person sessions, 183 00:08:48,040 --> 00:08:49,741 which we call expeditions. 184 00:08:50,117 --> 00:08:52,644 For expeditions, it's like mountain climbing: 185 00:08:52,644 --> 00:08:55,103 you have a guide, a "data sherpa," 186 00:08:55,103 --> 00:08:56,993 who will accompany you, 187 00:08:56,993 --> 00:08:58,233 attached by a rope. 188 00:08:58,233 --> 00:09:01,432 There will be 10 or 20 participants 189 00:09:01,432 --> 00:09:05,267 who work together during a weekend or sometimes for a few hours. 190 00:09:05,769 --> 00:09:07,631 Our first data expedition 191 00:09:07,631 --> 00:09:10,991 focused on the question of air pollution in Île-de-France. 192 00:09:10,991 --> 00:09:12,675 I don't know if you have seen 193 00:09:12,675 --> 00:09:15,325 these images of Paris with black clouds of pollution. 194 00:09:15,325 --> 00:09:18,060 They left their mark on us, and we said to ourselves: 195 00:09:18,060 --> 00:09:21,729 "Well, let's dig into this set of data." 196 00:09:22,458 --> 00:09:25,469 The first step, when we undertook this data expedition, 197 00:09:25,469 --> 00:09:27,741 was to identify the available data. 198 00:09:27,749 --> 00:09:31,041 We realized that there is no available data 199 00:09:31,041 --> 00:09:34,801 that is freely reusable, that is to say, that you have the right to reuse 200 00:09:34,801 --> 00:09:37,466 without asking for permission, on this crucial question. 201 00:09:37,466 --> 00:09:40,679 Therefore, we had to extract data from websites, 202 00:09:40,679 --> 00:09:43,299 reports, or even from graphics. 203 00:09:43,299 --> 00:09:47,127 Imagine what a mess it is to expose data that is in a graphic. 204 00:09:47,811 --> 00:09:50,402 We also realized that Airparif, 205 00:09:50,402 --> 00:09:53,161 the organization responsible for the production of data 206 00:09:53,161 --> 00:09:56,411 relevant to the question of air pollution in Île-de-France 207 00:09:56,411 --> 00:09:59,581 does not allow you to use its data freely. 208 00:09:59,581 --> 00:10:02,127 One must ask permission, or pay. 209 00:10:03,130 --> 00:10:05,164 We were able to overcome these constraints 210 00:10:05,164 --> 00:10:07,701 and to conduct this expedition 211 00:10:07,701 --> 00:10:10,571 guided by our sherpa, Pierre. 212 00:10:10,571 --> 00:10:13,987 During this data expedition 213 00:10:13,987 --> 00:10:18,227 we broke into small groups, and each group was assigned an angle. 214 00:10:18,227 --> 00:10:22,257 One of the principles of the expeditions: you have an angle, like in journalism, 215 00:10:22,257 --> 00:10:25,316 we ask ourselves questions that could be the title of an article. 216 00:10:25,316 --> 00:10:26,996 The first group asked itself 217 00:10:26,999 --> 00:10:31,484 if bicycle riding had led to a decrease in air pollution in Paris. 218 00:10:31,484 --> 00:10:32,524 The second group, 219 00:10:32,524 --> 00:10:34,254 since it was during a strike, 220 00:10:34,254 --> 00:10:37,464 asked itself if public transport strikes 221 00:10:37,464 --> 00:10:40,616 cause air pollution in Île-de-France to increase. 222 00:10:40,984 --> 00:10:44,384 And the third group asked if all regions are equal 223 00:10:44,384 --> 00:10:48,424 with regard to air pollution, or if geography and environment 224 00:10:48,424 --> 00:10:51,438 could have an effect, and if so, could be seen in the data. 225 00:10:53,617 --> 00:10:55,173 The results of this expedition, 226 00:10:55,173 --> 00:10:57,373 I am sorry to say, will be a bit disappointing. 227 00:10:57,373 --> 00:11:01,440 We did not find any correlation or causal connection 228 00:11:01,440 --> 00:11:04,320 with nice data points, a fitting curve, or a straight line, 229 00:11:04,320 --> 00:11:06,546 that proves that our hypotheses are correct. 230 00:11:06,546 --> 00:11:10,186 We did not succeed at that, but we worked for four hours. 231 00:11:10,186 --> 00:11:12,196 What we did manage to show, on the other hand, 232 00:11:12,196 --> 00:11:14,007 is that it is extremely difficult 233 00:11:14,007 --> 00:11:17,838 to use data concerning a question as crucial as air pollution, 234 00:11:17,838 --> 00:11:20,438 to understand how it is produced, 235 00:11:20,438 --> 00:11:23,228 extremely difficult to use it, 236 00:11:23,228 --> 00:11:26,084 that the most simple measurements are not accessible, 237 00:11:26,084 --> 00:11:29,336 and that you do not necessarily have the right to reuse them. 238 00:11:29,336 --> 00:11:32,346 That is just what we tried to do at this event: 239 00:11:32,346 --> 00:11:35,426 to develop a culture of critical thought on the way in which data 240 00:11:35,426 --> 00:11:38,491 is used concerning the question of air pollution. 241 00:11:38,491 --> 00:11:43,359 We also tried to develop this format of expeditions and training events 242 00:11:43,359 --> 00:11:45,149 with another group 243 00:11:45,149 --> 00:11:46,239 that is less expected, 244 00:11:46,239 --> 00:11:48,131 that of children. 245 00:11:48,131 --> 00:11:53,061 We asked ourselves the question during an event that we did with Etalab, 246 00:11:53,061 --> 00:11:56,661 the government institution in charge of data.gouv.fr, 247 00:11:56,661 --> 00:11:59,500 the open data portal of the French government. 248 00:11:59,500 --> 00:12:03,737 We suggested the idea of radically different open data portals. 249 00:12:03,737 --> 00:12:07,767 They were fictional projects, just prototypes. 250 00:12:07,767 --> 00:12:12,951 There is a group that has come out with a prototype called Tada.gouv.fr. 251 00:12:12,951 --> 00:12:17,132 Tada.gouv.fr is a fictional portal, a bit idealistic, destined for children. 252 00:12:17,775 --> 00:12:21,898 The data is presented not by government department or minister, 253 00:12:21,898 --> 00:12:24,798 but by discipline, that is to say that you have data 254 00:12:24,798 --> 00:12:27,517 about history and geography, physics and chemistry, 255 00:12:27,517 --> 00:12:29,477 or life and Earth sciences. 256 00:12:29,477 --> 00:12:32,473 On this occasion, we realized that open data 257 00:12:32,473 --> 00:12:34,995 can be a fantastic resource for school 258 00:12:34,995 --> 00:12:38,295 because it allows the development of inter-disciplinary work, 259 00:12:38,305 --> 00:12:41,370 and this culture of critical thought about data I have mentioned. 260 00:12:41,916 --> 00:12:43,877 We did not leave things at observation. 261 00:12:43,877 --> 00:12:46,217 We tried to do a first experiment 262 00:12:46,217 --> 00:12:48,751 and I would like to tell you about the first results. 263 00:12:49,745 --> 00:12:51,668 We joined with Silicon Banlieue, 264 00:12:51,668 --> 00:12:54,058 which is a site dedicated to data in Argenteuil, 265 00:12:54,058 --> 00:12:56,089 and we proposed to do an event 266 00:12:56,089 --> 00:12:58,479 with children between 8 and 14 years old 267 00:12:58,479 --> 00:13:00,258 who came to the Open World Forum, 268 00:13:00,258 --> 00:13:02,546 an event dedicated to open computing in Paris. 269 00:13:02,546 --> 00:13:05,388 There, you can see me from the back. 270 00:13:05,388 --> 00:13:08,828 With the 8 to 14 year old children, we worked on the question of cinema, 271 00:13:08,828 --> 00:13:12,152 because that interested them, and it is a simple enough subject. 272 00:13:12,152 --> 00:13:13,779 First we collected data, 273 00:13:13,779 --> 00:13:16,619 nothing very complicated, it was just a paper form. 274 00:13:16,619 --> 00:13:20,026 We asked them how many times a month they go to the cinema, 275 00:13:20,026 --> 00:13:23,808 which movies they saw from a list; then we compared that with data 276 00:13:23,808 --> 00:13:27,368 that is available from the survey of French cultural practices, 277 00:13:27,368 --> 00:13:30,243 on which you have exactly the same type of data. 278 00:13:30,243 --> 00:13:33,873 With the children, we produced an infographic at this time. 279 00:13:33,873 --> 00:13:37,510 Now, I am really bad at math, I got a 7,5 on the Bac, 280 00:13:37,510 --> 00:13:40,590 I found myself explaining the concept and calculation 281 00:13:40,590 --> 00:13:43,512 of averages using a spreadsheet, which was rather surprising. 282 00:13:43,512 --> 00:13:45,362 I explained how it works. 283 00:13:45,362 --> 00:13:49,505 We emerged with an infographic and we were able on this occasion, 284 00:13:49,505 --> 00:13:53,135 I think that this is the important point, to develop a culture of critical thought. 285 00:13:53,135 --> 00:13:56,521 I explained to them about data, how it is used, 286 00:13:56,521 --> 00:13:58,304 how they can use it, 287 00:13:58,304 --> 00:14:00,914 how it controls us in a certain way, 288 00:14:00,914 --> 00:14:03,726 but that we can also take back the power over data. 289 00:14:03,726 --> 00:14:06,731 I assure you that with a topic as attractive as cinema 290 00:14:06,731 --> 00:14:08,695 we can deliver this kind of message 291 00:14:08,695 --> 00:14:10,798 and have a discussion on these questions. 292 00:14:12,058 --> 00:14:15,198 I hope that I have convinced you that it is necessary today 293 00:14:15,198 --> 00:14:17,217 to take a step back with regard to data, 294 00:14:17,217 --> 00:14:20,523 to develop a culture of critical thought, to understand 295 00:14:20,523 --> 00:14:23,574 how it is produced and how you can use it, 296 00:14:23,574 --> 00:14:26,806 to prevent data from being forced on you. 297 00:14:26,806 --> 00:14:29,554 So from today, get your hands dirty, 298 00:14:29,554 --> 00:14:32,294 find a sherpa, all of the resources are online, 299 00:14:32,294 --> 00:14:34,123 and go on a data expedition. 300 00:14:34,123 --> 00:14:35,313 Thank you. 301 00:14:35,313 --> 00:14:36,765 (Applause)