[Script Info]
Title: 
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:06.66,0:00:11.02,Default,,0000,0000,0000,,In 2011, a team of physicists reported\Na startling discovery:
Dialogue: 0,0:00:11.02,0:00:13.54,Default,,0000,0000,0000,,neutrinos traveled faster \Nthan the speed of light
Dialogue: 0,0:00:13.54,0:00:15.88,Default,,0000,0000,0000,,by 60 billionths of a second
Dialogue: 0,0:00:15.88,0:00:20.57,Default,,0000,0000,0000,,in their 730 kilometer trip from Geneva\Nto a detector in Italy.
Dialogue: 0,0:00:20.57,0:00:25.32,Default,,0000,0000,0000,,Despite six months of double checking,\Nthe bizarre discovery refused to yield.
Dialogue: 0,0:00:25.32,0:00:27.80,Default,,0000,0000,0000,,But rather than celebrating \Na physics revolution,
Dialogue: 0,0:00:27.80,0:00:30.08,Default,,0000,0000,0000,,the researchers published a cautious paper
Dialogue: 0,0:00:30.08,0:00:35.10,Default,,0000,0000,0000,,arguing for continued research in an\Neffort to explain the observed anomaly.
Dialogue: 0,0:00:35.10,0:00:41.27,Default,,0000,0000,0000,,In time, the error was tracked to a single\Nincorrectly connected fiber optic cable.
Dialogue: 0,0:00:41.27,0:00:45.74,Default,,0000,0000,0000,,This example reminds us that real\Nscience is more than static textbooks.
Dialogue: 0,0:00:45.74,0:00:49.65,Default,,0000,0000,0000,,Instead, researchers around the world\Nare continuously publishing
Dialogue: 0,0:00:49.65,0:00:51.26,Default,,0000,0000,0000,,their latest discoveries
Dialogue: 0,0:00:51.26,0:00:54.96,Default,,0000,0000,0000,,with each paper adding \Nto the scientific conversation.
Dialogue: 0,0:00:54.96,0:00:57.42,Default,,0000,0000,0000,,Published studies \Ncan motivate future research,
Dialogue: 0,0:00:57.42,0:00:59.22,Default,,0000,0000,0000,,inspire new products,
Dialogue: 0,0:00:59.22,0:01:01.34,Default,,0000,0000,0000,,and inform government policy.
Dialogue: 0,0:01:01.34,0:01:05.14,Default,,0000,0000,0000,,So it's important that we have confidence\Nin the published results.
Dialogue: 0,0:01:05.14,0:01:06.73,Default,,0000,0000,0000,,If their conclusions are wrong,
Dialogue: 0,0:01:06.73,0:01:07.96,Default,,0000,0000,0000,,we risk time,
Dialogue: 0,0:01:07.96,0:01:09.12,Default,,0000,0000,0000,,resources,
Dialogue: 0,0:01:09.12,0:01:12.28,Default,,0000,0000,0000,,and even our health in the pursuit\Nof false leads.
Dialogue: 0,0:01:12.28,0:01:13.91,Default,,0000,0000,0000,,When findings are significant,
Dialogue: 0,0:01:13.91,0:01:17.00,Default,,0000,0000,0000,,they are frequently double-checked\Nby other researchers,
Dialogue: 0,0:01:17.00,0:01:18.100,Default,,0000,0000,0000,,either by reanalyzing the data
Dialogue: 0,0:01:18.100,0:01:21.89,Default,,0000,0000,0000,,or by redoing the entire experiment.
Dialogue: 0,0:01:21.89,0:01:25.50,Default,,0000,0000,0000,,For example, it took repeated \Ninvestigation of the CERN data
Dialogue: 0,0:01:25.50,0:01:28.77,Default,,0000,0000,0000,,before the timing error was tracked down.
Dialogue: 0,0:01:28.77,0:01:33.21,Default,,0000,0000,0000,,Unfortunately, there are currently neither\Nthe resources nor professional incentives
Dialogue: 0,0:01:33.21,0:01:38.62,Default,,0000,0000,0000,,to double check the more than 1 million\Nscientific papers published annually.
Dialogue: 0,0:01:38.62,0:01:42.72,Default,,0000,0000,0000,,Even when papers are challenged,\Nthe results are not reassuring.
Dialogue: 0,0:01:42.72,0:01:46.30,Default,,0000,0000,0000,,Recent studies that examined dozens\Nof published pharmaceutical papers
Dialogue: 0,0:01:46.30,0:01:50.81,Default,,0000,0000,0000,,managed to replicate the results of\Nless than 25% of them.
Dialogue: 0,0:01:50.81,0:01:54.59,Default,,0000,0000,0000,,And similar results have been found\Nin other scientific disciplines.
Dialogue: 0,0:01:54.59,0:01:58.32,Default,,0000,0000,0000,,There are a variety of sources \Nfor irreproducible results.
Dialogue: 0,0:01:58.32,0:02:03.60,Default,,0000,0000,0000,,Errors could hide in their original\Ndesign, execution, or analysis of the data.
Dialogue: 0,0:02:03.60,0:02:04.81,Default,,0000,0000,0000,,Unknown factors,
Dialogue: 0,0:02:04.81,0:02:08.24,Default,,0000,0000,0000,,such as patients' undisclosed condition\Nin a medical study,
Dialogue: 0,0:02:08.24,0:02:11.91,Default,,0000,0000,0000,,can produce results that are \Nnot repeatable in new test subjects.
Dialogue: 0,0:02:11.91,0:02:15.89,Default,,0000,0000,0000,,And sometimes, the second research group\Ncan't reproduce the original results
Dialogue: 0,0:02:15.89,0:02:20.37,Default,,0000,0000,0000,,simply because they don't know\Nexactly what the original group did.
Dialogue: 0,0:02:20.37,0:02:23.73,Default,,0000,0000,0000,,However, some problems might stem\Nfrom systematic decisions
Dialogue: 0,0:02:23.73,0:02:26.02,Default,,0000,0000,0000,,in how we do science.
Dialogue: 0,0:02:26.02,0:02:26.92,Default,,0000,0000,0000,,Researchers,
Dialogue: 0,0:02:26.92,0:02:28.55,Default,,0000,0000,0000,,the institutions that employ them,
Dialogue: 0,0:02:28.55,0:02:31.26,Default,,0000,0000,0000,,and the scientific journals \Nthat publish findings
Dialogue: 0,0:02:31.26,0:02:34.69,Default,,0000,0000,0000,,are expected to produce \Nbig results frequently.
Dialogue: 0,0:02:34.69,0:02:37.04,Default,,0000,0000,0000,,Important papers can advance careers,
Dialogue: 0,0:02:37.04,0:02:38.96,Default,,0000,0000,0000,,generate media interest,
Dialogue: 0,0:02:38.96,0:02:41.10,Default,,0000,0000,0000,,and secure essential funding,
Dialogue: 0,0:02:41.10,0:02:45.48,Default,,0000,0000,0000,,so there's slim motivation for researchers\Nto challenge their own exciting results.
Dialogue: 0,0:02:45.48,0:02:47.64,Default,,0000,0000,0000,,In addition, little incentive exists
Dialogue: 0,0:02:47.64,0:02:51.61,Default,,0000,0000,0000,,to publish results unsupportive\Nof the expected hypothesis.
Dialogue: 0,0:02:51.61,0:02:55.01,Default,,0000,0000,0000,,That results in a deluge of agreement\Nbetween what was expected
Dialogue: 0,0:02:55.01,0:02:56.62,Default,,0000,0000,0000,,and what was found.
Dialogue: 0,0:02:56.62,0:03:00.07,Default,,0000,0000,0000,,In rare occasions, this can even lead\Nto deliberate fabrication,
Dialogue: 0,0:03:00.07,0:03:04.78,Default,,0000,0000,0000,,such as in 2013, when a researcher\Nspiked rabbit blood with human blood
Dialogue: 0,0:03:04.78,0:03:08.89,Default,,0000,0000,0000,,to give false evidence that \Nhis HIV vaccine was working.
Dialogue: 0,0:03:08.89,0:03:10.89,Default,,0000,0000,0000,,The publish or perish mindset
Dialogue: 0,0:03:10.89,0:03:15.41,Default,,0000,0000,0000,,can also compromise academic journals'\Ntraditional peer-review processes
Dialogue: 0,0:03:15.41,0:03:16.72,Default,,0000,0000,0000,,which are safety checks
Dialogue: 0,0:03:16.72,0:03:20.46,Default,,0000,0000,0000,,where experts examine submitted papers\Nfor potential shortcomings.
Dialogue: 0,0:03:20.46,0:03:21.54,Default,,0000,0000,0000,,The current system,
Dialogue: 0,0:03:21.54,0:03:24.20,Default,,0000,0000,0000,,which might involve only one\Nor two reviewers,
Dialogue: 0,0:03:24.20,0:03:26.15,Default,,0000,0000,0000,,can be woefully ineffective.
Dialogue: 0,0:03:26.15,0:03:28.58,Default,,0000,0000,0000,,That was demonstrated in a 1998 study
Dialogue: 0,0:03:28.58,0:03:32.65,Default,,0000,0000,0000,,where eight weaknesses were deliberately\Ninserted into papers,
Dialogue: 0,0:03:32.65,0:03:36.29,Default,,0000,0000,0000,,but only around 25% \Nwere caught upon review.
Dialogue: 0,0:03:36.29,0:03:40.84,Default,,0000,0000,0000,,Many scientists are working toward\Nimproving reproducibility in their fields.
Dialogue: 0,0:03:40.84,0:03:42.94,Default,,0000,0000,0000,,There's a push to make researchers\Nraw data,
Dialogue: 0,0:03:42.94,0:03:44.56,Default,,0000,0000,0000,,experimental procedures,
Dialogue: 0,0:03:44.56,0:03:47.73,Default,,0000,0000,0000,,and analytical techniques \Nmore openly available
Dialogue: 0,0:03:47.73,0:03:50.56,Default,,0000,0000,0000,,in order to ease replication efforts.
Dialogue: 0,0:03:50.56,0:03:53.03,Default,,0000,0000,0000,,The peer review process can also\Nbe strengthened
Dialogue: 0,0:03:53.03,0:03:57.10,Default,,0000,0000,0000,,to more efficiently weed out weak papers\Nprior to publication.
Dialogue: 0,0:03:57.10,0:04:00.02,Default,,0000,0000,0000,,And we could temper the pressure\Nto find big results
Dialogue: 0,0:04:00.02,0:04:04.19,Default,,0000,0000,0000,,by publishing more papers that fail\Nto confirm the original hypothesis,
Dialogue: 0,0:04:04.19,0:04:08.67,Default,,0000,0000,0000,,an event that happens far more than\Ncurrent scientific literature suggests.
Dialogue: 0,0:04:08.67,0:04:12.31,Default,,0000,0000,0000,,Science always has, and always will,\Nencounter some false starts
Dialogue: 0,0:04:12.31,0:04:15.39,Default,,0000,0000,0000,,as part of the collective acquisition\Nof new knowledge.
Dialogue: 0,0:04:15.39,0:04:18.31,Default,,0000,0000,0000,,Finding ways to improve \Nthe reproducibility of our results
Dialogue: 0,0:04:18.31,0:04:21.60,Default,,0000,0000,0000,,can help us weed out those false starts\Nmore effectively,
Dialogue: 0,0:04:21.60,0:04:24.67,Default,,0000,0000,0000,,keeping us moving steadily toward\Nexciting new discoveries.