Reproducibility in the absence of selective reporting: An illustration from large‐scale brain asymmetry research

Details

Serval ID
serval:BIB_589FD42B39CD
Type
Article: article from journal or magazin.
Collection
Publications
Institution
Title
Reproducibility in the absence of selective reporting: An illustration from large‐scale brain asymmetry research
Journal
Human Brain Mapping
Author(s)
Kong Xiang-Zhen, Francks Clyde, Kong Xiang-Zhen, Mathias Samuel R., Guadalupe Tulio, Abé Christoph, Agartz Ingrid, Akudjedu Theophilus N., Aleman Andre, Alhusaini Saud, Allen Nicholas B., Ames David, Andreassen Ole A., Vasquez Alejandro Arias, Armstrong Nicola J., Asherson Phil, Bergo Felipe, Bastin Mark E., Batalla Albert, Bauer Jochen, Baune Bernhard T, Baur-Streubel Ramona, Biederman Joseph, Blaine Sara K., Boedhoe Premika, Bøen Erlend, Bose Anushree, Bralten Janita, Brandeis Daniel, Brem Silvia, Brodaty Henry, Yüksel Dilara, Brooks Samantha J., Buitelaar Jan, Bürger Christian, Bülow Robin, Calhoun Vince, Calvo Anna, Canales-Rodríguez Erick Jorge, Cannon Dara M., Caparelli Elisabeth C., Castellanos Francisco X., Cendes Fernando, Chaim-Avancini Tiffany Moukbel, Chantiluke Kaylita, Chen Qun-lin, Chen Xiayu, Cheng Yuqi, Christakou Anastasia, Clark Vincent P., Coghill David, Connolly Colm G., Conzelmann Annette, Córdova-Palomera Aldo, Cousijn Janna, Crow Tim, Cubillo Ana, Dannlowski Udo, Bruttopilo Sara Ambrosino, Zeeuw Patrick, Deary Ian J., Demeter Damion V., Di Martino Adriana, Dickie Erin W, Dietsche Bruno, Doan Nhat Trung, Doherty Colin P., Doyle Alysa, Durston Sarah, Earl Eric, Ehrlich Stefan, Ekman Carl Johan, Elvsåshagen Torbjørn, Epstein Jeffery N., Fair Damien A., Faraone Stephen V., Fernández Guillén, Flint Claas, Filho Geraldo Busatto, Förster Katharina, Fouche Jean-Paul, Foxe John J., Frodl Thomas, Fuentes-Claramonte Paola, Fullerton Janice M., Garavan Hugh, Santos Garcia Danielle, Gotlib Ian H., Goudriaan Anna E., Grabe Hans Jörgen, Groenewold Nynke A., Grotegerd Dominik, Gruber Oliver, Gurholt Tiril, Haavik Jan, Hahn Tim, Hansell Narelle K., Harris Mathew A., Hartman Catharina A., Carmen Valdés Hernández Maria, Heslenfeld Dirk, Hester Robert, Hibar Derrek Paul, Ho Beng-Choon, Ho Tiffany C., Hoekstra Pieter J., Holst Ruth J., Hoogman Martine, Høvik Marie F., Howells Fleur M., Hugdahl Kenneth, Huyser Chaim, Ingvar Martin, Ishikawa Akari, James Anthony, Jahanshad Neda, Jernigan Terry L., Jönsson Erik G, Kaleda Vasily, Kelly Clare, Kerich Michael, Keshavan Matcheri S., Khadka Sabin, Kircher Tilo, Kohls Gregor, Konrad Kerstin, Korucuoglu Ozlem, Krämer Bernd, Krug Axel, Kuntsi Jonna, Kwon Jun Soo, Lambregts-Rommelse Nanda, Landén Mikael, Lázaro Luisa, Lebedeva Irina, Lenroot Rhoshel, Lesch Klaus-Peter, Li Qinqin, Lim Kelvin O., Liu Jia, Lochner Christine, London Edythe D., Lorenzetti Valentina, Luciano Michelle, Luijten Maartje, Lundervold Astri J., Mackey Scott, MacMaster Frank P., Maingault Sophie, Malpas Charles B., Malt Ulrik F., Mataix-Cols David, Martin-Santos Rocio, Mayer Andrew R., McCarthy Hazel, Medland Sarah, Metha Mitul, Mitchell Philip B., Mueller Bryon A., Maniega Susana Muñoz, Mazoyer Bernard, McDonald Colm, McLellan Quinn, McMahon Katie L., McPhilemy Genevieve, Momenan Reza, Morales Angelica M., Narayanaswamy Janardhanan C., Moreira José Carlos Vasques, Nerland Stener, Nestor Liam, Newman Erik, Nigg Joel T., Nordvik Jan Egil, Novotny Stephanie, Weiss Eileen Oberwelland, O'Gorman Ruth L., Oosterlaan Jaap, Oranje Bob, Orr Catherine, Overs Bronwyn, Paloyelis Yannis, Pauli Paul, Paulus Martin, Plessen Kerstin Jessica, Polier Georg G., Pomarol-Clotet Edith, Portella Maria J., Qiu Jiang, Radua Joaquim, Ramos-Quiroga Josep Antoni, Reddy Y.C. Janardhan, Reif Andreas, Roberts Gloria, Rosa Pedro, Rubia Katya, Sacchet Matthew D., Sachdev Perminder S., Salvador Raymond, Schmaal Lianne, Schulte-Rüther Martin, Schweren Lizanne, Seitz Jochen, Serpa Mauricio Henriques, Shaw Philip, Shumskaya Elena, Silk Timothy J., Simmons Alan N., Simulionyte Egle, Sinha Rajita, Sjoerds Zsuzsika, Smelror Runar Elle, Soliva Joan Carlos, Solowij Nadia, Souza-Duran Fabio Luisde, Sponheim Scott R., Stein Dan J., Stein Elliot A., Stevens Michael, Strike Lachlan T., Sudre Gustavo, Sui Jing, Tamm Leanne, Temmingh Hendrik S., Thoma Robert J., Tomyshev Alexander, Tronchin Giulia, Turner Jessica, Uhlmann Anne, Erp Theo G.M., Heuvel Odile A., Meer Dennis, Eijk Liza, Vance Alasdair, Veer Ilya M., Veltman Dick J., Venkatasubramanian Ganesan, Vilarroya Oscar, Vives-Gilabert Yolanda, Voineskos Aristotle N, Völzke Henry, Vuletic Daniella, Walitza Susanne, Walter Henrik, Walton Esther, Wardlaw Joanna M., Wen Wei, Westlye Lars T., Whelan Christopher D., White Tonya, Wiers Reinout W., Wright Margaret J., Wittfeld Katharina, Yang Tony T., Yasuda Clarissa L., Yoncheva Yuliya, Yücel Murat, Yun Je-Yeon, Zanetti Marcus Vinicius, Zhen Zonglei, Zhu Xing-xing, Ziegler Georg C., Zubicaray Greig I., Zwiers Marcel, Project Karolinska Schizophrenia, Glahn David C., Crivello Fabrice, Fisher Simon E., Thompson Paul M., Francks Clyde, Farde Lars, Flyckt Lena, Engberg Göran, Erhardt Sophie, Fatouros-Bergman Helena, Cervenka Simon, Schwieler Lilly, Piehl Fredrik, Agartz Ingrid, Collste Karin, Victorsson Pauliina, Malmqvist Anna, Hedberg Mikael, Orhan Funda, Sellgren Carl
ISSN
1065-9471
1097-0193
Publication state
Published
Issued date
25/08/2020
Language
english
Abstract
The problem of poor reproducibility of scientific findings has received much attention over recent years, in a variety of fields including psychology and neuroscience. The problem has been partly attributed to publication bias and unwanted practices such as p-hacking. Low statistical power in individual studies is also understood to be an important factor. In a recent multisite collaborative study, we mapped brain anatomical left-right asymmetries for regional measures of surface area and cortical thickness, in 99 MRI datasets from around the world, for a total of over 17,000 participants. In the present study, we revisited these hemispheric effects from the perspective of reproducibility. Within each dataset, we considered that an effect had been reproduced when it matched the meta-analytic effect from the 98 other datasets, in terms of effect direction and significance threshold. In this sense, the results within each dataset were viewed as coming from separate studies in an "ideal publishing environment," that is, free from selective reporting and p hacking. We found an average reproducibility rate of 63.2% (SD = 22.9%, min = 22.2%, max = 97.0%). As expected, reproducibility was higher for larger effects and in larger datasets. Reproducibility was not obviously related to the age of participants, scanner field strength, FreeSurfer software version, cortical regional measurement reliability, or regional size. These findings constitute an empirical illustration of reproducibility in the absence of publication bias or p hacking, when assessing realistic biological effects in heterogeneous neuroscience data, and given typically-used sample sizes.
Keywords
Anatomy, Radiological and Ultrasound Technology, Radiology Nuclear Medicine and imaging, Neurology, Clinical Neurology
Pubmed
Web of science
Open Access
Yes
Create date
29/01/2021 16:21
Last modification date
30/01/2021 7:26
Usage data