Help Privacy Policy Disclaimer
  Advanced SearchBrowse


  #EEGManyLabs: Investigating the replicability of influential EEG experiments

Pavlov, Y. G., Adamian, N., Appelhoff, S., Arvaneh, M., Benwell, C. S. Y., Beste, C., et al. (2021). #EEGManyLabs: Investigating the replicability of influential EEG experiments. Cortex, 144, 213-229. doi:10.1016/j.cortex.2021.03.013.

Item is


show Files
hide Files
neu-21-wel-02-eegmanylabs.pdf (Publisher version), 2MB
MIME-Type / Checksum:
application/pdf / [MD5]
Technical Metadata:
Copyright Date:
Copyright Info:
© 2021 The Authors. Published by Elsevier Ltd. This is an open access article under the CC BY-NC-ND licens




Pavlov, Yuri G.1, 2, Author
Adamian, Nika3, Author
Appelhoff, Stefan4, Author
Arvaneh, Mahnaz5, Author
Benwell, Christopher S. Y.6, Author
Beste, Christian7, Author
Bland, Amy R.8, Author
Bradford, Daniel E.9, Author
Bublatzky, Florian10, Author
Busch, Niko A.11, Author
Clayson, Peter E.12, Author
Cruse, Damian13, Author
Czeszumski, Artur14, Author
Dreber, Anna15, 16, Author
Dumas, Guillaume17, 18, Author
Ehinger, Benedikt19, Author
Ganis, Giorgio20, Author
He, Xun21, Author
Hinojosa, José A.22, 23, Author
Huber-Huber, Christoph24, Author
Inzlicht, Michael25, AuthorJack, Bradley N.26, AuthorJohannesson, Magnus15, AuthorJones, Rhiannon27, AuthorKalenkovich, Evgenii28, AuthorKaltwasser, Laura29, AuthorKarimi-Rouzbahani, Hamid30, 31, AuthorKeil, Andreas32, AuthorKönig, Peter14, 33, AuthorKouara, Layla34, AuthorKulke, Louisa35, AuthorLadouceur, Cecile D.36, AuthorLanger, Nicolas37, 38, AuthorLiesefeld, Heinrich R.39, 40, AuthorLuque, David41, 42, AuthorMacNamara, Annmarie43, AuthorMudrik, Liad44, AuthorMuthuraman, Muthuraman45, AuthorNeal, Lauren B.46, AuthorNilsonne, Gustav47, 48, AuthorNiso, Guiomar49, 50, AuthorOcklenburg, Sebastian51, AuthorOostenveld, Robert24, AuthorPernet, Cyril R.52, AuthorPourtois, Gilles53, AuthorRuzzoli, Manuela54, AuthorSass, Sarah M.55, AuthorSchaefer, Alexandre56, AuthorSenderecka, Magdalena57, AuthorSnyder, Joel S.58, AuthorTamnes, Christian K.59, AuthorTognoli, Emmanuelle60, Authorvan Vugt, Marieke K.61, AuthorVerona, Edelyn12, AuthorVloeberghs, Robin62, AuthorWelke, Dominik63, Author           Wessel, Jan R.64, 65, AuthorZakharov, Ilya66, AuthorMushtaq, Faisal34, Author more..
1University of Tuebingen, Germany, ou_persistent22              
2Ural Federal University, Russia, ou_persistent22              
3University of Aberdeen, UK, ou_persistent22              
4Max Planck Institute for Human Development, Berlin, Germany , ou_persistent22              
5University of Sheffield, UK, ou_persistent22              
6University of Dundee, UK , ou_persistent22              
7TU Dresden, Germany, ou_persistent22              
8Manchester Metropolitan University, UK, ou_persistent22              
9University of Miami, USA , ou_persistent22              
10Heidelberg University, Germany , ou_persistent22              
11University of Münster, Germany, ou_persistent22              
12University of South Florida, USA, ou_persistent22              
13University of Birmingham, UK, ou_persistent22              
14University Osnabrück, Germany, ou_persistent22              
15Stockholm School of Economics, Sweden, ou_persistent22              
16University of Innsbruck, Austria, ou_persistent22              
17Université de Montréal, Montréal, Quebec, Canada, ou_persistent22              
18CHU Sainte-Justine Research Center, Montréal, Quebec, Canada, ou_persistent22              
19University of Stuttgart, Germany, ou_persistent22              
20University of Plymouth, UK, ou_persistent22              
21Bournemouth University, UK, ou_persistent22              
22Universidad Complutense de Madrid, Spain, ou_persistent22              
23Universidad Nebrija, Spain, ou_persistent22              
24Radboud University, Nijmegen, Netherlands, ou_persistent22              
25University of Toronto, Canada, ou_persistent22              
26The Australian National University, Canberra, Australia, ou_persistent22              
27Department of Psychology, University of Winchester, UK , ou_persistent22              
28HSE University, Moscow, Russia, ou_persistent22              
29Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, Germany, ou_persistent22              
30University of Cambridge, UK, ou_persistent22              
31Macquarie University, Sydney, Australia, ou_persistent22              
32University of Florida, USA, ou_persistent22              
33University Medical Center Hamburg-Eppendorf, Hamburg, Germany, ou_persistent22              
34University of Leeds, UK, ou_persistent22              
35Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany, ou_persistent22              
36University of Pittsburgh, USA, ou_persistent22              
37University of Zurich, Switzerland, ou_persistent22              
38Neuroscience Center Zurich, Switzerland, ou_persistent22              
39University of Bremen, Germany, ou_persistent22              
40Ludwig-Maximilians-Universität München, Germany, ou_persistent22              
41Universidad Autónoma de Madrid, Spain, ou_persistent22              
42Universidad de Málaga, Spain, ou_persistent22              
43Texas A&M University, USA, ou_persistent22              
44School of Psychological Sciences & Sagol School of Neuroscience, Tel Aviv University, Israel, ou_persistent22              
45 Johannes Gutenberg University, Mainz, Germany, ou_persistent22              
46University of Texas Permian Basin, USA, ou_persistent22              
47Karolinska Institutet, Sweden , ou_persistent22              
48Stockholm University, Sweden, ou_persistent22              
49Indiana University, Bloomington, USA, ou_persistent22              
50Universidad Politecnica de Madrid and CIBER-BBN, Spain, ou_persistent22              
51Institute of Cognitive Neuroscience, Ruhr University Bochum, Germany, ou_persistent22              
52University of Edinburgh, UK, ou_persistent22              
53CAPLAB - Ghent University, Belgium, ou_persistent22              
54University of Glasgow, Glasgow, UK, ou_persistent22              
55The University of Texas at Tyler, USA , ou_persistent22              
56Monash University (Malaysia Campus), Malaysia, ou_persistent22              
57Institute of Philosophy, Jagiellonian University, Krakow, Poland, ou_persistent22              
58Department of Psychology, University of Nevada, Las Vegas, USA, ou_persistent22              
59University of Oslo, Oslo, Norway, ou_persistent22              
60Florida Atlantic University, USA , ou_persistent22              
61University of Groningen, the Netherlands, ou_persistent22              
62KU Leuven, Belgium, ou_persistent22              
63Department of Neuroscience, Max Planck Institute for Empirical Aesthetics, Max Planck Society, ou_2421697              
64University of Iowa Hospitals and Clinics, Iowa City, USA, ou_persistent22              
65University of Iowa, Iowa City, USA, ou_persistent22              
66Russian Academy of Education, Russia, ou_persistent22              


Free keywords: EEG; ERP; Replication; Many labs; Open science; Cognitive neuroscience
 Abstract: There is growing awareness across the neuroscience community that the replicability of findings about the relationship between brain activity and cognitive phenomena can be improved by conducting studies with high statistical power that adhere to well-defined and standardised analysis pipelines. Inspired by recent efforts from the psychological sciences, and with the desire to examine some of the foundational findings using electroencephalography (EEG), we have launched #EEGManyLabs, a large-scale international collaborative replication effort. Since its discovery in the early 20th century, EEG has had a profound influence on our understanding of human cognition, but there is limited evidence on the replicability of some of the most highly cited discoveries. After a systematic search and selection process, we have identified 27 of the most influential and continually cited studies in the field. We plan to directly test the replicability of key findings from 20 of these studies in teams of at least three independent laboratories. The design and protocol of each replication effort will be submitted as a Registered Report and peer-reviewed prior to data collection. Prediction markets, open to all EEG researchers, will be used as a forecasting tool to examine which findings the community expects to replicate. This project will update our confidence in some of the most influential EEG findings and generate a large open access database that can be used to inform future research practices. Finally, through this international effort, we hope to create a cultural shift towards inclusive, high-powered multi-laboratory collaborations.


Language(s): eng - English
 Dates: 2021-03-022021-01-052021-03-092021-04-022021-11
 Publication Status: Published in print
 Pages: -
 Publishing info: -
 Table of Contents: -
 Rev. Type: Peer
 Identifiers: DOI: 10.1016/j.cortex.2021.03.013
 Degree: -



Legal Case


Project information


Source 1

Title: Cortex
  Other : Cortex
Source Genre: Journal
Publ. Info: Milan [etc.] : Elsevier Masson SAS
Pages: - Volume / Issue: 144 Sequence Number: - Start / End Page: 213 - 229 Identifier: ISSN: 0010-9452
CoNE: https://pure.mpg.de/cone/journals/resource/954925393344