Data from Investigating Variation in Replicability: A “Many Labs” Replication Project

Richard A. Klein; Kate A Ratliff; Michelangelo Vianello; Reginald B Adams Jr.; Stĕpán Bahník; Michael J Bernstein; Konrad Bocian; Mark J Brandt; Beach Brooks; Claudia Chloe Brumbaugh; Zeynep Cemalcilar; Jesse Chandler; Winnee Cheong; William E Davis; Thierry Devos; Matthew Eisner; Natalia Frankowska; David Furrow; Elisa Maria Galliani; Fred Hasselman; Joshua A Hicks; James F Hovermale; S Jane Hunt; Jeffrey R Huntsinger; Hans IJzerman; Melissa-Sue John; Jennifer A Joy-Gaba; Heather Barry Kappes; Lacy E Krueger; Jamie Kurtz; Carmel A Levitan; Robyn K Mallett; Wendy L Morris; Anthony J Nelson; Jason A Nier; Grant Packard; Ronaldo Pilati; Abraham M Rutchick; Kathleen Schmidt; Jeanine L Skorinko; Robert Smith; Troy G Steiner; Justin Storbeck; Lyn M Van Swol; Donna Thompson; A E van’t Veer; Leigh Ann Vaughn; Marek Vranka; Aaron L Wichman; Julie A Woodzicka; Brian A Nosek

doi:10.5334/jopd.ad

Data from Investigating Variation in Replicability: A “Many Labs” Replication Project

Volume 2 (2014): Issue 1

By: Richard A. Klein, Kate A Ratliff, Michelangelo Vianello, Reginald B Adams Jr., Stĕpán Bahník, Michael J Bernstein, Konrad Bocian, Mark J Brandt, Beach Brooks, Claudia Chloe Brumbaugh, Zeynep Cemalcilar, Jesse Chandler, Winnee Cheong, William E Davis, Thierry Devos, Matthew Eisner, Natalia Frankowska, David Furrow, Elisa Maria Galliani, Fred Hasselman, Joshua A Hicks, James F Hovermale, S Jane Hunt, Jeffrey R Huntsinger, Hans IJzerman, Melissa-Sue John, Jennifer A Joy-Gaba, Heather Barry Kappes, Lacy E Krueger, Jamie Kurtz, Carmel A Levitan, Robyn K Mallett, Wendy L Morris, Anthony J Nelson, Jason A Nier, Grant Packard, Ronaldo Pilati, Abraham M Rutchick, Kathleen Schmidt, Jeanine L Skorinko, Robert Smith, Troy G Steiner, Justin Storbeck, Lyn M Van Swol, Donna Thompson, A E van’t Veer, Leigh Ann Vaughn, Marek Vranka, Aaron L Wichman, Julie A Woodzicka and Brian A Nosek

Open Access

|Apr 2014

Abstract

This dataset is from the Many Labs Replication Project in which 13 effects were replicated across 36 samples and over 6,000 participants. Data from the replications are included, along with demographic variables about the participants and contextual information about the environment in which the replication was conducted. Data were collected in-lab and online through a standardized procedure administered via an online link. The dataset is stored on the Open Science Framework website. These data could be used to further investigate the results of the included 13 effects or to study replication and generalizability more broadly.

References

1
Klein R A Ratliff K A Vianello M Adams R B Jr. Bahník Š Bernstein M J Nosek B A (in press). Investigating variation in replicability: A “many labs” replication project Social Psychology

Back to article
2
Open Science Collaboration An open, large-scale, collaborative effort to estimate the reproducibility of psychological science Perspectives on Psychological Science 2012 7 657 660 10.1177/1745691612462588

Back to article
3
Makel M C Plucker J A Hegarty B Replications in Psychology Research How Often Do They Really Occur? Perspectives on Psychological Science 2012 7 6 537 542 10.1177/1745691612460688

Back to article
4
Ioannidis J P Why most published research findings are false PLoS medicine 2005 2 8 e124 10.1371/journal.pmed.0020124

Back to article
5
Henrich J Heine S J Norenzayan A Most people are not WEIRD Nature 2010 466 7302 29 10.1038/466029a

Back to article
6
Oppenheimer D M Meyvis T Davidenko N Instructional manipulation checks: Detecting satisficing to increase statistical power Journal of Experimental Social Psychology 2009 45 4 867 872 10.1016/j.jesp.2009.03.009

Back to article
7
Tversky A Kahneman D The framing of decisions and the psychology of choice Science 1981 211 4481 453 458 10.1126/science.7455683

Back to article
8
Jacowitz K E Kahneman D Measures of anchoring in estimation tasks Personality and Social Psychology Bulletin 1995 21 11 1161 1166 10.1177/01461672952111004

Back to article
9
Oppenheimer D M Monin B The retrospective gambler’s fallacy: Unlikely events, constructing the past, and multiple universes Judgment and Decision Making 2009 4 5 326 334

Back to article
10
Schwarz N Hippler H J Deutsch B Strack F Response scales: Effects of category range on reported behavior and comparative judgments Public Opinion Quarterly 1985 49 3 388 395 10.1086/268936

Back to article
11
Hyman H H Sheatsley P B The current status of American public opinion The Teaching of Contemporary Affairs 1950 New York National Council of Social Studies 11 34

Back to article
12
Rugg D Experiments in wording questions: II Public Opinion Quarterly 1941

Back to article
13
Lorge I Curtiss C C Prestige, suggestion, and attitudes The Journal of Social Psychology 1936 7 4 386 402 10.1080/00224545.1936.9919891

Back to article
14
Carter T J Ferguson M J Hassin R R A single exposure to the American flag shifts support toward Republicanism up to 8 months later Psychological science 2011 22 8 1011 1018 10.1177/0956797611414726

Back to article
15
Caruso E M Vohs K D Baxter B Waytz A Mere exposure to money increases endorsement of free-market systems and social inequality Journal of Experimental Psychology: General 2013 142 301 306 10.1037/a0029288

Back to article
16
Husnu S Crisp R J Elaboration enhances the imagined contact effect Journal of Experimental Social Psychology 2010 46 6 943 950 10.1016/j.jesp.2010.05.014

Back to article
17
Nosek B A Banaji M R Greenwald A G Math = Male, Me = Female, therefore Math ≠ Me Journal of Personality and Social Psychology 2002 83 1 44 59 10.1037/0022-3514.83.1.44

Back to article

DOI: https://doi.org/10.5334/jopd.ad | Journal eISSN: 2050-9863

Journal RSS Feed

Language: English

Published on: Apr 4, 2014

Published by: Ubiquity Press

In partnership with: Paradigm Publishing Services

Publication frequency: 1 issue per year

Keywords:

replication,

generalizability,

context

© 2014 Richard A. Klein, Kate A Ratliff, Michelangelo Vianello, Reginald B Adams Jr., Stĕpán Bahník, Michael J Bernstein, Konrad Bocian, Mark J Brandt, Beach Brooks, Claudia Chloe Brumbaugh, Zeynep Cemalcilar, Jesse Chandler, Winnee Cheong, William E Davis, Thierry Devos, Matthew Eisner, Natalia Frankowska, David Furrow, Elisa Maria Galliani, Fred Hasselman, Joshua A Hicks, James F Hovermale, S Jane Hunt, Jeffrey R Huntsinger, Hans IJzerman, Melissa-Sue John, Jennifer A Joy-Gaba, Heather Barry Kappes, Lacy E Krueger, Jamie Kurtz, Carmel A Levitan, Robyn K Mallett, Wendy L Morris, Anthony J Nelson, Jason A Nier, Grant Packard, Ronaldo Pilati, Abraham M Rutchick, Kathleen Schmidt, Jeanine L Skorinko, Robert Smith, Troy G Steiner, Justin Storbeck, Lyn M Van Swol, Donna Thompson, A E van’t Veer, Leigh Ann Vaughn, Marek Vranka, Aaron L Wichman, Julie A Woodzicka, Brian A Nosek, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.

Previous article Volume 2 (2014): Issue 1 Next article