The Open Anchoring Quest Dataset: Anchored Estimates from 96 Studies on Anchoring Effects

Lukas Röseler; Lucia Weber; Katharina Helgerth; Elena Stich; Miriam Günther; Paulina Tegethoff; Felix Wagner; M. Antunovic; F. Barrera-Lemarchand; E. Halali; K. Ioannidis; O. Genschow; N. Milstein; D. C. Molden; F. Papenmeier; Z. Pavlovic; R. Rinn; M. L. Schreiter; M. F. Zimdahl; Š. Bahník; C. Bermeitinger; F. B. N. Blower; H. L. Bögler; P. Burgmer; N. N. Cheek; L. Dorsch; S. Fels; M.-L. Frech; L. Freira; A. J. L. Harris; J. A. Häusser; M. V. Hedgebeth; M. Henkel; D. Horvath; P. Intelmann; A. Klamar; E. Knappe; L.-M. Köppel; S. M. Krueger; S. Lagator; F. Lopez-Boo; J. Navajas; J. K. Norem; J. Novak; Y. Onuki; E. Page; T. R. Rebholz; M. Sartorio; S. Schindler; D. R. Shanks; M.-C. Siems; P. Stäglich; M. Starkulla; M. Stitz; T. Straube; K. Thies; E. Thum; K. Ueda; M. Undorf; D. Urlichich; M. A. Vadillo; H. Wolf; A. Zhou; A. Schütz

doi:10.5334/jopd.67

Figures & Tables

Two Examples for Anchoring Items including Codings for Nine Variables.
*Note*: Other types of stimuli may be written information, images, videos, or combinations of such stimuli.

Table 1

Overview of variables with descriptions and examples included in the dataset.

VARIABLE	DESCRIPTION	NOTES AND EXAMPLES
id	Unique ID per case	Consecutive number per row
reference	APA reference of the dataset or corresponding research article	—
reference_short	Short APA reference with study number (if multiple studies were reported)	e.g., “Author et al., 2022, Study 1”
link	Link to download dataset	—
participant_id	ID variable from the respective study
sex	1 = male, 2 = female, 3 = non-binary
age	Participant age in years
anchoring_item	Description of anchoring item from the study (e.g., year the telephone was invented)	This is a brief explanation of the anchoring question.
true_value	Correct answer for anchoring item (if none exists, unanchored mean estimate can be used)	Unanchored mean estimates were computed on the basis of a condition where no anchor was presented, a pretest, or a previous study with a similar setting and similar participants. Unanchored mean estimates were not used if true values differed between participants (e.g., height of their grand- father).
anchor	Anchor that was presented in the trial
anchorhigh	1 = high anchor, 0 = low anchor
anchortype	1 = explicitly random, 2 = fixed and provided without explanation, 3 = having some relevance with the target, 4 = self-generated	Examples: 1 – Participants are involved in creating the random number, e.g., due to it being the last digits of their phone number or because they drew a number from an urn or threw a die. 2 – Was the telephone invented before or after 1830? 3 – The television was invented in 1900. When was the telephone invented? 4 – What is the boiling temperature of water on Mt Everest? (The self-generated anchor is 100°C, but 100 is not explicitly presented.
comparative_question	0 = no, 1 = yes	Comparative question refers to the question asking “Is the distance between Berlin and Prague more or less than X?” For this variable, it does not matter whether participants had to give explicit responses to this question or which responses they gave. Incidental or subliminal anchors or anchors framed as “Hint: The true value Is more than 50 km” were coded as 0 (no).
direction	1 = direction of adjustment was known, 0 = direction was unknown	Direction was coded as 0 if there was a comparative question (even if all participants gave the same answer to that question). Direction was coded as 1 if participants were told something like “Prices for this product in this store are given to compensate for decreases during negotiation” or “The true value is lower than $100”.
estimate	Estimate that was given by participant in the respective trial
experiment_type	1 = online, 2 = lab, 3 = class, 4 = field, 5 = mixed	Class refers to experiments conducted as part of a lecture or seminar in a classroom or in a synchronous online meeting. If the class was run online, it was coded as 1 (online).
incentive	Monetary incentives are coded, only; 0 = not incentivized, 1 = incentivized for participation, 2 = incentivized for accurate estimation (can be coupled with incentives for participation); 3 = anchored estimate was a price participants would pay (WTP) or accept for some product (WTA); receiving feedback does not count as an incentive for participation); receiving feedback does not count as incentive	Course credit and feedback were coded as 0, vouchers/coupons and ready money were coded as 1 or 2
preregistered	“0” = no; if yes, the link was provided; if the pre-registration was under embargo, it was coded as “embargoed” until the embargo ends
preregtype	Preregistration type	AsPredicted = AsPredicted.org; OSF-Standard Reg = OSF-Standard Pre-Data Collection Registration; Repl Recipe Reg = Replication Recipe (Brandt et al., 2014): Pre-Registration; Open-Ended Reg = Open-Ended Registration; PreReg in SocPsy = Pre-Registration in Social (van ‘t Veer & Giner-Sorolla, 2016): Pre-Registration; RegRep Protocol = Registered Report Protocol Preregistration; OSF PreReg = OSF Preregistration
published	0 = no, 1 = yes; refers to whether the data or the corresponding article has been published in a peer-reviewed journal or conference (preprints = 0, data that is part of a published study = 1)
sampletype	1 = lay, 2 = professional or expert, 3 = mixed	Examples: Professionals/experts include judges estimating punishments or car mechanics estimating values of cars.
scaletype	1 = open, 2 = closed, 3 = visual	Examples: 1 – Textbox. 2 – Textbox with limited range of possible answers (e.g., probability that has to lay between 0 and 100%. 3 – visual analogue scale
stimulitype	1 = no additional information, 2 = additional information in text form, 3 = image/audio/video, 4 = 2&3, 9 = other	Examples: 1 – What is the population of Chicago? [no additional information] 2 – Newspaper article about Chicago prior to the question that does not state the true value. 3 – Image or Map of Chicago. 4 – Newspaper article with an image of Chicago. 9 – People who have visited Chicago during the last year are asked.
tasktype	Type of estimation task (e.g. price, quantity, age, distance, …)
adjustment	Difference between estimate and anchor
absadjustment	Absolute difference between estimate and anchor
score	Difference between estimate and anchor divided by difference between true value and anchor
restr_score	The above score but with cut-offs at 0 and 1

NO	AUTHOR	ORCID	CONTRIBUTION (CREDIT)	AFFILIATION	AUTHOR HAS CHECKED HIS OR HER DATA	AUTHOR HAS EMPTIED FILE-DRAWER¹
1	Röseler, L.	0000-0002-6446-1901	Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing	University of Bamberg	x	x
2	Weber, L.		Data curation, Investigation, Resources, Software, Visualization, Writing – review & editing	University of Bamberg	x	x
3	Helgerth, K. A. C.		Validation, Writing – review & editing	University of Bamberg	x	x
4	Stich, E.		Data curation, Software, Writing – review & editing	University of Bamberg	x	x
5	Günther, M.		Data curation, Writing – review & editing	University of Bamberg	x	x
6	Tegethoff, P.	0000-0002-4701-4309	Investigation, Data Curation, Resources, Validation, Writing – review & editing	University of Bamberg	x	x
7	Wagner, F. S.		Investigation, Writing – review & editing	University of Bamberg	x	x
8	Antunovic, M.		Resources & Data Curation, Writing – review & editing	University of Tübingen	x	x
9	Barrera-Lemarchand, F.	0000-0003-2031-1597	Resources & Data Curation, Writing – review & editing	Universidad Torcuato di Tella/Universidad de Buenos Aires	x	x
10	Halali, E.	0000-0001-5730-7677	Resources & Data Curation, Writing – review & editing	Bar-Ilan University	x	x
11	Ioannidis, K.	0000-0003-2858-4688	Resources & Data Curation, Writing – review & editing	University of Amsterdam	x	x
12	Genschow, O.	0000-0001-6322-4392	Resources & Data Curation, Writing – review & editing	Leuphana University Lüneburg	x	x
13	Milstein, N.	0000-0002-4328-7174	Resources & Data Curation, Writing – review & editing	Bar-Ilan University	x	x
14	Molden, D. C.	0000-0002-2182-5621	Resources & Data Curation, Writing – review & editing	Northwestern University	x	x
15	Papenmeier, F.	0000-0001-5566-9658	Resources & Data Curation, Writing – review & editing	University of Tübingen	x	x
16	Pavlovic, Z.	0000-0002-9231-5100	Resources & Data Curation, Writing – review & editing	University of Belgrade	x	x
17	Rinn, R.	0000-0002-2640-8325	Resources & Data Curation, Writing – review & editing	University of Würzburg	x	x
18	Schreiter, M. L.	0000-0002-4596-9195	Resources & Data Curation, Writing – review & editing	University of Tübingen	x	x
19	Zimdahl, M. F.	0000-0001-5808-2967	Resources & Data Curation, Writing – review & editing	University of Mannheim	x	x
20	Bahník, Š.	0000-0002-0579-6808	Resources, Writing – review & editing	Prague College of Psychosocial Studies	x	x
21	Bermeitinger, C.	0000-0001-9977-7001	Resources, Writing – review & editing	University of Hildesheim, Germany	x	x
22	Blower, F. B. N.	0000-0002-5729-8077	Resources, Writing – review & editing	University College London	x	x
23	Bögler, H. L.	0000-0003-2401-8945	Resources, Writing – review & editing	University of Bamberg	x	x
24	Burgmer, P.	0000-0003-3664-0539	Resources, Writing – review & editing	University of Kent	x	x
25	Cheek, N. N.	0000-0003-3515-4141	Resources, Writing – review & editing	Purdue University	x	x
26	Dorsch, L.		Resources, Writing – review & editing	University of Tübingen	x	x
27	Fels, S.		Resources, Writing – review & editing	University of Bamberg	x	x
28	Frech, M.-L.		Resources, Writing – review & editing	Leuphana University Lüneburg	x	x
29	Freira, L.	0000-0002-2710-0760	Resources, Writing – review & editing	Universidad Torcuato Di Tella	x	x
30	Harris, A. J. L.		Resources, Writing – review & editing	University College London
31	Häusser, J. A.	0000-0001-8993-9919	Resources, Writing – review & editing	Justus-Liebig-University Giessen	x	x
32	Hedgebeth, M. V.		Resources, Writing – review & editing	Virginia Commonwealth University	x	x
33	Henkel, M.		Resources, Writing – review & editing	University of Würzburg
34	Horvath, D.	0000-0003-3954-1720	Resources, Writing – review & editing	Technical University of Darmstadt	x	x
35	Intelmann, P.		Resources, Writing – review & editing	University of Tübingen	x	x
36	Klamar, A.	0000-0002-5983-3707	Resources, Writing – review & editing	Federal University of Applied Administrative Sciences	x	x
37	Knappe, Ella		Resources, Writing – review & editing	Harz University of Applied Science	x	x
38	Köppel, L.-M.	0000-0002-1124-2262	Resources, Writing – review & editing	University of Bamberg	x	x
39	Krueger, S. M.		Resources, Writing – review & editing	University of Bamberg	x	x
40	Lagator, S.	0000-0001-6060-2941	Resources, Writing – review & editing	University College London	x	x
41	Lopez-Boo, F.		Resources, Writing – review & editing	InterAmerican Development Bank, Washington DC, US	x	x
42	Navajas, J.	0000-0001-8765-037X	Resources, Writing – review & editing	Universidad Torcuato Di Tella	x	x
43	Norem, J. K.	0000-0001-9470-230X	Resources, Writing – review & editing	Wellesley College	x	x
44	Novak, J.		Resources, Writing – review & editing	University of Tübingen	x	x
45	Onuki, Y.	0000-0003-2918-802X	Resources, Writing – review & editing	The university of Tokyo	x	x
46	Page, E.	0000-0001-8212-9833	Resources, Writing – review & editing	University College London	x	x
47	Rebholz, T. R.	0000-0001-5436-0253	Resources, Writing – review & editing	University of Tübingen	x	x
48	Sartorio, M.		Resources, Writing – review & editing	Universidad Torcuato Di Tella	x	x
49	Schindler, S.	0000-0002-7054-5431	Resources, Writing – review & editing	University of Muenster	x	x
50	Shanks, D. R.	0000-0002-4600-6323	Resources, Writing – review & editing	University College London	x	x
51	Siems, M.-C.		Resources, Writing – review & editing	Leuphana University Lüneburg	x	x
52	Stäglich, P.		Resources, Writing – review & editing	University of Tübingen	x	x
53	Starkulla, M.		Resources, Writing – review & editing	University of Tübingen	x	x
54	Stitz, M.		Resources, Writing – review & editing	University of Tübingen	x	x
55	Straube, T.	0000-0002-5301-7549	Resources, Writing – review & editing	University of Muenster
56	Thies, K.	0000-0002-3723-4156	Resources, Writing – review & editing	University of Tübingen	x	x
57	Thum, Elias		Resources, Writing – review & editing	University of Tübingen	x	x
58	Ueda, K.	0000-0003-1244-7945	Resources, Writing – review & editing	The university of Tokyo	x	x
59	Undorf, M.	0000-0002-0118-824X	Resources, Writing – review & editing	University of Mannheim	x	x
60	Urlichich, D.	0000-0002-0089-0918	Resources, Writing – review & editing	University College London	x	x
61	Vadillo, M. A.	0000-0001-8421-816X	Resources, Writing – review & editing	Universidad Autónoma de Madrid	x	x
62	Wolf, H.		Resources, Writing – review & editing	University of Tübingen	x	x
63	Zhou, A.	0000-0001-6345-0816	Resources, Writing – review & editing	University of Bamberg	x	x
64	Schütz, A.	0000-0002-6358-167X	Funding acquisition, Resources, Supervision, Writing – review & editing	University of Bamberg	x	x

[i] ¹ An empty file-drawer means that all of this author’s studies that were completed before February 1^st 2022 are included in the OpaQ-dataset.

Resources co-Authors have provided data and checked them in the processed version of the OpAQ-dataset. Data Curation co-authors have processed their datasets themselves. All other datasets were processed by LR, LW, ES, and PT.

The Open Anchoring Quest Dataset: Anchored Estimates from 96 Studies on Anchoring Effects

Figures & Tables

Figure 1

Table 1

Paradigm

My account