Have a personal or library account? Click to login
On the Limitations of Manipulation Checks: An Obstacle Toward Cumulative Science Cover

On the Limitations of Manipulation Checks: An Obstacle Toward Cumulative Science

Open Access
|Jun 2017

Figures & Tables

Table 1

Results as a function of the presence versus absence of a manipulation check.

QuestionsaWithout MC (n = 49)With MC (n = 51)
M (SD)M (SD)
1.With which degree of certainty would you say that the sample’s size is sufficient to test the researcher’s hypothesis?5.84 (2.37)6.92 (2.02)
2.With which degree of certainty would you say that the source’s sympathy created a more favorable evaluation of the message’s content?4.53 (2.06)5.12 (2.03)
Without: MC (n = 49)With: MC (n = 51)
Yes/No questionsAnswer YesAnswer NoAnswer YesAnswer No
%%%%
3.Does this study contain all the methodological precautions to conclude that the source’s sympathy created a more favorable evaluation of the message content?14.2983.6721.1576.92
4.Would you accept this communication in a congress’ program?85.7114.2980.7717.31
5.Does the addition/presence of a MC allow concluding that the source’s sympathy created a more favorable evaluation of the message content?71.4326.5340.3853.85
6.In your opinion, is a MC necessary in a well-designed social psychology lab experiment?79.5918.3776.9217.31
7.In your opinion, would the absence of the MC constitute a flaw?61.2238.7850.0048.08
8.In your opinion, is a MC necessary for the causality relation between an IV and a DV?51.0248.9840.3859.62
9.In your opinion, if a researcher wants to test a mediation hypothesis, is a measure of the mediator between the IV and the DV necessary?77.5516.3375.0021.15

[i] a Ratings on 10-point scales (1: not at all certain; 10: completely certain). Items appear in the order of presentation. Here we report estimations per condition for filler items (1, 3, and 4) and items assessing general view of MC (6–9).

DOI: https://doi.org/10.5334/irsp.102 | Journal eISSN: 2397-8570
Language: English
Published on: Jun 20, 2017
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year

© 2017 Marie-Pierre Fayant, Harold Sigall, Aurore Lemonnier, Emilie Retsin, Theodore Alexopoulos, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.