Network Models to Organize a Dispersed Literature: The Case of Misunderstanding Analysis of Covariance

Koen Derks; Julian Burger; Johnny van Doorn; Jolanda J. Kossakowski; Dora Matzke; Ludovica Atticciati; Julia Beitner; Viket Benzesin; Anne L. de Bruijn; Tara R. H. Cohen; Elisa P. A. Cordesius; Marit van Dekken; Nora Delvendahl; Simone Dobbelaar; Eva R. Groenendijk; Merel E. Hermans; Anu P. Hiekkaranta; Ria H. A. Hoekstra; Agnes M. Hoffmann; Sally A. M. Hogenboom; Sercan Kahveci; Irina J. Karaban; Sofieke Kevenaar; Jurriaan L. te Koppele; Anne-wil Kramer; Emese Kroon; Šimon Kucharský; Ricardo Lieuw-On; Gaby Lunansky; Timo P. Matzen; Annemarie Meijer; Annika Nieper; Laura de Nooij; Leonie Poelstra; Wikke J. van der Putten; Alexandra Sarafoglou; Jessica V. Schaaf; Sara A. J. van de Schraaf; Steven van Schuppen; Manon H. M. Schutte; Mitja Seibold; Scarlett K. Slagter; Aishah C. Snoek; Selina Stracke; Zenab Tamimy; Bram Timmers; Han Tran; Elizabeth S. Uduwa-Vidanalage; Laura Vergeer; Linos Vossoughi; Dilan E. Yücel; Eric-Jan Wagenmakers

doi:10.5334/jeps.458

Network Models to Organize a Dispersed Literature: The Case of Misunderstanding Analysis of Covariance

Volume 9 (2018): Issue 1

By: Koen Derks, Julian Burger, Johnny van Doorn, Jolanda J. Kossakowski, Dora Matzke, Ludovica Atticciati, Julia Beitner, Viket Benzesin, Anne L. de Bruijn, Tara R. H. Cohen, Elisa P. A. Cordesius, Marit van Dekken, Nora Delvendahl, Simone Dobbelaar, Eva R. Groenendijk, Merel E. Hermans, Anu P. Hiekkaranta, Ria H. A. Hoekstra, Agnes M. Hoffmann, Sally A. M. Hogenboom, Sercan Kahveci, Irina J. Karaban, Sofieke Kevenaar, Jurriaan L. te Koppele, Anne-wil Kramer, Emese Kroon, Šimon Kucharský, Ricardo Lieuw-On, Gaby Lunansky, Timo P. Matzen, Annemarie Meijer, Annika Nieper, Laura de Nooij, Leonie Poelstra, Wikke J. van der Putten, Alexandra Sarafoglou, Jessica V. Schaaf, Sara A. J. van de Schraaf, Steven van Schuppen, Manon H. M. Schutte, Mitja Seibold, Scarlett K. Slagter, Aishah C. Snoek, Selina Stracke, Zenab Tamimy, Bram Timmers, Han Tran, Elizabeth S. Uduwa-Vidanalage, Laura Vergeer, Linos Vossoughi, Dilan E. Yücel and Eric-Jan Wagenmakers

Open Access

|Dec 2018

Abstract

We outline a network method to synthesize a literature overview from search results obtained by multiple team members. Several network statistics are used to create a single representativeness ranking. We illustrate the method with the dispersed literature on a common misinterpretation of analysis of covariance (ANCOVA). The network method yields a top ten list of the most relevant articles that students and researchers can take as a point of departure for a more detailed study on this topic. The proposed methodology is implemented in Shiny, an open-source R package.

References

Adams, K. M., Brown, G. G., & Grant, I. (1985). Analysis of covariance as a remedy for demographic mismatch of research subject groups: Some sobering simulations. Journal of Clinical and Experimental Neuropsychology, 7(4), 445–462. DOI: 10.1080/01688638508401276
Open DOI Search in Google Scholar Back to article
Albert, J. H. (1992). Bayesian estimation of the polychoric correlation coefficient. Journal of Statistical Computation and Simulation, 44(1–2), 47–61. DOI: 10.1080/00949659208811448
Open DOI Search in Google Scholar Back to article
Borsboom, D., & Cramer, A. O. (2013). Network analysis: An integrative approach to the structure of psychopathology. Annual Review of Clinical Psychology, 9(1), 91–121. DOI: 10.1146/annurev-clinpsy-050212-185608
Open DOI Search in Google Scholar Back to article
Cochran, W. G. (1957). Analysis of covariance: Its nature and uses. Biometrics, 13(3), 261–281. DOI: 10.2307/2527916
Open DOI Search in Google Scholar Back to article
Cohen, J., & Cohen, P. (1983). Applied multiple regression/correlation analysis for the behavioral sciences. Oxford, England: Lawrence Erlbaum. DOI: 10.4324/9780203774441
Open DOI Search in Google Scholar Back to article
Costantini, G., Epskamp, S., Borsboom, D., Perugini, M., Mõttus, R., Waldorp, L. J., & Cramer, A. O. (2015). State of the aRt personality research: A tutorial on network analysis of personality data in R. Journal of Research in Personality, 54, 13–29. DOI: 10.1016/j.jrp.2014.07.003
Open DOI Search in Google Scholar Back to article
Cox, D. R., & McCullagh, P. (1982). Some aspects of analysis of covariance. Biometrics, 38(3), 541–561. DOI: 10.2307/2530040
Open DOI Search in Google Scholar Back to article
Epskamp, S., Cramer, A. O., Waldorp, L. J., Schmittmann, V. D., & Borsboom, D. (2012). Qgraph: Network visualizations of relationships in psychometric data. Journal of Statistical Software, 48(4), 1–18. DOI: 10.18637/jss.v048.i04
Open DOI Search in Google Scholar Back to article
Elashoff, J. (1969). Analysis of covariance: A delicate instrument. American Educational Research Journal, 6(3), 383–401. DOI: 10.2307/1161858
Open DOI Search in Google Scholar Back to article
Etz, A., Gronau, Q. F., Dablander, F., Edelsbrunner, P. A., & Baribault, B. (2017). How to become a Bayesian in eight easy steps: An annotated reading list. Psychonomic Bulletin & Review. DOI: 10.3758/s13423-017-1317-5
Open DOI Search in Google Scholar Back to article
Evans, S. H., & Anastasio, E. J. (1968). Misuse of analysis of covariance when treatment effect and covariate are confounded. Psychological Bulletin, 69(4), 225–234. DOI: 10.1037/h0025666
Open DOI Search in Google Scholar Back to article
Field, A. (2013). Discovering statistics using IBM SPSS statistics. Sage. DOI: 10.1111/insr.12011_21
Open DOI Search in Google Scholar Back to article
Friedkin, N. E. (1991). Theoretical foundations for centrality measures. American Journal of Sociology, 96(6), 1478–1504. DOI: 10.1086/229694
Open DOI Search in Google Scholar Back to article
Glass, G. V., Peckham, P. D., & Sanders, J. R. (1972). Consequences of failure to meet assumptions underlying the fixed effects analyses of variance and covariance. Review of Educational Research, 42(3), 237–288. DOI: 10.2307/1169991
Open DOI Search in Google Scholar Back to article
Huitema, B. E. (1980) The analysis of covariance and alternatives. Hoboken, New Jersey, John Wiley & Sons. DOI: 10.1002/9781118067475
Open DOI Search in Google Scholar Back to article
Jamieson, J. (2004). Analysis of covariance (ANCOVA) with difference scores. International Journal of Psychophysiology, 52(3), 277–283. DOI: 10.1016/j.ijpsycho.2003.12.009
Open DOI Search in Google Scholar Back to article
Judd, C. M., McClelland, G. H., & Ryan, C. S. (2011). Data analysis: A model comparison approach. New York: Routledge.
Search in Google Scholar Back to article
Keselman, H. J., Huberty, C. J., Lix, L. M., Olejnik, S., Cribbie, R. A., Donahue, B., & Levin, J. R. (1998). Statistical practices of educational researchers: An analysis of their ANOVA, MANOVA, and ANCOVA analyses. Review of Educational Research, 68(3), 350–386. DOI: 10.2307/1170601
Open DOI Search in Google Scholar Back to article
Loftin, L. (1990). The extreme dangers of covariance corrections. Retrieved from: https://eric.ed.gov/?id=ED317588.
Search in Google Scholar Back to article
Lord, F. M. (1967). A paradox in the interpretation of group comparisons. Psychological Bulletin, 68(5), 304–305. DOI: 10.1037/h0025105
Open DOI Search in Google Scholar Back to article
Miller, G. A., & Chapman, J. P. (2001). Misunderstanding analysis of covariance. Journal of Abnormal Psychology, 110(1), 1, 40–48. DOI: 10.1037//0021-843X.110.1.40
Open DOI Search in Google Scholar Back to article
Overall, J. E., & Woodward, J. A. (1977). Common misconceptions concerning the analysis of covariance. Multivariate Behavioral Research, 12(2), 171–186. DOI: 10.1207/s15327906mbr1202_5
Open DOI Search in Google Scholar Back to article
Porter, A. C., & Raudenbush, S. W. (1987). Analysis of covariance: Its model and use in psychological research, Journal of Counseling Psychology, 34(4), 383–392. DOI: 10.1037//0022-0167.34.4.383
Open DOI Search in Google Scholar Back to article
Stephenson, K., & Zelen, M. (1989). Rethinking centrality: Methods and examples. Social Networks, 11(1), 1–37. DOI: 10.1016/0378-8733(89)90016-6
Open DOI Search in Google Scholar Back to article
Storandt, M., & Hudson, W. (1975). Misuse of analysis of covariance in aging research and some partial solutions. Experimental Aging Research, 1(1), 121–125. DOI: 10.1080/03610737508257953
Open DOI Search in Google Scholar Back to article
van Doorn, J., Ly, A., Marsman, M., & Wagenmakers, E.-J. (2017). Bayesian estimation of Kendall’s tau using a latent normal approach. arXiv preprint arXiv: 1703.01805.
Search in Google Scholar Back to article
Wainer, H. (1991). Adjusting for differential base rates: Lord’s paradox again. Psychological Bulletin, 109(1), 147–151. DOI: 10.1037//0033-2909.109.1.147
Open DOI Search in Google Scholar Back to article
White, D. R., & Borgatti, S. P. (1994). Betweenness centrality measures for directed graphs. Social Networks, 16(4), 335–346. DOI: 10.1016/0378-8733(94)90015-9
Open DOI Search in Google Scholar Back to article
Wijngaert, L., Bouwman, H., & Contractor, N. (2014). A network approach toward literature review. Quality & Quantity, 48(2), 623–643. DOI: 10.1007/s11135-012-9791-3
Open DOI Search in Google Scholar Back to article

Articles in this issue

DOI: https://doi.org/10.5334/jeps.458 | Journal eISSN: 2222-6931

Journal RSS Feed

Language: English

Page range: 48 - 57

Published on: Dec 12, 2018

Published by: Ubiquity Press

In partnership with: Paradigm Publishing Services

Keywords:

ANCOVA,

© 2018 Koen Derks, Julian Burger, Johnny van Doorn, Jolanda J. Kossakowski, Dora Matzke, Ludovica Atticciati, Julia Beitner, Viket Benzesin, Anne L. de Bruijn, Tara R. H. Cohen, Elisa P. A. Cordesius, Marit van Dekken, Nora Delvendahl, Simone Dobbelaar, Eva R. Groenendijk, Merel E. Hermans, Anu P. Hiekkaranta, Ria H. A. Hoekstra, Agnes M. Hoffmann, Sally A. M. Hogenboom, Sercan Kahveci, Irina J. Karaban, Sofieke Kevenaar, Jurriaan L. te Koppele, Anne-wil Kramer, Emese Kroon, Šimon Kucharský, Ricardo Lieuw-On, Gaby Lunansky, Timo P. Matzen, Annemarie Meijer, Annika Nieper, Laura de Nooij, Leonie Poelstra, Wikke J. van der Putten, Alexandra Sarafoglou, Jessica V. Schaaf, Sara A. J. van de Schraaf, Steven van Schuppen, Manon H. M. Schutte, Mitja Seibold, Scarlett K. Slagter, Aishah C. Snoek, Selina Stracke, Zenab Tamimy, Bram Timmers, Han Tran, Elizabeth S. Uduwa-Vidanalage, Laura Vergeer, Linos Vossoughi, Dilan E. Yücel, Eric-Jan Wagenmakers, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.

Volume 9 (2018): Issue 1