References
- 1Anwyl-Irvine, A., Dalmaijer, E. S., Hodges, N., & Evershed, J. K. (2020). Realistic precision and accuracy of online experiment platforms, web browsers, and devices. Behavior Research Methods. DOI: 10.3758/s13428-020-01501-5
- 2Bridges, D., Pitiot, A., MacAskill, M. R., & Peirce, J. W. (2020). The timing mega-study: Comparing a range of experiment generators, both lab-based and online. PeerJ, 8,
e9414 . DOI: 10.7717/peerj.9414 - 3Brown, H. R., Zeidman, P., Smittenaar, P., Adams, R. A., McNab, F., Rutledge, R. B., & Dolan, R. J. (2014). Crowdsourcing for Cognitive Science – The Utility of Smartphones. PLOS ONE, 9(7),
e100662 . DOI: 10.1371/journal.pone.0100662 - 4Bürkner, P.-C. (2017). brms: An R Package for Bayesian Multilevel Models Using Stan. Journal of Statistical Software, 80(1), 1–28. DOI: 10.18637/jss.v080.i01
- 5Carpenter, B., Gelman, A., Hoffman, M. D., Lee, D., Goodrich, B., Betancourt, M., Brubaker, M., Guo, J., Li, P., & Riddell, A. (2017). Stan: A Probabilistic Programming Language. Journal of Statistical Software, 76(1), 1–32. DOI: 10.18637/jss.v076.i01
- 6Chang, W., Cheng, J., Allaire, J., Xie, Y., & McPherson, J. (2018). shiny: Web application framework for r, 2015. R Package Version, 1(0), 14.
- 7Cipora, K., Soltanlou, M., Reips, U.-D., & Nuerk, H.-C. (2019). The SNARC and MARC effects measured online: Large-scale assessment methods in flexible cognitive effects. Behavior Research Methods, 51(4), 1676–1692. DOI: 10.3758/s13428-019-01213-5
- 8Crump, M. J. C., McDonnell, J. V., & Gureckis, T. M. (2013). Evaluating Amazon’s Mechanical Turk as a Tool for Experimental Behavioral Research. PLOS ONE, 8(3),
e57410 . DOI: 10.1371/journal.pone.0057410 - 9Dandurand, F., Shultz, T. R., & Onishi, K. H. (2008). Comparing online and lab methods in a problem-solving experiment. Behavior Research Methods, 40(2), 428–434. DOI: 10.3758/BRM.40.2.428
- 10de Leeuw, J. R. (2015). jsPsych: A JavaScript library for creating behavioral experiments in a Web browser. Behavior Research Methods, 47(1), 1–12. DOI: 10.3758/s13428-014-0458-y
- 11Dehaene, S. (1989). The psychophysics of numerical comparison: A reexamination of apparently incompatible data. Perception & Psychophysics, 45(6), 557–566. DOI: 10.3758/BF03208063
- 12Dehaene, S. (2011). The number sense: How the mind creates mathematics (Rev. and updated ed). Oxford University Press.
- 13Dehaene, S., Dupoux, E., & Mehler, J. (1990). Is numerical comparison digital? Analogical and symbolic effects in two-digit number comparison. Journal of Experimental Psychology: Human Perception and Performance, 16(3), 626–641. DOI: 10.1037/0096-1523.16.3.626
- 14Dufau, S., Duñabeitia, J. A., Moret-Tatay, C., McGonigal, A., Peeters, D., Alario, F.-X., Balota, D. A., Brysbaert, M., Carreiras, M., Ferrand, L., Ktori, M., Perea, M., Rastle, K., Sasburg, O., Yap, M. J., Ziegler, J. C., & Grainger, J. (2011). Smart Phone, Smart Science: How the Use of Smartphones Can Revolutionize Research in Cognitive Science. PLOS ONE, 6(9),
e24974 . DOI: 10.1371/journal.pone.0024974 - 15Gabry, J. (2018). shinystan: Interactive visual and numerical diagnostics and posterior analysis for Bayesian models (Version 2.5.0) [Computer software].
- 16Garaizar, P., & Reips, U.-D. (2019). Best practices: Two Web-browser-based methods for stimulus presentation in behavioral experiments with high-resolution timing requirements. Behavior Research Methods, 51(3), 1441–1453. DOI: 10.3758/s13428-018-1126-4
- 17Gelman, A., Goodrich, B., Gabry, J., & Vehtari, A. (2019). R-squared for Bayesian Regression Models. The American Statistician, 73(3), 307–309. DOI: 10.1080/00031305.2018.1549100
- 18Gelman, A., Jakulin, A., Pittau, M. G., & Su, Y.-S. (2008). A weakly informative default prior distribution for logistic and other regression models. Annals of Applied Statistics, 2(4), 1360–1383. DOI: 10.1214/08-AOAS191
- 19Gelman, A., Vehtari, A., Simpson, D., Margossian, C. C., Carpenter, B., Yao, Y., Kennedy, L., Gabry, J., Bürkner, P.-C., & Modrák, M. (2020). Bayesian Workflow. ArXiv:2011.01808 [Stat].
http://arxiv.org/abs/2011.01808 - 20Germine, L., Nakayama, K., Duchaine, B. C., Chabris, C. F., Chatterjee, G., & Wilmer, J. B. (2012). Is the Web as good as the lab? Comparable performance from Web and lab in cognitive/perceptual experiments. Psychonomic Bulletin & Review, 19(5), 847–857. DOI: 10.3758/s13423-012-0296-9
- 21Gökaydin, D., Brugger, P., & Loetscher, T. (2018). Sequential Effects in SNARC. Scientific Reports, 8(1),
10996 . DOI: 10.1038/s41598-018-29337-2 - 22Gosling, S. D., Vazire, S., Srivastava, S., & John, O. P. (2004). Should We Trust Web-Based Studies? A Comparative Analysis of Six Preconceptions About Internet Questionnaires. American Psychologist, 59(2), 93–104. DOI: 10.1037/0003-066X.59.2.93
- 23Grootswagers, T. (2020). A primer on running human behavioural experiments online. Behavior Research Methods, 52(6), 2283–2286. DOI: 10.3758/s13428-020-01395-3
- 24Hinrichs, J. V., Yurko, D. S., & Hu, J. (1981). Two-digit number comparison: Use of place information. Journal of Experimental Psychology: Human Perception and Performance, 7(4), 890–901. DOI: 10.1037/0096-1523.7.4.890
- 25Holden, J., Francisco, E., Lensch, R., Tommerdahl, A., Kirsch, B., Zai, L., Dennis, R., & Tommerdahl, M. (2019). Accuracy of different modalities of reaction time testing: Implications for online cognitive assessment tools. BioRxiv,
726364 . DOI: 10.1101/726364 - 26Hosmer
Jr , D. W., Lemeshow, S., & Sturdivant, R. X. (2013). Applied Logistic Regression. John Wiley & Sons. DOI: 10.1002/9781118548387 - 27Huber, S., Nuerk, H.-C., Reips, U.-D., & Soltanlou, M. (2019). Individual differences influence two-digit number processing, but not their analog magnitude processing: A large-scale online study. Psychological Research, 83(7), 1444–1464. DOI: 10.1007/s00426-017-0964-5
- 28Kaufman, A. R. (2020). Implementing novel, flexible, and powerful survey designs in R Shiny. PLOS ONE, 15(4),
e0232424 . DOI: 10.1371/journal.pone.0232424 - 29Kochari, A. R. (2019). Conducting Web-Based Experiments for Numerical Cognition Research. Journal of Cognition, 2(1). DOI: 10.5334/joc.85
- 30Krajcsi, A., & Kojouharova, P. (2017). Symbolic Numerical Distance Effect Does Not Reflect the Difference between Numbers. Frontiers in Psychology, 8. DOI: 10.3389/fpsyg.2017.02013
- 31Krantz, J. H., & Dalal, R. (2000).
Validity of Web-based psychological research . In Psychological experiments on the Internet (pp. 35–60). Academic Press. DOI: 10.1016/B978-012099980-4/50003-4 - 32Lange, K., Kühn, S., & Filevich, E. (2015). “Just Another Tool for Online Studies” (JATOS): An Easy Solution for Setup and Management of Web Servers Supporting Online Studies. PLOS ONE, 10(6),
e0130834 . DOI: 10.1371/journal.pone.0130834 - 33Lieberoth, A. (2015). Shallow Gamification: Testing Psychological Effects of Framing an Activity as a Game. Games and Culture, 10(3), 229–248. DOI: 10.1177/1555412014559978
- 34Lumsden, J., Edwards, E. A., Lawrence, N. S., Coyle, D., & Munafò, M. R. (2016). Gamification of Cognitive Assessment and Cognitive Training: A Systematic Review of Applications and Efficacy. JMIR Serious Games, 4(2),
e5888 . DOI: 10.2196/games.5888 - 35Moyer, R. S., & Landauer, T. K. (1967). Time required for judgements of numerical inequality. Nature, 215(5109), 1519–1520. DOI: 10.1038/2151519a0
- 36Moyer, R. S., & Landauer, T. K. (1973). Determinants of reaction time for digit inequality judgments. Bulletin of the Psychonomic Society, 1(3), 167–168. DOI: 10.3758/BF03334328
- 37Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017). A manifesto for reproducible science. Nature Human Behaviour, 1(1), 1–9. DOI: 10.1038/s41562-016-0021
- 38Nuerk, H.-C., Weger, U., & Willmes, K. (2001). Decade breaks in the mental number line? Putting the tens and units back in different bins. Cognition, 82(1), B25–B33. DOI: 10.1016/S0010-0277(01)00142-1
- 39Plant, R. R. (2016). A reminder on millisecond timing accuracy and potential replication failure in computer-based psychology experiments: An open letter. Behavior Research Methods, 48(1), 408–411. DOI: 10.3758/s13428-015-0577-0
- 40Pronk, T., Wiers, R. W., Molenkamp, B., & Murre, J. (2020). Mental chronometry in the pocket? Timing accuracy of web applications on touchscreen and keyboard devices. Behavior Research Methods, 52(3), 1371–1382. DOI: 10.3758/s13428-019-01321-2
- 41Ratcliff, R., Thapar, A., Gomez, P., & McKoon, G. (2004). A Diffusion Model Analysis of the Effects of Aging in the Lexical-Decision Task. Psychology and Aging, 19(2), 278–289. DOI: 10.1037/0882-7974.19.2.278
- 42Ratcliff, R., Thapar, A., & McKoon, G. (2010). Individual differences, aging, and IQ in two-choice tasks. Cognitive Psychology, 60(3), 127–157. DOI: 10.1016/j.cogpsych.2009.09.001
- 43Reimers, S., & Stewart, N. (2008). Using Adobe Flash Lite on mobile phones for psychological research: Reaction time measurement reliability and interdevice variability. Behavior Research Methods, 40(4), 1170–1176. DOI: 10.3758/BRM.40.4.1170
- 44Reips, U.-D. (2002). Standards for Internet-Based Experimenting. Experimental Psychology, 49(4), 243–256. DOI: 10.1026//1618-3169.49.4.243
- 45Semmelmann, K., & Weigelt, S. (2017). Online psychophysics: Reaction time effects in cognitive experiments. Behavior Research Methods, 49(4), 1241–1260. DOI: 10.3758/s13428-016-0783-4
- 46Silver, L., Smith, A., Johnson, C., Taylor, K., Jiang, J., Anderson, M., & Rainie, L. (2019). Mobile connectivity in emerging economies. Pew Research Center, 7.
- 47Simcox, T., & Fiez, J. A. (2014). Collecting Response Times using Amazon Mechanical Turk and Adobe Flash. Behavior Research Methods, 46(1), 95–111. DOI: 10.3758/s13428-013-0345-y
- 48Steiner, M., Phillips, N., & Trutmann, K. (2020). ShinyPsych: An easy way to program psychology experiments using Shiny.
- 49Verguts, T., & De Moor, W. (2005). Two-digit Comparison. Experimental Psychology, 52(3), 195–200. DOI: 10.1027/1618-3169.52.3.195
- 50Wagenmakers, E.-J., & Brown, S. (2007). On the linear relation between the mean and the standard deviation of a response time distribution. Psychological Review, 114(3), 830–841. DOI: 10.1037/0033-295X.114.3.830
- 51Wiley, K., Vedress, S., & Mandryk, R. L. (2020). How Points and Theme Affect Performance and Experience in a Gamified Cognitive Task. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (pp. 1–15).
Association for Computing Machinery . DOI: 10.1145/3313831.3376697 - 52Zimmerman, F., Shalom, D., Gonzalez, P. A., Garrido, J. M., Heduan, F. A., Dehaene, S., Sigman, M., & Rieznik, A. (2016). Arithmetic on Your Phone: A Large Scale Investigation of Simple Additions and Multiplications. PLOS ONE, 11(12),
e0168431 . DOI: 10.1371/journal.pone.0168431