PyBOLE – A General Python Based Framework for Behavioral Online Experiments: A Case Study Using the QUEST+ Adaptive Method
References
- Brooks J, Peirce J, MacAskill M. (Eds.). Building Experiments in PsychoPy. Perception. 2019;48(2). DOI: 10.1177/0301006618823976
- Chandler J, Mueller P, Paolacci G. Nonnaïveté among Amazon Mechanical Turk workers: Consequences and solutions for behavioral researchers. Behavior Research Methods. 2014;46(1). DOI: 10.3758/s13428-013-0365-7
- Germine L, Nakayama K, Duchaine BC, Chabris CF, Chatterjee G, Wilmer JB. Is the web as good as the lab? comparable performance from web and lab in cognitive/perceptual experiments. Psychonomic Bulletin and Review. 2012. DOI: 10.3758/s13423-012-0296-9
- Grootswagers T. A primer on running human behavioural experiments online. Behavior research methods. 2020;52(6):2283–2286. DOI: 10.3758/s13428-020-01395-3
- Gumančík J, Cornelissen PL, Brokjøb LG, Ridley BJ, McCarty K, Tovée MJ, Cornelissen KK. Testing the validity of online psychophysical measurement of body image perception. PLoS ONE. 2024;19. DOI: 10.1371/journal.pone.0302747
- Jun E, Hsieh G, Reinecke K. Types of motivation affect study selection, attention, and dropouts in online experiments. Proceedings of the ACM on Human-Computer Interaction. 2017;1(CSCW):1–15. DOI: 10.1145/3134691
- Krause F, Lindemann O. Expyriment: A python library for cognitive and neuroscientific experiments. Behavior Research Methods. 2014;46(2):416–428. DOI: 10.3758/s13428-013-0390-6
- Kuroki D, Pronk T. jsquestplus: A javascript implementation of the quest+ method for estimating psychometric function parameters in online experiments. Behavior Research Methods. 2023;55. DOI: 10.3758/s13428-022-01948-8
- Leadbeater RJ, McGraw P, Ledgeway T. Assessing the reliability of web-based measurements of visual function. Behavior Research Methods. 2024;56. DOI: 10.3758/s13428-022-02057-2
- Mathôt S, Schreij D, Theeuwes J. OpenSesame: An open-source, graphical experiment builder for the social sciences; 2012.
- Myrodia V, Buisine J, Madelain L. Comparison of threshold measurements in laboratory and online studies using a Quest+ algorithm. Journal of Vision. 2021. DOI: 10.1167/jov.21.9.1959
- Oppenheimer DM, Meyvis T, Davidenko N. Journal of Experimental Social Psychology Instructional manipulation checks: Detecting satisficing to increase statistical power. Journal of Experimental Social Psychology. 2009;45(4). DOI: 10.1016/j.jesp.2009.03.009
- Peirce J, Gray JR, Simpson S, MacAskill M, Höchenberger R, Sogo H, Kastman E, Lindeløv JK. Psychopy2: Experiments in behavior made easy. Behavior Research Methods. 2019;51:195–203. DOI: 10.3758/s13428-018-01193-y
- Peirce JW. Psychopy—psychophysics software in python. Journal of neuroscience methods. 2007;162(1–2):8–13. DOI: 10.1016/j.jneumeth.2006.11.017
- Sauter M, Draschkow D, Mack W. Building, hosting, recruiting: A brief introduction to running behavioral experiments online. Preprint. 2020;3(1):1–9. DOI: 10.31234/osf.io/tr76d
- Thoutam V. A study on python web application framework. Journal of Electronics, Computer Networking and Applied Mathematics (JECNAM) ISSN: 2799-1156. 2021;1(01):48–55. DOI: 10.55529/jecnam.11.48.55
- Watson AB. QUEST+: A general multidimensional Bayesian adaptive psychometric method. Journal of Vision. 4, 2017;17(3):
10 . DOI: 10.1167/17.3.10 - Watson AB, Pelli DG. Quest: A Bayesian adaptive psychometric method. Perception & Psychophysics. 3 1983; 33(2):113–120. DOI: 10.3758/BF03202828
- Yang J, Pitt MA, Ahn WY, Myung JI. ADOpy: a python package for adaptive design optimization. Behavior Research Methods. 2021;53(2). DOI: 10.3758/s13428-020-01386-4
DOI: https://doi.org/10.5334/jors.423 | Journal eISSN: 2049-9647
Language: English
Page range: 36 - 36
Submitted on: Mar 25, 2022
Accepted on: Apr 29, 2026
Published on: May 12, 2026
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year
Keywords:
© 2026 Vasiliki Myrodia, Jérôme Buisine, Samuel Delepoulle, Laurent Madelain, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.