Have a personal or library account? Click to login
Judgements of research co-created by Generative AI: Experimental evidence Cover

Judgements of research co-created by Generative AI: Experimental evidence

By: Paweł Niszczota and  Paul Conway  
Open Access
|Jul 2023

Abstract

The introduction of ChatGPT has fuelled a public debate on the appropriateness of using Generative AI (large language models; LLMs) in work, including a debate on how they might be used (and abused) by researchers. In the current work, we test whether delegating parts of the research process to LLMs leads people to distrust researchers and devalues their scientific work. Participants (N = 402) considered a researcher who delegates elements of the research process to a PhD student or LLM and rated three aspects of such delegation. Firstly, they rated whether it is morally appropriate to do so. Secondly, they judged whether—after deciding to delegate the research process—they would trust the scientist (that decided to delegate) to oversee future projects. Thirdly, they rated the expected accuracy and quality of the output from the delegated research process. Our results show that people judged delegating to an LLM as less morally acceptable than delegating to a human (d = –0.78). Delegation to an LLM also decreased trust to oversee future research projects (d = –0.80), and people thought the results would be less accurate and of lower quality (d = −0.85). We discuss how this devaluation might transfer into the underreporting of Generative AI use.

DOI: https://doi.org/10.18559/ebr.2023.2.744 | Journal eISSN: 2450-0097 | Journal ISSN: 2392-1641
Language: English
Page range: 101 - 114
Submitted on: May 3, 2023
Accepted on: Jun 16, 2023
Published on: Jul 26, 2023
Published by: Poznań University of Economics and Business Press
In partnership with: Paradigm Publishing Services
Publication frequency: 4 issues per year

© 2023 Paweł Niszczota, Paul Conway, published by Poznań University of Economics and Business Press
This work is licensed under the Creative Commons Attribution 4.0 License.