Determination of Criteria Priorities and Interactions in ChatGPT by a Fuzzy Model

Çakır, Fatma Sönmez; Keleş, Nuh

doi:10.2478/fcds-2025-0008

Abstract

Today, technology is advancing much more and faster than in the past. The technological revolution is progressing so fast that people can now communicate with preprogrammed computers through Artificial Intelligence (AI). This study aims to evaluate the priorities and interactions of the criteria that stand out in the use of ChatGPT-4, using Fuzzy-Analytical Hierarchy Process (F-AHP) and Fuzzy-DEMATEL (F-DEMATEL) methods. Eight critical criteria in the use of ChatGPT are determined by the expert opinions obtained from the focus group. Among the criteria, this study found that reliability 23.1% and security 21.2% were the most important criteria by F-AHP calculations. This study also found that the criteria of appearance and functionality were generally influencing criteria, and the criteria of speed was generally influenced by other criteria.

References

Abdullah, L., and Zulkifli, N., Integration of fuzzy AHP and interval type-2 fuzzy DEMATEL: An application to human resource management. Expert Systems with Applications, 42, 9, 2015, 4397-4409. https://doi.org/10.1016/j.eswa.2015.01.021.
Search in Google Scholar Back to article
Almazyad, M., Aljofan, F., Abouammoh, N. A., Muaygil, R., Malki, K. H., Aljamaan, F., ... and Alrubaian, A., Enhancing expert panel discussions in pediatric palliative care: innovative scenario development and summarization with ChatGPT-4. Cureus, 15, 4, 2023, https://doi.org/10.7759/cureus.38249.
Search in Google Scholar Back to article
Ayhan, M. B., A Fuzzy AHP Approach for supplier selection problem: A case study in a gearmotor company. International Journal of Managing Value and Supply Chains, 4, 3, 2013, 11-23. http://dx.doi.org/10.5121/ijmvsc.2013.4302.
Search in Google Scholar Back to article
Bakır, M., and Atalık, Ö., Application of fuzzy AHP and fuzzy MARCOS approach for the evaluation of e-service quality in the airline industry. Decision Making: Applications in Management and Engineering, 4, 1, 2021, 127-152. https://doi.org/10.31181/dmame2104127b.
Search in Google Scholar Back to article
Burger, B., Kanbach, D. K., Kraus, S., Breier, M., and Corvello, V., On the use of AI-based tools like ChatGPT to support management research. European Journal of Innovation Management, 26, 7, 2023, 233-241. https://doi.org/10.1108/EJIM-02-2023-0156.
Search in Google Scholar Back to article
Chang, B., Chang, C. W., and Wu, C. H., Fuzzy DEMATEL method for developing supplier selection criteria. Expert systems with Applications, 38, 3, 2011, 1850-1858. https://doi.org/10.1016/j.eswa.2010.07.114.
Search in Google Scholar Back to article
Cotton, D. R., Cotton, P. A., and Shipway, J. R., Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International, 2023, 1-12. https://doi.org/10.1080/14703297.2023.2190148.
Search in Google Scholar Back to article
Deng, J., and Lin, Y., The Benefits and Challenges of ChatGPT: An Overview. Frontiers in Computing and Intelligent Systems, 2, 2, 2022, 81-83. https://doi.org/10.54097/fcis.v2i2.4465.
Search in Google Scholar Back to article
Dergaa, I., Chamari, K., Zmijewski, P., and Saad, H. B., From human writing to artificial intelligence generated text: examining the prospects and potential threats of ChatGPT in academic writing. Biology of Sport, 40, 2, 2023, 615-622. https://doi.org/10.5114/biolsport.2023.125623.
Search in Google Scholar Back to article
Farrokhnia, M., Banihashem, S. K., Noroozi, O., and Wals, A., A SWOT analysis of ChatGPT: Implications for educational practice and research. Innovations in Education and Teaching International, 61, 3, 2024, 460-474.
Search in Google Scholar Back to article
Feng, C., and Ma, R., Identification of the factors that influence service innovation in manufacturing enterprises by using the fuzzy DEMATEL method. Journal of Cleaner Production, 253, 2020, 120002. https://doi.org/10.1016/j.jclepro.2020.120002.
Search in Google Scholar Back to article
Gilson, A., Safranek, C. W., Huang, T., Socrates, V., Chi, L., Taylor, R. A., and Chartash, D., How does ChatGPT perform on the United States medical licensing examination? The implications of large language models for medical education and knowledge assessment. JMIR Med Educ. 2023; 9: e45312. Published 2023 Feb 8. Inf Process Manag, 39, 1, 2023 45-65. https://doi.org/10.2196/45312.
Search in Google Scholar Back to article
Haleem, A., Javaid, M., and Singh, R. P., An era of ChatGPT as a significant futuristic support tool: A study on features, abilities, and challenges. BenchCouncil transactions on benchmarks, standards and evaluations, 2, 4, 2022 1-8, 100089. https://doi.org/10.1016/j.tbench.2023.100089.
Search in Google Scholar Back to article
Heo, E., Kim, J., and Boo, K. J., Analysis of the assessment factors for renewable energy dissemination program evaluation using fuzzy AHP. Renewable and sustainable energy reviews, 14, 8, 2010, 2214-2220. https://doi.org/10.1016/j.rser.2010.01.020.
Search in Google Scholar Back to article
Hosseini, S. M., Paydar, M. M., and Hajiaghaei-Keshteli, M., Recovery solutions for ecotourism centers during the Covid-19 pandemic: Utilizing Fuzzy DEMATEL and Fuzzy VIKOR methods. Expert Systems with Applications, 185, 2021, 115594. https://doi.org/10.1016/j.eswa.2021.115594.
Search in Google Scholar Back to article
Javaid, M., Haleem, A., and Singh, R. P., ChatGPT for healthcare services: An emerging stage for an innovative perspective. BenchCouncil Transactions on Benchmarks, Standards and Evaluations, 3, 1, 2023, 1-11, 100105. https://doi.org/10.1016/j.tbench.2023.100105.
Search in Google Scholar Back to article
Khan, S., and Haleem, A., Strategies to implement circular economy practices: A fuzzy DEMATEL approach. Journal of Industrial Integration and Management, 5, 2, 2020, 253-269. https://doi.org/10.1142/S2424862220500050.
Search in Google Scholar Back to article
Khan, S., Singh, R., Haleem, A., Dsilva, J., and Ali, S. S., Exploration of critical success factors of logistics 4.0: a DEMATEL approach. Logistics, 6, 1, 2022, 13. https://doi.org/10.3390/logistics6010013.
Search in Google Scholar Back to article
Li, H., Wang, W., Fan, L., Li, Q., and Chen, X., A novel hybrid MCDM model for machine tool selection using fuzzy DEMATEL, entropy weighting and later defuzzification VIKOR. Applied Soft Computing, 91, 2020, 106207. https://doi.org/10.1016/j.asoc.2020.106207.
Search in Google Scholar Back to article
Li, C. W., and Tzeng, G. H., Identification of a threshold value for the DEMATEL method using the maximum mean de-entropy algorithm to find critical services provided by a semiconductor intellectual property mall. Expert Systems with Applications, 36, 6, 2009 9891-9898. https://doi.org/10.1016/j.eswa.2009.01.073.
Search in Google Scholar Back to article
Liu, Y., Eckert, C. M., and Earl, C., A review of fuzzy AHP methods for decision-making with subjective judgements. Expert Systems with Applications, 161, 2020, 113738. https://doi.org/10.1016/j.eswa.2020.113738.
Search in Google Scholar Back to article
Liu, Y., Wood, L. C., Venkatesh, V. G., Zhang, A., and Farooque, M., Barriers to sustainable food consumption and production in China: A fuzzy DEMATEL analysis from a circular economy perspective. Sustainable Production and Consumption, 28, 2021, 1114-1129. https://doi.org/10.1016/j.spc.2021.07.028.
Search in Google Scholar Back to article
Lyu, H. M., Sun, W. J., Shen, S. L., and Zhou, A. N., Risk assessment using a new consulting process in fuzzy AHP. Journal of Construction Engineering and Management, 146, 3, 2020, 04019112. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001757.
Search in Google Scholar Back to article
Mangla, S. K., Kumar, P., and Barua, M. K., Risk analysis in green supply chain using fuzzy AHP approach: A case study. Resources, Conservation and recycling, 104, 375-390. 2015, https://doi.org/10.1016/j.resconrec.2015.01.001.
Search in Google Scholar Back to article
Mattas, P. S., ChatGPT: A Study of AI Language Processing and its Implications. International Journal of Research Publication and Reviews, 4, 2, 2023 435-440, ISSN 2582-7421.
Search in Google Scholar Back to article
Mijwil, M., Aljanabi, M., and Ali, A. H., ChatGPT: exploring the role of cybersecurity in the protection of medical information. Mesopotamian journal of cybersecurity, 2023, 18-21. https://doi.org/10.58496/MJCS/2023/004.
Search in Google Scholar Back to article
Nasrollahi, M., Fathi, M. R., Sobhani, S. M., Khosravi, A., and Noorbakhsh, A., Modeling resilient supplier selection criteria in desalination supply chain based on fuzzy DEMATEL and ISM. International Journal of Management Science and Engineering Management, 16, 4, 2021, 264-278. https://doi.org/10.1080/17509653.2021.1965502.
Search in Google Scholar Back to article
Ocampo, L. A., Villegas, Z. V. A., Carvajal, J. A. T., and Apas, C. A. A., Identifying significant drivers for sustainable practices in achieving sustainable food supply chain using modified fuzzy decision-making trial and evaluation laboratory approach. International Journal of Advanced Operations Management, 10, 1, 2018, 51-89. https://doi.org/10.1504/IJAOM.2018.091317.
Search in Google Scholar Back to article
Paul, J., Ueno, A., and Dennis, C., ChatGPT and consumers: benefits, pitfalls and future research Agenda. International Journal of Consumer Studies. 1-13, 2023, https://doi.org/10.1111/ijcs.12928.
Search in Google Scholar Back to article
Pekkaya, M., Keleş, N., and Çakır, F. S., Freight Village Efficiency Criteria Evaluation via Fuzzy Multi-criteria Decision-Making Methods. In: Sahoo, L., Senapati, T., Yager, R.R. (eds). In Real Life Applications of Multiple Criteria Decision Making Techniques in Fuzzy Domain (pp. 619-641). Singapore: Springer Nature Singapore. 2023, https://doi.org/10.1007/978-981-19-4929-6_30.
Search in Google Scholar Back to article
Pinochet, L. H. C., Moreira, M. Â. L., Fávero, L. P., dos Santos, M., and Pardim, V. I., Collaborative Work Alternatives with ChatGPT Based on Evaluation Criteria for its Use in Higher Education: Application of the PROMETHEE-SAPEVO-M1 Method. Procedia Computer Science, 221, 2023, 177-184. https://doi.org/10.1016/j.procs.2023.07.025.
Search in Google Scholar Back to article
Rahman, M., Terano, H. J., Rahman, M. N., Salamzadeh, A., and Rahaman, M., ChatGPT and Academic Research: A Review and Recommendations Based on Practical Examples, Journal of Education, Management and Development Studies, 3, 1, 2023, 1-12. http://dx.doi.org/10.52631/jemds.v3i1.175.
Search in Google Scholar Back to article
Ray, P. P., ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet of Things and Cyber-Physical Systems, 3, 2023, 121-154. https://doi.org/10.1016/j.iotcps.2023.04.003
Search in Google Scholar Back to article
Rudolph, J., Tan, S., and Tan, S., ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?. Journal of Applied Learning and Teaching, 6, 1, 2023, 1-22. https://doi.org/10.37074/jalt.2023.6.1.9.
Search in Google Scholar Back to article
Saaty, T. L., The Analytic Hierarchy Process. New York: McGraw-Hill, 1980.
Search in Google Scholar Back to article
Sallam, M., ChatGPT utility in healthcare education, research, and practice: Systematic review on the promising perspectives and valid concerns. In Healthcare, 11, 6, 2023, 887. MDPI. https://doi.org/10.3390/healthcare11060887.
Search in Google Scholar Back to article
Shieh, J. I., Wu, H. H., and Huang, K. K., A DEMATEL method in identifying key success factors of hospital service quality. Knowledge-Based Systems, 23, 3, 2010, 277-282. https://doi.org/10.1016/j.knosys.2010.01.013.
Search in Google Scholar Back to article
Sönmez Çakır, F., and Pekkaya, M., Determination of interaction between criteria and the criteria priorities in laptop selection problem. International Journal of Fuzzy Systems, 22, 4, 2020 1177-1190. https://doi.org/10.1007/s40815-020-00857-2.
Search in Google Scholar Back to article
Sun, C. C., A performance evaluation model by integrating fuzzy AHP and fuzzy TOPSIS methods. Expert systems with applications, 37, 12, 2010, 7745-7754. https://doi.org/10.1016/j.eswa.2010.04.066.
Search in Google Scholar Back to article
Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., and Agyemang, B., What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education. Smart Learning Environments, 10, 1, 2023, 15. https://doi.org/10.1186/s40561-023-00237-x.
Search in Google Scholar Back to article
Tsai, W. H., and Chou, W. C., Selecting management systems for sustainable development in SMEs: A novel hybrid model based on DEMATEL, ANP, and ZOGP. Expert systems with applications, 36, 2, 2009, 1444-1458. https://doi.org/10.1016/j.eswa.2007.11.058.
Search in Google Scholar Back to article
Tzeng, G. H., Chiang, C. H., and Li, C. W., Evaluating intertwined effects in e-learning programs: A novel hybrid MCDM model based on factor analysis and DEMATEL. Expert systems with Applications, 32, 4, 2007, 1028-1044. https://doi.org/10.1016/j.eswa.2006.02.004.
Search in Google Scholar Back to article
van Dis, E. A., Bollen, J., Zuidema, W., van Rooij, R., and Bockting, C. L., ChatGPT: five priorities for research. Nature, 614, 7947, 2023, 224-226. https://doi.org/10.1038/d41586-023-00288-7.
Search in Google Scholar Back to article
Yan, H., Yang, Y., Lei, X., Ye, Q., Huang, W., and Gao, C., Regret Theory and Fuzzy-DEMATEL-Based Model for Construction Program Manager Selection in China. Buildings, 13, 4, 2023, 838. https://doi.org/10.3390/buildings13040838.
Search in Google Scholar Back to article
Zadeh, L. A., The concept of a linguistic variable and its application to approximate reasoning—I. Information sciences, 8, 3, 1975, 199-249. https://doi.org/10.1016/0020-0255(75)90036-5.
Search in Google Scholar Back to article

Determination of Criteria Priorities and Interactions in ChatGPT by a Fuzzy Model

Abstract

Paradigm

My account