Climate change in Poland – the assessment of the conversation with ChatGPT

Krzyżewska, Agnieszka

doi:10.2478/mgrsd-2023-0017

Abstract

ChatGPT, along with its applications, possibilities, limitations and future development, is currently one of the most often discussed topics worldwide. One of the issues raised in those discussions is its ethically questionable role in science and education.

The goal of this paper is to assess the accuracy and correctness of the responses given by ChatGPT, using climate change in Poland as an example. Eight questions related to this topic were posed to ChatGPT, and each answer was subsequently verified and assigned a grade on a scale of 0–10. The overall grade obtained was 3.8, indicating that only 30–40% of the information provided by ChatGPT was accurate. This poor result can be attributed to fake references, inaccurate data, overgeneralizations and simplification. Nevertheless, with proper training and development, ChatGPT has tremendous potential to serve as a valuable tool for ethically sound applications in the field of science.

References

Biswas, SS 2023, ‘Potential use of Chat GPT in Global Warming’, Annals of Biomedical Engineering, vol. 3, pp. 3–4.
Search in Google Scholar Back to article
Castro Nascimento, CM & Pimentel, AS 2023, ‘Do large language models understand chemistry? A conversation with ChatGPT’, Journal of Chemical Information and Modeling, vol. 63, pp. 1649–1655.
Search in Google Scholar Back to article
Ciaccio, EJ 2023, ‘Use of artificial intelligence in scientific paper writing’, Informatics in Medicine Unlocked, vol. 41, article number 101253.
Search in Google Scholar Back to article
Cooper, G 2023, ‘Examining science education in ChatGPT: An exploratory study of generative artificial intelligence’, Journal of Science Education and Technology, vol. 32, no. 3, pp. 444–452.
Search in Google Scholar Back to article
Day, T 2023, ‘A preliminary investigation of fake peer-reviewed citations and references generated by ChatGPT’, Professional Geographer, pp. 1–4.
Search in Google Scholar Back to article
Doroszewski A, Jóźwicki, T, Wróblewska, E & Kozyra, J 2014, Agricultural drought in Poland in 1961–2010, Instytut Uprawy Nawożenia i Gleboznawstwa Państwowy Instytut Badawczy, Puławy.
Search in Google Scholar Back to article
Eighth National Communication And Fifth Biennial Report Under The United Nations Framework Convention On Climate Change 2022, Warsaw. Available from: <https://unfccc.int/sites/default/files/resource/Poland_Report-NC8_BR5_27dec2022%281%29.pdf.>. [10 September 2023].
Search in Google Scholar Back to article
Falarz, M 2021, Climate change in Poland: Past, present, future. Available from: <https://link.springer.com/10.1007/978-3-030-70328-8>. [20 September 2023].
Search in Google Scholar Back to article
Fifth National Communication on Climate Change of the Republic of Poland 2010. Warsaw. Available from: <https://unfccc.int/resource/docs/natc/pol_nc5.pdf.>. [20 September 2023].
Search in Google Scholar Back to article
Fourth National Communication under the United Nations Framework Convention on Climate Change 2006. Warsaw. Available from: <https://unfccc.int/resource/docs/natc/polnc4.pdf.>. [20 September 2023].
Search in Google Scholar Back to article
Frąckiewicz, M 2023, The next generation of chatting: A look at ChatGPT-5. Available from: <https://ts2.space/en/the-next-generation-of-chatting-a-look-at-chatgpt-5/>. [20 September 2023].
Search in Google Scholar Back to article
Grünebaum, A, Chervenak, J, Pollet, SL, Katz, A & Chervenak, FA 2023, ‘The exciting potential for ChatGPT in obstetrics and gynecology’, Am J Obstet Gynecol., vol 228(6), pp. 696–705.
Search in Google Scholar Back to article
Haleem, A, Javaid, M & Singh, RP 2022, ‘An era of ChatGPT as a significant futuristic support tool: A study on features, abilities, and challenges’, Bench Council Transactions on Benchmarks, Standards and Evaluations, vol. 2, no. 4.
Search in Google Scholar Back to article
IMGW-PIB 2021, Climate of Poland 2020. Available from: <https://www.imgw.pl/sites/default/files/2021-04/imgw-pib-klimat-polski-2020-opracowanie-final-eng-rozkladowki-min.pdf.>. [20 September 2023].
Search in Google Scholar Back to article
Jungwirth, D & Haluza, D 2023, ‘Artificial intelligence and public health: An exploratory study’, International Journal of Environmental Research and Public Health, vol. 20, no. 5.
Search in Google Scholar Back to article
Koźmiński, C & Michalska, B 2002, ‘Characterization of wind speed and calms in Poland’, Acta Agrophysica, vol. 78, pp. 111–132.
Search in Google Scholar Back to article
Kuchcik, M 2006, ‘Defining heat waves - different approaches’, Geographia Polonica, vol. 79, no. 2, pp. 47–63.
Search in Google Scholar Back to article
Kundzewicz, ZW & Matczak, P 2012, ‘Climate change regional review: Poland’, Wiley Interdisciplinary Reviews: Climate Change, vol. 3, no. 4, pp. 297–311.
Search in Google Scholar Back to article
Łabędzki, L & Bąk, B 2015, ‘Meteorological and agricultural drought indices used in drought monitoring in Poland: a review’, Meteorology Hydrology and Water Management, vol. 2, no. 2, pp. 3–14.
Search in Google Scholar Back to article
Matuszko, D 2018, ‘Long-term variability of the cloud amount and cloud genera and their relationship with circulation (Kraków, Poland)’, vol. 38, pp. 1205–1220.
Search in Google Scholar Back to article
Matuszko, D, Bartoszek, K & Soroka, J 2022, ‘Long-term variability of cloud cover in Poland (1971–2020)’, Atmospheric Research, vol. 268, article number 106028.
Search in Google Scholar Back to article
Matuszko, D, Bartoszek, K, Soroka, J & Węglarczyk, S 2020, ‘Sunshine duration in Poland from ground- and satellite-based data’, International Journal of Climatology, vol. 40, no. 9, pp. 4259–4271.
Search in Google Scholar Back to article
Mietus, M 1991, ‘Snow depth at the Hornsund Station, Spitsbergen in 1978–1986’, Polish Polar Research, vol. 12, no. 2, pp. 223–228.
Search in Google Scholar Back to article
Nature 2023, ‘Tools such as ChatGPT threaten transparent science; here are our ground rules for their use’, Nature, vol. 613, no. 610.
Search in Google Scholar Back to article
Ollivier, M, Pareek, A, Dahmen, J, Kayaalp, ME, Winkler, PW, Hirschmann, MT & Karlsson, J 2023, ‘A deeper dive into ChatGPT: history, use and future perspectives for orthopaedic research’, Knee Surgery, Sports Traumatology, Arthroscopy, vol. 31, no. 4, pp. 1190–1192.
Search in Google Scholar Back to article
Phillips, MR, Rees, EF & Thomas, T 2013, ‘Winds, sea levels and North Atlantic Oscillation (NAO) influences: An evaluation’, Global and Planetary Change, vol. 100, pp. 145–152.
Search in Google Scholar Back to article
Pińskwar, I & Choryński, A 2021,‘Projections of precipitation changes in Poland’ in Climate Change in Poland: Past, present, future, ed. M Falarz, Springer Nature, Switzerland., pp.529–544.
Search in Google Scholar Back to article
Pińskwar, I, Choryński, A, Graczyk, D & Kundzewicz, ZW 2019, ‘Observed changes in extreme precipitation in Poland: 1991–2015 versus 1961–1990’, Theoretical and Applied Climatology, vol. 135, no. 1–2, pp. 773–787.
Search in Google Scholar Back to article
Pörtner, H-O, Roberts, DC, Adams, H, Adler, C, Aldunce, P, Ali, E, Rawshan, AB & Betts, R 2022, Climate Change 2022 - Impacts, Adaptation and Vulnerability - Summary for Policymakers.
Search in Google Scholar Back to article
Ray, PP 2023, ‘ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope’, Internet of Things and Cyber-Physical Systems, vol. 3, pp. 121–154.
Search in Google Scholar Back to article
Seventh National Communication and Third Biennial Report Under the United Nations Framework Convention 2017. Warsaw.
Search in Google Scholar Back to article
Sixth National Communication and the First Biennial Report To the Conference of the Parties To the United Nations Framework Convention on Climate Change 2013. Available from: <https://unfccc.int/sites/default/files/pol_nc6.pdf.>. [20 September 2023].
Search in Google Scholar Back to article
Szwed, M, Pińskwar, I, Kundzewicz, ZW, Graczyk, D & Mezghani, A 2017, ‘Changes of snow cover in Poland’, Acta Geophysica, vol. 65, no. 1, pp. 65–76.
Search in Google Scholar Back to article
Szyga-Pluta, K 2022a, ‘Changes in snow cover occurrence and the atmospheric circulation impact in Poznań (Poland)’, Theoretical and Applied Climatology, vol. 147, no. 3–4, pp. 925–940.
Search in Google Scholar Back to article
Szyga-Pluta, K 2022b, ‘Cloudiness and cloud genera variability at the turn of the 21st century in Poznań (Poland)’, Idojaras, vol. 126, no. 1, pp. 109–125.
Search in Google Scholar Back to article
Thorp, HH 2023, ‘ChatGPT is fun, but not an author’, Science, vol. 379, no. 6630.
Search in Google Scholar Back to article
Tomczyk, AM & Bednorz, E 2019, ‘Heat waves in Central Europe and tropospheric anomalies of temperature and geopotential heights’, International Journal of Climatology, vol. 39, no. 11, pp. 4189–4205.
Search in Google Scholar Back to article
Tomczyk, AM, Bednorz, E & Szyga-Pluta, K 2021, ‘Changes in air temperature and snow cover in winter in Poland’, Atmosphere, vol. 12, no. 1, pp. 1–19.
Search in Google Scholar Back to article
Turing, A 1950, ‘Computing machinery and intelligence’, Mind A Quarterly Review of Psychology and Philosophy, vol. 236, pp. 433–460.
Search in Google Scholar Back to article
Twardosz, R, Łupikasza, E, Niedźwiedź, T & Walanus, A 2012, ‘Long-term variability of occurrence of precipitation forms in winter in Kraków, Poland’, Climatic Change, vol. 113, no. 3–4, pp. 623–638.
Search in Google Scholar Back to article
Website of the Republic of Poland 2022. Available from: <https://www.gov.pl/>. [20 September 2023].
Search in Google Scholar Back to article
Wibig, J 2008, ‘Cloudiness variations in Łódź in the second half of the 20th century’, International Journal of Climatology, vol. 28, pp. 479–491.
Search in Google Scholar Back to article
Wibig, J 2021a,‘Wind change in Poland’ in Climate change in Poland, Springer Nature, Switzerland, pp. 391–420.
Search in Google Scholar Back to article
Wibig, J 2021b, ‘Hot days and heat waves in Poland in the period 1951–2019 and the circulation factors favoring the most extreme of them’, Atmosphere, vol. 12, no. 3.
Search in Google Scholar Back to article
Zheng, H & Zhan, H 2023, ‘ChatGPT in scientific writing: A cautionary tale’, The American Journal of Medicine, vol. 136(8), pp. 725–726.
Search in Google Scholar Back to article

Climate change in Poland – the assessment of the conversation with ChatGPT

Abstract

Paradigm

My account