Next Article in Journal
Cloud Database Analysis of Instant Messaging Apps on Mobile Devices
Previous Article in Journal
LightVSR: A Lightweight Video Super-Resolution Model with Multi-Scale Feature Aggregation
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Applied Sciences
Volume 15
Issue 3
10.3390/app15031508
applsci-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
This is an early access version, the complete PDF, HTML, and XML versions will be available soon.
Article

ChatGPT-4 vs. Google Bard: Which Chatbot Better Understands the Italian Legislative Framework for Worker Health and Safety?

by
Martina Padovan
1,†,
Alessandro Palla
2,†,
Riccardo Marino
1,
Francesco Porciatti
1,
Bianca Cosci
1,
Francesco Carlucci
1,
Gianluca Nerli
1,
Armando Petillo
1,
Gabriele Necciari
1,
Letizia Dell’Amico
1,
Vincenzo Carmelo Lucisano
1,
Sergio Scarinci
1 and
Rudy Foddis
1,*
1
Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, 56126 Pisa, Italy
2
Intel Corporation, Santa Clara, CA 95054, USA
*
Author to whom correspondence should be addressed.
†
These authors contributed equally to this work.
Appl. Sci. 2025, 15(3), 1508; https://doi.org/10.3390/app15031508
Submission received: 18 December 2024 / Revised: 15 January 2025 / Accepted: 30 January 2025 / Published: 1 February 2025
(This article belongs to the Special Issue Occupational and Environmental Medicine: Exploring Practical Solutions)
Versions Notes

Abstract

Large language models, such as ChatGPT-4 and Google Bard, have demonstrated potential in healthcare. This study explores their utility in occupational medicine, a field where decisions rely on compliance with specific workplace health and safety regulations. A dataset of questions encompassing key occupational health topics derived from the Italian Legislative Decree 81/08, which governs workplace health and safety, was utilized. Responses from ChatGPT-4 with contextual information (ChatGPT-4+context) and Google Bard were evaluated for accuracy and completeness, with error categorization used to identify common issues. Subcategories of the topics of the regulations were analyzed as well. In total, 433 questions were included in our analysis. ChatGPT-4+context surpasses Bard in terms of accuracy and completeness in responses, with a lower error rate in the categories analyzed, except for the percentage of missed responses. In the subcategories analyzed, Bard is superior to ChatGPT-4+context only in the areas of the manual handling of loads and physical hazards. ChatGPT-4+context outperformed Bard in providing answers about Italian regulations on health and safety at work. This study highlights the potential and limitations of large language models as decision-support tools in occupational medicine and underscores the importance of regulatory context in enhancing their reliability.
Keywords: generative artificial intelligence; ChatGPT; Google Bard; chatbot; large language model; occupational health and safety; occupational medicine generative artificial intelligence; ChatGPT; Google Bard; chatbot; large language model; occupational health and safety; occupational medicine

Share and Cite

MDPI and ACS Style

Padovan, M.; Palla, A.; Marino, R.; Porciatti, F.; Cosci, B.; Carlucci, F.; Nerli, G.; Petillo, A.; Necciari, G.; Dell’Amico, L.; et al. ChatGPT-4 vs. Google Bard: Which Chatbot Better Understands the Italian Legislative Framework for Worker Health and Safety? Appl. Sci. 2025, 15, 1508. https://doi.org/10.3390/app15031508

AMA Style

Padovan M, Palla A, Marino R, Porciatti F, Cosci B, Carlucci F, Nerli G, Petillo A, Necciari G, Dell’Amico L, et al. ChatGPT-4 vs. Google Bard: Which Chatbot Better Understands the Italian Legislative Framework for Worker Health and Safety? Applied Sciences. 2025; 15(3):1508. https://doi.org/10.3390/app15031508

Chicago/Turabian Style

Padovan, Martina, Alessandro Palla, Riccardo Marino, Francesco Porciatti, Bianca Cosci, Francesco Carlucci, Gianluca Nerli, Armando Petillo, Gabriele Necciari, Letizia Dell’Amico, and et al. 2025. "ChatGPT-4 vs. Google Bard: Which Chatbot Better Understands the Italian Legislative Framework for Worker Health and Safety?" Applied Sciences 15, no. 3: 1508. https://doi.org/10.3390/app15031508

APA Style

Padovan, M., Palla, A., Marino, R., Porciatti, F., Cosci, B., Carlucci, F., Nerli, G., Petillo, A., Necciari, G., Dell’Amico, L., Lucisano, V. C., Scarinci, S., & Foddis, R. (2025). ChatGPT-4 vs. Google Bard: Which Chatbot Better Understands the Italian Legislative Framework for Worker Health and Safety? Applied Sciences, 15(3), 1508. https://doi.org/10.3390/app15031508

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop