Is ChatGPT‐4 Accurate in Proofread a Manuscript in Otolaryngology–Head and Neck Surgery?

Abstract

AbstractChatGPT is a new artificial intelligence‐powered language model of chatbot able to help otolaryngologists in clinical practice and research. We investigated the ability of ChatGPT‐4 in the editing of a manuscript in otolaryngology. Four papers were written by a nonnative English otolaryngologist and edited by a professional editing service. ChatGPT‐4 was used to detect and correct errors in manuscripts. From the 171 errors in the manuscripts, ChatGPT‐4 detected 86 errors (50.3%) including vocabulary (N = 36), determiner (N = 27), preposition (N = 24), capitalization (N = 20), and number (N = 11). ChatGPT‐4 proposed appropriate corrections for 72 (83.7%) errors, while some errors were poorly detected (eg, capitalization [5%] and vocabulary [44.4%] errors. ChatGPT‐4 claimed to change something that was already there in 82 cases. ChatGPT demonstrated usefulness in identifying some types of errors but not all. Nonnative English researchers should be aware of the current limits of ChatGPT‐4 in the proofreading of manuscripts.