The authors evaluated the reliability and accuracy of responses given by 3 AI apps to questions related to paediatric ophthalmology. One-hundred multiple choice questions specific to paediatric ophthalmology were selected from the OphthoQuestions questionnaire bank (4551 questions on this platform). These were randomly selected to create the list of questions and then classified into 9 primary topics covering extraocular muscle anatomy and surgery, strabismus and amblyopia, cornea, uveitis, lens, retina, infections and allergic ocular disorders, glaucoma and other paediatric ophthalmology topics. Responses were checked by the 3 authors. Comprehensibility and complexity of responses were assessed by the Readable online tool. The Flesch-Kincaid-grade level, Coleman-Liay index and Flesch reading ease scale assessed legibility. Higher scores indicated that text was more readable. ChatGPT answered correctly for 61% and incorrect for 39% with highest accuracy for uveitis and lowest for strabismus and amblyopia. Gemini had 60% accuracy, 40% inaccuracy with highest accuracy for uveitis and worst for glaucoma. Copilot had 74% accuracy with highest accuracy for ‘other’ and worst for glaucoma. In terms of readability, ChatGPT was best for uveitis and worst for ‘other’, Gemini was best for cornea and lens but worst for ‘other’, and copilot was best for uveitis and infection/allergies but worst for strabismus/amblyopia and ‘other’. All 3 apps provided identical answers for 44% of questions (37 being correct and 7 incorrect). The authors conclude that AI can be a reliable tool for learning about paediatric ophthalmology. However, caution is needed because of inaccurate results. The lower accuracy for some questions may relate to the complexity of the conditions, question difficulty and scope.
Use of AI apps in providing information about paediatric ophthalmology
Reviewed by Fiona Rowe
Comparison of ChatGPT, Microsoft copilot and google Gemini for pediatric ophthalmology questions.
CONTRIBUTOR
Fiona Rowe (Prof)
Institute of Population Health, University of Liverpool, UK.
View Full Profile
