文献类型：期刊文献

英文题名：Evaluation of large language models in generating and optimizing educational materials for neonatal home oxygen therapy

作者：Liu, Zhendong[1];Yang, Xiaoping[1];Zhang, Yu[2];Xu, Yujing[1];Xiang, Yue[1];Wang, Hongyan[1,2]

第一作者：Liu, Zhendong

通信作者：Wang, HY[1];Wang, HY[2]

机构：[1]Gansu Univ Chinese Med, Sch Nursing, Lanzhou, Peoples R China;[2]Gansu Prov Maternal & Child Hlth Hosp, Dept Neonatol, Lanzhou, Peoples R China

第一机构：甘肃中医药大学护理学院

通信机构：[1]corresponding author), Gansu Univ Chinese Med, Sch Nursing, Lanzhou, Peoples R China;[2]corresponding author), Gansu Prov Maternal & Child Hlth Hosp, Dept Neonatol, Lanzhou, Peoples R China.|[107352f23a9081f8152fc]甘肃中医药大学护理学院;[10735]甘肃中医药大学;

年份：2026

卷号：9

外文期刊名：FRONTIERS IN ARTIFICIAL INTELLIGENCE

收录：WOS:【ESCI(收录号:WOS:001737225300001)】；

基金：The author(s) declared that financial support was received for this work and/or its publication. This work was supported by the Hospital Management Special Project of Gansu Provincial Maternity and Child Health Care Hospital (Grant No. CMCCH2024-5-2), GSWSHL2022-31 and GSWSH2021-009, under the Gansu Province Health Industry Scientific Research Program Project.

语种：英文

外文关键词：bronchopulmonary dysplasia; health education materials; large language models; neonatal home oxygen therapy; patient education; prompt engineering; readability

摘要：Background: Neonatal Home Oxygen Therapy (NHOT) is a critical treatment for premature infants with Bronchopulmonary Dysplasia (BPD). However, existing health education materials are generally difficult to read, particularly for grandparent caregivers with lower educational backgrounds. This study aimed to systematically evaluate the capacity of six major Large Language Models (LLMs) to generate and optimize NHOT health education materials. Methods: Six LLMs were included: ChatGPT-5.1, Claude 4.5 Sonnet, Gemini 2.5 Pro, Grok-4.1, Qwen-3-Max, and DeepSeek-V3.2. Each model generated 20 texts under three prompting strategies-baseline (Prompt A), simplification (Prompt B), and rewriting (Prompt C)-yielding 360 texts in total. Twenty WeChat public health articles served as the human-authored baseline. Subjective evaluation employed C-DISCERN, C-PEMAT (understandability and actionability), and a medical accuracy Likert scale, supplemented by objective linguistic analysis using the Alpha Readability Chinese (ARC) tool. Results: All models demonstrated superior medical accuracy compared to the human baseline (Likert median 1.0, against 2.0 for the original articles). Under baseline conditions, Qwen achieved the highest content quality (C-DISCERN median 57.0), while Claude attained perfect actionability scores. The simplification prompt (Prompt B) significantly reduced C-DISCERN scores across all models (all p < 0.001) without meaningfully improving understandability or actionability. In the rewriting task (Prompt C), all models significantly enhanced the understandability of original texts (p < 0.01), with Grok and Qwen additionally improving content quality and actionability. Linguistic analysis revealed that prompt optimization improved semantic accuracy and reduced semantic noise, but at the cost of decreased lexical richness. Conclusion: LLMs demonstrate significant potential for optimizing existing health education materials, performing more reliably in rewriting mode than in de novo generation. Simplistic "plain language" instructions risk compromising content quality, highlighting the need for carefully designed prompts that balance accuracy, clarity, and completeness. All AI-generated materials require rigorous review by qualified clinical professionals prior to distribution.