详细信息

Profile-associated financial and access-related framing in LLM-generated pediatric asthma referral plans: a factorial audit of seven large language models    

文献类型:期刊文献

英文题名:Profile-associated financial and access-related framing in LLM-generated pediatric asthma referral plans: a factorial audit of seven large language models

作者:Liu, Zhendong[1,2];Yang, Xiaoping[1];Zhang, Yu[2];Xu, Yujing[1];Xiang, Yue[1];Wang, Hongyan[1,2]

第一作者:Liu, Zhendong

通信作者:Wang, HY[1];Wang, HY[2]

机构:[1]Gansu Univ Tradit Chinese Med, Grad Sch, Lanzhou, Peoples R China;[2]Gansu Prov Maternal & Child Hlth Hosp, Dept Pediat, Lanzhou, Peoples R China

第一机构:甘肃中医药大学

通信机构:[1]corresponding author), Gansu Univ Tradit Chinese Med, Grad Sch, Lanzhou, Peoples R China;[2]corresponding author), Gansu Prov Maternal & Child Hlth Hosp, Dept Pediat, Lanzhou, Peoples R China.|[10735]甘肃中医药大学;

年份:2026

卷号:8

外文期刊名:FRONTIERS IN DIGITAL HEALTH

收录:Scopus(收录号:2-s2.0-105046812461);WOS:【ESCI(收录号:WOS:001826352900001)】;

基金:The author(s) declared that financial support was received for this work and/or its publication. This work was supported by the Hospital Management Special Project of Gansu Provincial Maternity and Child Health Care Hospital (Grant No. CMCCH2024-5-2).

语种:英文

外文关键词:algorithmic audit; clinical AI evaluation; health equity; large language models; pediatric asthma; social determinants of health; structural competence

摘要:Background Large language models (LLMs) are increasingly considered for clinical documentation, referral support, and patient-facing communication. Biomedical accuracy alone may be insufficient for safe deployment if generated plans vary in access navigation, financial-access language, referral specificity, or tone across socially meaningful patient cues. Objective To evaluate whether onomastic and bundled geographic-access signals are associated with differences in LLM-generated pediatric asthma referral plans. Methods We conducted a cross-sectional 2 & times; 2 factorial audit of seven commercial LLMs. A standardized vignette described a 5-year-old boy with moderate persistent asthma, persistent nocturnal symptoms, FEV1 of 70% predicted, and an Asthma Control Test score of 16. Patient name, Liam Miller versus DeShawn Washington, and address/geography, Palo Alto, CA versus Indianola, MS, were manipulated while clinical facts were held constant. Each model generated 20 responses per profile, yielding 560 referral plans. Outputs were scored using a prespecified Automated Structural Competence Scoring framework. The primary endpoint was response-length-adjusted M16 Financial-Access Term Rate, analyzed using a negative-binomial model with log word-count offset and LLM fixed effects. Key secondary endpoints were controlled using Benjamini-Hochberg false-discovery-rate correction.Results In the response-level primary model, the DeShawn name signal was associated with a higher financial-access term rate (IRR, 1.47; 95% CI, 1.23-1.77; p < 0.001), as was the bundled geographic-access signal (IRR, 2.40; 95% CI, 2.02-2.85; p < 0.001). The name-signal association was directionally similar but less precise in model-profile aggregated sensitivity analysis. The interaction term was below 1.0 (IRR, 0.79; 95% CI, 0.63-1.00; p = 0.048), indicating no positive multiplicative synergy. Institutional Specificity and Triage Ranking were at ceiling. SDOH Recognition Depth, Location-Friction Acknowledgment, Navigator Recommendation, and Empathy/Subjectivity differed by profile, whereas Access Priority remained low and non-significant after correction. Human validation showed moderate endpoint-specific reliability. Conclusions LLM-generated pediatric asthma referral plans varied in financial-access, geographic-access, navigation, SDOH-recognition, and selected tone-related framing. These findings do not establish discriminatory intent, clinical equivalence, downstream harm, or positive synergistic interaction, but support evaluating structural and access-related framing alongside biomedical content in clinical LLM audits.

参考文献:

正在载入数据...

版权所有©甘肃中医药大学 重庆维普资讯有限公司 渝B2-20050021-8 
渝公网安备 50019002500408号 违法和不良信息举报中心