medRxiv: Drug-safety warnings weaker on Russian, Arabic and Hebrew Wikipedia than English, audit finds

[medRxiv] A cross-sectional audit of 33 drugs found that Russian, Arabic and Hebrew Wikipedia articles carried weaker drug-safety warnings than English articles, according to the authors. The study covered 24 risk-positive drugs (eight each for G6PD deficiency, teratogenicity and QT-interval prolongation) plus nine negative controls; three large language models coded each warning, and a hierarchical Bayesian cumulative-logit model used English as reference. The authors reported pooled cumulative odds ratios versus English of 0.41 for Russian, 0.25 for Arabic and 0.31 for Hebrew, with posterior probabilities of 78%, 87% and 87% that English warns more strongly, while the 95% credible intervals included 1. Eight of nine language-by-domain estimates were below 1, the exception being Russian QT. Exploratory analyses suggested the Russian gap mainly reflects missing or short articles, whereas Arabic articles less often escalated a mentioned risk to a directive. The authors said uncertainty was wide given a small purposive panel and model codes not yet validated against human coding.