Language models can extract documented cannabis use, but need validation
Extracting patient-reported cannabis use and reasons for use from EHR in rheumatology: a benchmarking study of language models.
AI Summary
This retrospective study asked whether language models can identify documented cannabis use and reasons for use in electronic health records of patients with autoimmune rheumatic diseases. Researchers compared language models, a fine-tuned clinical model, and a logistic-regression baseline using expert-labeled snippets from clinical notes recorded between 2015 and 2024. The tasks were to classify use status and identify documented reasons such as pain, nausea, sleep, or stress and anxiety.
The fine-tuned GatorTron model had the highest reported point estimates for use-status classification, while GPT-OSS-20B had the highest for reasons for use. The confidence intervals for the best and second-best models overlapped, so the apparent differences should be interpreted cautiously. The study indicates that automated extraction is feasible, but this retrospective benchmarking study cannot establish how common cannabis use is among patients with these conditions; the authors call for validation in samples representative of prevalence. This is an abstract-based summary.
π‘ Key Findings
π
Original Abstract
Related Research
Similar Studies
More Pain research papers you might find interesting.
Interviews explore how adults with regular pain perceive cannabis use
An 18-month cohort found adverse outcomes were infrequent, but long-term risksβ¦
TBI study links cannabis use with symptoms, not proven effects
Explore More Research
Stay informed about the latest cannabis science.