Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

About TrialGPT

Patient recruitment is challenging for clinical trials. We introduce TrialGPT, an end-to-end framework for zero-shot patient-to-trial matching with large language models. TrialGPT comprises three modules: it first performs large-scale filtering to retrieve candidate trials (TrialGPT-Retrieval); then predicts criterion-level patient eligibility (TrialGPT-Matching); and finally generates trial-level scores (TrialGPT-Ranking). We evaluate TrialGPT on three cohorts of 183 synthetic patients with over 75,000 trial annotations. TrialGPT-Retrieval can recall over 90% of relevant trials using less than 6% of the initial collection. Manual evaluations on 1,015 patient-criterion pairs show that TrialGPT-Matching achieves an accuracy of 87.3% with faithful explanations, close to the expert performance. The TrialGPT-Ranking scores are highly correlated with human judgments and outperform the best-competing models by 43.8% in ranking and excluding trials. Furthermore, our user study reveals that TrialGPT can reduce the screening time by 42.6% in patient recruitment. Overall, these results have demonstrated promising opportunities for patient-to-trial matching with TrialGPT.

TrialGPT Framework

Proposed Overall Framework for Effective Patient-to-Trial Matching using Generative AI.

Our Team

Members from NLM
PI: Zhiyong Lu, PhD
Tech Lead: Qiao Jin, MD
Team Members: Yifan Yang; Joey Chan; Nick Wan; Shubo Tian, PhD
Collaborators from other NIH Institutes
NCI: Charalampos S Floudas, MD DMSc MS; Dara Bracken-Clarke, MD; Elisabetta Xue, MD; James L. Gulley, MD PhD
NEI: Emily Chew, MD
NICHD: Christina Tatsi, MD MHSc PhD
Collaborators from Organizations outside NIH
UIUC: Zifeng Wang; Jimeng Sun, PhD
Harvard: Fangyuan Chen, MD
Jacobi Medical Center: Changlin Gong, MD