Large Language Models Illuminate a Progressive Pathway to Artificial Healthcare Assistant: A Review

🔔 News

💥 [2023/11/06] Our review paper is available at here.
✨ [2023/11/03] We create this repository to maintain a paper list on Large Language Models (LLMs) in Medicine.

Introduction

In the fast-evolving landscape of artificial intelligence, Large Language Models (LLMs) have emerged as groundbreaking tools with the potential to emulate complex human linguistic abilities. Their profound impact on healthcare, a field at the crossroads of multifaceted data and intricate decision-making, is of immense interest. This repository delves into the integration challenges and showcases the breadth of LLMs' applications within the medical sphere.

Herein, we offer a curated anthology that navigates through the realm of general-purpose and specialized LLMs, elucidating their roles in enhancing medical research, streamlining clinical operations, and supporting diagnostic processes. We cast a spotlight on multimodal LLMs, championing their sophistication in harmonizing varied data streams such as medical imagery and electronic health records (EHRs) to refine diagnostic precision. Advancing into the frontiers of innovation, we explore LLM-empowered autonomous healthcare agents, scrutinizing their capacity for personalized care and intricate clinical reasoning. Additionally, we present a synthesis of evaluative strategies critical for verifying the dependability and security of LLMs within medical settings.

Our extensive analysis sheds light on the transformative promise LLMs hold for healthcare's future. Yet, we underscore the indispensable call for ongoing refinement and ethical vigilance as precursors to their successful clinical integration.

Please note: This repository's scope is centered on the technological evolution of LLMs in medicine. For insights into clinical deployments and applications of LLMs, we invite you to consult our comprehensive review.

We sincerely value all contributions, whether through pull requests, issue reports, emails, or other forms of communication.

Table of Content (ToC)

Introduction
Specialized Medical LLMs
Multimodal LLMs in Medicine
LLM-Powered Healthcare Agents
Evaluation
- Strategies
Valuable Resources
- Related Surveys
  - LLM Techniques
  - LLMs in Medicine
- Repositories
Project Maintainers & Contributors
Citing
Acknowledgement

Evaluating General-Purpose LLMs in Medicine via Prompting

[2023/11] Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicine Harsha Nori et al. arXiv. [paper]
[2023/10] Exploring the Boundaries of GPT-4 in Radiology Liu et al. EMNLP 2023 main. [paper]
[2023/08] Evaluating large language models on medical evidence summarization. Liyan Tang et al. npj Digital Medicine. [paper]
[2023/07] Evaluating Large Language Models for Radiology Natural Language Processing. Zhengliang Liu et al. arXiv. [paper]
[2023/07] Advanced prompting as a catalyst: Empowering large language models in the management of gastrointestinal cancers Jiajia Yuan et al. The Innovation Medicine. [paper]
[2023/04] Are Large Language Models Ready for Healthcare? A Comparative Study on Clinical Language Understanding. Yuqing Wang et al. arXiv. [paper]

Specialized Medical LLMs

[2023/12] Towards Accurate Differential Diagnosis with Large Language Models Daniel McDuff et al. arXiv. [paper]
[2023/11] MEDITRON-70B: Scaling Medical Pretraining for Large Language Models Zeming Chen et al. arXiv. [paper][code]
[2023/11] Taiyi: A Bilingual Fine-Tuned Large Language Model for Diverse Biomedical Tasks Ling Luo et al. arXiv. [paper][code]
[2023/11] HuatuoGPT-II, One-stage Training for Medical Adaption of LLMs Junying Chen et al. arXiv. [paper][code]
[2023/10] AlpaCare:Instruction-tuned Large Language Models for Medical Application Zhang et al. arXiv. [paper] [code]
[2023/10] ChatRadio-Valuer: A Chat Large Language Model for Generalizable Radiology Report Generation Based on Multi-institution and Multi-system Data Zhong et al. arXiv. [paper]
[2023/10] Publicly Shareable Clinical Large Language Model Built on Synthetic Clinical Notes Sunjun Kweon et al. arXiv. [paper] [code]
[2023/09] HealGPT GR-Tech. [code] [demo]
[2023/09] MedChatZH: a Better Medical Adviser Learns from Better Instructions Tan et al. arXiv. [paper] [code]
[2023/09] CPLLM: Clinical Prediction with Large Language Models Shoham et al. arXiv. [paper]
[2023/09] Radiology-Llama2: Best-in-Class Large Language Model for Radiology Liu et al. arXiv. [paper]
[2023/08] Zhongjing: Enhancing the Chinese Medical Capabilities of Large Language Model through Expert Feedback and Real-world Multi-turn Dialogue Songhua Yang et al. arXiv. [paper] [code]
[2023/08] DISC-MedLLM: Bridging General Large Language Models and Real-World Medical Consultation Zhijie Bao et al. arXiv. [paper] [code]
[2023/08] CareGPT: Medical LLM, Open Source Driven for a Healthy Future Rongsheng Wang et al. [code]
[2023/07] HuangDi: A Generative Large Language Model for Ancient Chinese Medical Texts Jundong Zhang et al. [code]
[2023/07] MING: A Chinese Medical Consultation Large Model Yusheng Liao et al. [code]
[2023/06] TCMLLM Xuezhong Zhou et al. [code]
[2023/06] PULSE OpenMedLab. [code]
[2023/06] Sunsimiao: Chinese Medicine LLM Xin Yan et al. [code]
[2023/06] ShenNong-TCM: A Traditional Chinese Medicine Large Language Model Wei Zhu et al. [code]
[2023/06] Radiology-GPT: A Large Language Model for Radiology Zhengliang Liu et al. arXiv. [paper] [code]
[2023/06] MedicalGPT: Training Medical GPT Model Ming Xu et al. [code]
[2023/06] ClinicalGPT: Large Language Models Finetuned with Diverse Medical Data and Comprehensive Evaluation Guangyu Wang et al. arXiv. [paper]
[2023/05] CAMEL: Clinically Adapted Model Enhanced from LLaMA Sunjun Kweon et al. [code] [blog]
[2023/05] Clinfo.AI: Answer Clinical Questions Grounded in Medical Literature Alejandro Lozano et al. [code]
[2023/05] Towards Expert-Level Medical Question Answering with Large Language Models Karan Singhal et al. arXiv. [paper]
[2023/05] CMLM-ZhongJing: Large Language Model is Good Story Listener Yanlan Kang et al. [code]
[2023/05] QiZhenGPT: An Open Source Chinese Medical Large Language Model Yao Chang et al. [code]
[2023/05] HuatuoGPT, towards Taming Language Model to Be a Doctor Hongbo Zhang et al. arXiv. [paper] [code]
[2023/05] Clinical Camel: An Open Expert-Level Medical Language Model with Dialogue-Based Knowledge Encoding Toma et al. arXiv. [paper] [code]
[2023/04] BianQue: Balancing the Questioning and Suggestion Ability of Health LLMs with Multi-turn Health Conversations Polished by ChatGPT Yirong Chen et al. arXiv. [paper] [code]
[2023/04] ChatMed: A Chinese Medical Large Language Model Wei Zhu et al. [code]
[2023/04] DoctorGLM: Fine-tuning your Chinese Doctor is not a Herculean Task Honglin Xiong et al. arXiv. [paper] [code]
[2023/04] PMC-LLaMA: Towards Building Open-source Language Models for Medicine Chaoyi Wu et al. arXiv. [paper] [code]
[2023/04] HuaTuo: Tuning LLaMA Model with Chinese Medical Knowledge Haochun Wang et al. arXiv. [paper] [code]
[2023/04] Doctor Dignity Siraj Raval et al. [code]
[2023/04] MedAlpaca--An Open-Source Collection of Medical Conversational AI Models and Training Data Tianyu Han et al. arXiv. [paper] [code]
[2023/03] Palmyra-Large Parameter Autoregressive Language Model Writer Engineering team. [code]
[2023/03] ChatGLM-Med Haochun Wang et al. [code]
[2023/03] ChatDoctor: A Medical Chat Model Fine-Tuned on a Large Language Model Meta-AI (LLaMA) Using Medical Domain Knowledge Yunxiang Li et al. Cureus. [paper] [code]
[2022/12] A large language model for electronic health records Xi Yang et al. npj Digital Medicine. [paper] [code]
[2022/12] Large language models encode clinical knowledge Karan Singhal et al. Nature. [paper] [code]
[2022/10] Health system-scale language models are all-purpose prediction engines Lavender Yao Jiang et al. Nature. [paper] [code]

Multimodal LLMs in Medicine

[2023/12] A Foundational Multimodal Vision Language AI Assistant for Human Pathology Ming Y. Liu et al. arXiv, [paper]
[2023/10] Qilin-Med-VL: Towards Chinese Large Vision-Language Model for General Healthcare Junling Liu et al. arXiv. [paper] [code]
[2023/08] ELIXR: Towards a general purpose X-ray artificial intelligence system through alignment of large language models and radiology vision encoders Shawn Xu et al. arXiv. [paper]
[2023/08] Towards Generalist Foundation Model for Radiology by Leveraging Web-scale 2D&3D Medical Data Chaoyi Wu et al. arXiv. [paper] [code]
[2023/08] BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicine Yizhen Luo et al. arXiv. [paper] [code]
[2023/07] Multimodal LLMs for health grounded in individual-specific data Anastasiya Belyaeva et al. arXiv. [paper]