medical_image.md

Application of Visual Language Model in Medical Images

1. CLIP-Driven Universal Model for Organ Segmentation and Tumor Detection

Author: Jie Liu, Yixiao Zhang, Jie-Neng Chen, Junfei Xiao, Yongyi Lu, Bennett A. Landman, Yixuan Yuan, Alan Yuille, Yucheng Tang, Zongwei Zhou

[GitHub Repo] [Paper]

简介 在多个部位的癌症数据集上学习；CLIP。

CILP-Driven Universal Model

2. MedKLIP: Medical Knowledge Enhanced Language-Image Pre-Training

Author: Chaoyi Wu, Xiaoman Zhang, Ya Zhang, Yanfeng Wang, Weidi Xie

[GitHub Repo (Not Released)] [Paper] [Page]

简介 使用基于规则的文本提取器结构化病例，并使用同义词词库扩充语义信息；缺点是实验结果并不好。

MedKLIP

3. Multi-Granularity Cross-modal Alignment for Generalized Medical Visual Representation Learning

Author: Fuying Wang, Yuyin Zhou, Shujun Wang, Varut Vardhanabhuti, Lequan Yu

[GitHub Repo] [Paper]

简介 在三个语义层面对齐；实验结果挺好。

MGCA