-
Notifications
You must be signed in to change notification settings - Fork 0
/
index.html
129 lines (105 loc) · 9.26 KB
/
index.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
<title>AMIA 2024 Annual Symposium Panel on Multimodal Data Analysis in Healthcare: Opportunities and Challenges</title>
<link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/bootstrap/3.2.0/css/bootstrap.min.css">
<link href='http://fonts.googleapis.com/css?family=Lato:400,700' rel='stylesheet' type='text/css'>
<link href="css/style.css" rel="stylesheet" type="text/css" />
</head>
<body>
<div class="container">
<table border="0" align="center">
<tr>
<td width="700" align="center" valign="middle"><h3>AMIA 2024 Annual Symposium Panel on</h3>
<span class="title">Multimodal Data Analysis in Healthcare: Opportunities and Challenges</span></td>
</tr>
<tr>
<h2><td colspan="3" align="center"><br>
Location: Continental Ballroom 5 - Hilton Union Square, San Francisco, CA, USA<br>
Time: <b>1:45-3:15 pm PST, November 11, 2024</b>
</td>
</h2>
</tr>
</table>
<!-- <p><img src="figures/teaser.jpg" width="1000" align="middle" /></p> -->
</div>
</br>
<div class="container">
<h2>Panelists</h2>
<div class = "row">
<div class="instructor">
<a href="https://www.ncbi.nlm.nih.gov/research/bionlp/">
<div class="instructorphoto"><img src="figures/luzh.png"></div>
<div>Zhiyong Lu<br>National Library of Medicine<br></div>
</a>
</div>
<div class="instructor">
<a href="https://ldi.upenn.edu/fellows/fellows-directory/kevin-b-johnson-md-ms/">
<div class="instructorphoto"><img src="figures/kevin.jpg"></div>
<div>Kevin B. Johnson<br>University of Pennsylvania<br></div>
</a>
</div>
<div class="instructor">
<a href="https://www.microsoft.com/en-us/research/people/hoifung/">
<div class="instructorphoto"><img src="figures/hoifung.jpg"></div>
<div>Hoifung Poon<br>Microsoft Inc<br><br></div>
</a>
</div>
</div>
<div class = "row">
<div class="instructor">
<a href="https://www.mayo.edu/research/faculty/banerjee-imon-ph-d/bio-20555791">
<div class="instructorphoto"><img src="figures/imon.jpg"></div>
<div>Imon Banerjee<br>Mayo Clinic<br></div>
</a>
</div>
<div class="instructor">
<a href="https://penglab.weill.cornell.edu/">
<div class="instructorphoto"><img src="figures/yifan_peng.jpg"></div>
<div>Yifan Peng<br>Weill Cornell Medicine<br></div>
</a>
</div>
</div>
</div>
</br>
<div class="container">
<h2>Overview</h2>
<div class="overview">
<p>The recent advances in multimodal foundation models have made a significant shift in research and clinical practices. However, to fully realize the potential of multimodal data analysis, there are various scientific and social challenges that need to be addressed, such as how to ensure models’ trustworthiness and scalability, and how to maintain data quality and integration. The objective of this panel is to introduce the audience to the opportunities and challenges, as well as the development and responsible employment of such technology in research and healthcare. It will specifically focus on the development of multimodal foundation models in healthcare, issues of model transparency, accountability, and fairness, and multimodal data de-identification and sharing. After participating in this session, attendees should be able to understand the most important challenges facing multimodal data analysis and some of the possible solutions. </p>
</div>
</div>
<br>
<div class="container">
<h2>Tentative Schedule</h2>
<div class="schedule">
<p><span class="announce_date">1:45-2:05pm</span>. Hidden flaws behind expert-level accuracy of GPT-4 vision in medicine (Zhiyong Lu)</p>
<p><span class="announce_date">2:05-2:25pm</span>. Challenges of de-identifying and sharing multimodal data (Kevin B. Johnson)</p>
<p><span class="announce_date">2:25-2:45pm</span>. Precision health in the age of multimodal generative AI (Hoifung Poon)</p>
<p><span class="announce_date">2:45-3:05pm</span>. Health disparities in large visual-language models (Imon Banerjee)</p>
<p><span class="announce_date">3:05-3:15pm</span>. Pannel discussion</p>
</div>
</div>
<br>
<div class="container">
<h2>About the speakers</h2>
<div class="schedule">
<p><b>Zhiyong Lu</b>, Ph.D., is a tenured Senior Investigator in the NIH Intramural Research Program, leading research in biomedical text and image processing, information retrieval, and AI/machine learning. In his role as Deputy Director for Literature Search at the National Center of Biotechnology Information (NCBI), Dr. Lu oversees the overall R&D efforts to improve literature search and information access in resources like PubMed and LitCovid that are used by millions worldwide on a daily basis. Additionally, Dr. Lu holds an Adjunct Professor position with the Department of Computer Science at the University of Illinois Urbana-Champaign (UIUC). In this panel, Dr. Lu will discuss their latest research related to multi-modal foundation models such as GPT4 Vision and their applications in various medical applications such as automated disease diagnosis and medical report generation.
</p>
<p><b>Kevin B. Johnson</b>, MD, MS, is the David L. Cohen University Professor of Pediatrics, Biomedical Informatics, and Science Communication at the University of Pennsylvania. He is an internationally known developer and evaluator of clinical information technology. His main research is focused on the use of multimodal data and machine learning to summarize and quantify patient signs and symptoms in the EHR, assist with generating medical communications, and create decision support tools using real-time streaming data. In this panel, Dr. Johnson will discuss the challenges of deidentifying multimodal data and developing robust pipelines that promote the sharing of these data.
</p>
<p><b>Hoifung Poon</b>, Ph.D., is General Manager at Health Futures in Microsoft Research and an affiliated faculty at the University of Washington Medical School. He leads biomedical AI research and incubation, with the overarching goal of structuring medical data to optimize delivery and accelerate discovery for precision health. His team and collaborators are among the first to explore large language models (LLMs) in health applications, producing popular open-source foundation models such as PubMedBERT, BioGPT, BiomedCLIP, LLaVA-Med. His latest publication in Nature features GigaPath, the first whole-slide digital pathology foundation model pretrained on over 1 billion pathology image tiles. He has led successful research partnerships with large health providers and life science companies, creating AI systems in daily use for applications such as molecular tumor board and clinical trial matching. In this panel, Dr. Poon will discuss the exciting frontier of multimodal generative AI in Precision Health, where multimodal, longitudinal real-world patient data can be used to pretrain powerful multimodal patient embedding, enable patient-like-me reasoning at scale, and unlock population-level real-world evidence for advancing precision medicine.
</p>
<p><b>Imon Banerjee</b>, Ph.D., pertains to computer science, particularly artificial intelligence (AI) and data mining. Her studies show implicit bias in the AI model toward race across multiple imaging modalities. Dr. Banerjee's goal is to decrease AI-driven healthcare disparities. She reduces this tendency by using model unlearning and adversarial debiasing. These techniques decrease inaccurate, harmful, and outdated information learned by the AI models. She collaborates with institutions and centers that serve minority groups, such as Emory University in Atlanta and the Mountain Park Health Center in Arizona, to train and evaluate AI models with diverse datasets. In this panel, Dr. Banerjee will discuss the challenges in reducing bias and vulnerability in the pre-training of large visual-language models. She will also highlight the effect of pre-training bias in the downstream targeted tasks.
</p>
<p><b>Yifan Peng</b> (Moderator), Ph.D., FACMI, is an Associate Professor in the Department of Population Health Sciences at Weill Cornell Medicine. His main research interests include BioNLP and medical image analysis. He has published in major AI and healthcare informatics venues, including ACL, NAACL, CVPR, and MICCAI, as well as medical venues, including Nature Medicine, Nucleic Acids Research, npj Digital Medicine, and JAMIA. His research has been funded by federal agencies, including NIH and NSF and industries such as Amazon and Google. He received the AMIA New Investigator Award in 2023.
</p>
</div>
</div>
<br>
<div class="containersmall">
<p>Please contact <a href="yip4002@med.cornell.edu">Yifan Peng</a> if you have question. The webpage template is by the courtesy of awesome <a href="https://gkioxari.github.io/">Georgia</a>.</p>
</div>
<!--<p align="center" class="acknowledgement">Last updated: Jan. 6, 2017</p>-->
</body>
</html>