Program in Quantitative Genomics
The Program in Quantitative Genomics (PQG) develops and applies quantitative methods to help handle massive genetic, genomic, and health data. Based in the Harvard Chan School and Longwood Medical Area, its goal is to improve health through the interdisciplinary study of genetics, behavior, environment, and health.
255 Huntington Ave
Building 2, 4th floor
Boston, MA 02115
Multimodal LLMs and beyond: optimizing prediction models with controlled agent swarms
Health and biomedicine are inherently multimodal, and require integration of multiple heterogeneous data sources to develop truly personalized models. In this talk I will present architectural strategies for augmenting existing multimodal LLMs with clinical data ranging from tabular values to waveforms to genomic features. I will then discuss a system that uses a controlled swarm of AI agents to iteratively optimize scorable prediction tasks and its application to scientific problems spanning disciplines.