Author: Neringa Jurenaite (Technische Universität Dresden, Center for Information Services and High Performance Computing (ZIH); Center for Scalable Data Analytics and Artificial Intelligence (ScaDS.AI) Dresden/Leipzig)
Advisor: Wolfgang E. Nagel (CIDS (Center for Interdisciplinary Digital Sciences), Technical University Dresden), Jakob N. Kather (Technical University of Dresden)
Abstract: The recent rapid growth and curation of large multi-omic datasets, driven largely by high-throughput sequencing, have provided unprecedented opportunities in medical and clinical research, especially for precision medicine. This presents an opportunity for improved multi-omic deep learning implementations for oncology tasks. However, it comes with a set of challenges, namely:
1. Granularity in genomic variant representation: representing complex, arbitrary-length genomic variant data without destroying spatial context or non-coding regulatory signals in both standalone and multi-omic models
2. Scalability and efficiency: establishing efficient and domain-informed data loading strategies, hyperparameter optimization guidelines and computationally scalable architectural choices, especially for resource-intensive medical applications
3. Systematized multi-omic integration: How can we rigorously evaluate multi-omics integration strategies and assess which combinations of omics modalities yield the most informative biological representations for oncology tasks?
To address these issues, we have made the following contributions. First, we developed a feasibility study into the representation of genomic variant data, leveraging genome language models (gLMs) to capture nucleotide-level dependencies across variable-length somatic variant-associated sequences for pan-cancer classification and survival analysis. Next, we scaled our framework to combine both coding exomes and non-coding regions by implementing input load balancing and architectural changes, improving performance on chosen oncology tasks. Finally, we introduced a generalized, versatile, and modular framework that incorporates key autoencoder architectures for representation learning, enabling exploration and robust evaluation of multi-modal omics integration.
The cumulative findings bridge hardware-efficient scaling, biological representation learning, and cancer-specific multi-omics to drive medical actionability.
Thesis Canvas: pdf