Doctoral Showcase Archive

Foundation Models for Discovery and Exploration in Chemical Space


Author: Anoushka Bhutani (University of Michigan)

Advisor: Venkat Viswanathan (University of Michigan)

Abstract: Accurate, rapid prediction of molecular properties remains a bottleneck in materials innovation because experiments and conventional simulations are too costly to explore vast, high-dimensional chemical spaces. Scalable and interpretable molecular foundation models can accelerate discovery across chemical space while using computational resources efficiently. We demonstrate this with MIST, a family of molecular foundation models trained with up to an order of magnitude more data and parameters than prior work. To train MIST we developed Smirk, a tokenizer which preserves nuclear, electronic, and geometric information, enabling representation learning across chemical systems.

The largest MIST model has 1.8B parameters and was trained on 2B molecules. Training such a large model is an expensive endeavor. To make model development tractable on an academic compute budget we developed hyperparameter-penalized neural scaling laws which guided identification of compute-optimal model configurations without exhaustive sweeps at every scale, reducing model-development cost by an order of magnitude.

MIST models have been fine-tuned to predict over 400 structure–property relationships spanning domains from psychophysics to electrochemistry. They demonstrate state-of-the-art benchmark performance and enable real-world applications including stereochemical reasoning for organometallics, olfactory perception mapping, and electrolyte formulation design.

Beyond raw predictive accuracy, using mechanistic-interpretability methods we determine MIST learns chemically meaningful concepts during training. Analysis of token vectors, low-dimensional embedding projections and model logits reveals concept-aligned structures not explicitly labeled during training.

Together, these contributions connect molecular representation learning, compute-optimal scaling, and broad scientific validation, establishing scientific foundation models as robust tools for materials discovery and optimization.


Thesis Canvas: pdf



Back to Doctoral Showcase Archive Listing