Navigating Chemical-Linguistic Sharing Space with Heterogeneous Molecular Encoding

Read the full article See related articles

Listed in

This article is not in any list yet, why not save it to one of your lists.
Log in to save this article

Abstract

Chemical language models (CLMs) are prominent for their effectiveness in exploring chemical space and enabling molecular design and engineering. However, while exploring chemical-linguistic space, CLMs suffer from the semantic gap between natural language and molecular representations. This challenge is primarily due to the inherent modeling differences between molecules and texts: molecules operate unified modeling to learn chemical space, while natural language sequentially models their semantic space. Additionally, the limited availability of high-quality text-to-molecule datasets further exacerbates this challenge. To address the problem, we first verified the information bias in molecular representations from different perspectives. We then developed the Heterogeneous Molecular Encoding (HME) framework, a unified molecular encoder compressing the molecular features from fragment sequence, topology, and conformation with Q-learning. To better model chemical-linguistic space, we further constructed the MCMoD dataset, which contains over one million molecules with various conditions, including properties, fragments, and descriptions. Experimentally, HME promotes CLMs to achieve chemical-linguistic sharing space exploration from two aspects: (1) chemical space exploration with linguistic guidance, where HME achieves significant improvements (+37.8% FCD) for molecular design in multiple constraints, even in zero-shot learning scenarios; (2) linguistic space exploration with molecular guidance, where HME generates textual descriptions with high qualities (+11.6% BLEU) for molecules. These results highlight the precision of HME in handling multi-objective and cross-domain tasks, as well as its remarkable generalization capability on unseen task combinations. HME offers a new perspective on navigating the chemical-linguistic sharing space, advancing the potential of CLMs in both fundamental research and practical applications in chemistry.

Article activity feed