Technical report: Improving the properties of molecules generated by LIMO
Vineet Thumuluri, Peter Eckmann, Michael K. Gilson, Rose Yu

TL;DR
This technical report explores enhancements to the LIMO framework for molecule generation, demonstrating that an autoregressive Transformer decoder with GroupSELFIES improves molecular property outcomes.
Contribution
It introduces optimized variants of LIMO, particularly using an autoregressive Transformer with GroupSELFIES, to enhance generated molecule properties.
Findings
Autoregressive Transformer with GroupSELFIES yields better molecular properties.
Ablative studies identify key factors influencing molecule quality.
Transformer-based models outperform other decoders in this framework.
Abstract
This technical report investigates variants of the Latent Inceptionism on Molecules (LIMO) framework to improve the properties of generated molecules. We conduct ablative studies of molecular representation, decoder model, and surrogate model training scheme. The experiments suggest that an autogressive Transformer decoder with GroupSELFIES achieves the best average properties for the random generation task.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsVarious Chemistry Research Topics
MethodsAttention Is All You Need · Byte Pair Encoding · Layer Normalization · Label Smoothing · Linear Layer · Softmax · Position-Wise Feed-Forward Layer · Absolute Position Encodings · Multi-Head Attention · Dense Connections
