TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/TorchMD-NET: Equivariant Transformers for Neural Network b...

TorchMD-NET: Equivariant Transformers for Neural Network based Molecular Potentials

Philipp Thölke, Gianni de Fabritiis

2022-02-05Graph Property Prediction
PaperPDFCode(official)

Abstract

The prediction of quantum mechanical properties is historically plagued by a trade-off between accuracy and speed. Machine learning potentials have previously shown great success in this domain, reaching increasingly better accuracy while maintaining computational efficiency comparable with classical force fields. In this work we propose TorchMD-NET, a novel equivariant transformer (ET) architecture, outperforming state-of-the-art on MD17, ANI-1, and many QM9 targets in both accuracy and computational efficiency. Through an extensive attention weight analysis, we gain valuable insights into the black box predictor and show differences in the learned representation of conformers versus conformations sampled from molecular dynamics or normal modes. Furthermore, we highlight the importance of datasets including off-equilibrium conformations for the evaluation of molecular potentials.

Results

TaskDatasetMetricValueModel
Graph Property PredictionQM9Standardized MAE0.84TorchMD-NET
Graph Property PredictionQM9alpha (ma)59TorchMD-NET
Graph Property PredictionQM9gap (meV)36.1TorchMD-NET
Graph Property PredictionQM9logMAE-5.9TorchMD-NET

Related Papers

Graph Positional Autoencoders as Self-supervised Learners2025-05-29Message-Passing State-Space Models: Improving Graph Learning with Modern Sequence Modeling2025-05-24GotenNet: Rethinking Efficient 3D Equivariant Graph Neural Networks2025-04-24Unlocking the Potential of Classic GNNs for Graph-level Tasks: Simple Architectures Meet Excellence2025-02-13Graph Generative Pre-trained Transformer2025-01-02Virtual Nodes Can Help: Tackling Distribution Shifts in Federated Graph Learning2024-12-26Data-Driven Self-Supervised Graph Representation Learning2024-12-24Next Level Message-Passing with Hierarchical Support Graphs2024-06-22