Journal
NPJ COMPUTATIONAL MATERIALS
Volume 7, Issue 1, Pages -Publisher
NATURE PORTFOLIO
DOI: 10.1038/s41524-021-00545-1
Keywords
-
Funding
- NSF CAREER Award [DMR 1651668]
- Berlin International Graduate School in Model and Simulation-based Research
- German Academic Exchange Service [57438025]
Ask authors/readers for more resources
In this paper, we demonstrated the application of the Transformer self-attention mechanism in materials science through CrabNet. CrabNet shows promising performance in structure-agnostic materials property predictions when only a chemical formula is provided, outperforming current best-practice methods on 28 benchmark datasets and offering model interpretability through its architecture. CrabNet and its attention-based framework are expected to spark interest among future materials informatics researchers.
In this paper, we demonstrate an application of the Transformer self-attention mechanism in the context of materials science. Our network, the Compositionally Restricted Attention-Based network (CrabNet), explores the area of structure-agnostic materials property predictions when only a chemical formula is provided. Our results show that CrabNet's performance matches or exceeds current best-practice methods on nearly all of 28 total benchmark datasets. We also demonstrate how CrabNet's architecture lends itself towards model interpretability by showing different visualization approaches that are made possible by its design. We feel confident that CrabNet and its attention-based framework will be of keen interest to future materials informatics researchers.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available