MATERIALS WORD EMBEDDINGS

WORD2VEC

Based on Mikolov, Tomas et al. "Efficient estimation of word representations in vector space." (2013). arXiv:1301.3781 

Kim, Edward et al. "Machine-learned and codified synthesis parameters of oxide materials." (2017). Scientific Data.

FASTTEXT

Based on Bojanowski, Piotr et al. "Enriching Word Vectors with Subword Information." (2017). arXiv:1607.04606

​

Kim, Edward et al. "Inorganic materials synthesis planning with literature-trained neural networks." (2020). Journal of Chemical Information and Modeling. 

ELMO

Based on Peters, Matthew et al. "Deep contextualized word representations." (2018). arXiv:1802.05365

​

Kim, Edward et al. "Inorganic materials synthesis planning with literature-trained neural networks." (2020). Journal of Chemical Information and Modeling. 

BERT

Based on Devlin, Jacob et al. "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding." (2019). arxiv.org/abs/1810.04805v2