Masked Language Model

SemGloVe: Semantic Co-occurrences for GloVe from BERT
GloVe learns word embeddings by leveraging statistical information from word co-occurrence matrices. However, word pairs in the …
Leilei Gan, Zhiyang Teng, Yue Zhang, Linchao Zhu, Fei Wu, Yi Yang
PDF Cite
SemGloVe: Semantic Co-occurrences for GloVe from BERT