Deep learning lecture 4 Word Embedding

基于knowledge的表示

基于语料库的表示

atomic symbol

neighbors

issues on window-based co-occurrence matrix

word2vec

Glove

Word2Vec skip-gram model

GloVe 结合count-based and direct prediction的两方面的好处

Word vector evaluation

intrinsic evaluation-Word Analog

intrinsic evaluation-Word Correlation

extrinsic evaluation-Subsequent task