Data Science

GloVe and fastText Clearly Explained: Extracting Features from Text Data

How are they better than Word2Vec?

Albers Uzila
Level Up Coding
Published in
11 min readSep 12, 2022

--

Table of Contents๐Ÿงค GloVe
โš™๏ธ The Basics
๐Ÿงฎ Cost Function Derivation
๐Ÿ”ฎ Final Prediction
๐Ÿช™ Advantages & Limitations
โฉ fastText
๐Ÿ“š Skip-gram reviewed
๐Ÿ“ˆ Improving Skip-gram
๐Ÿ†š fastText vs Word2Vec
๐Ÿš€ Summary

In most cases, Word2Vec embedding is better than the bag of words representation ofโ€ฆ

--

--