Skip to main content

Layout: FastText

Created on February 4|Last edited on February 4

Exploring fastText models





In this quick project, I explored baselines from Facebook Research's fastText library for text representation and classification.

Run set
53


Optimal Learning Rate 0.5-0.6





Optimal learning rate appears to be around 0.5-0.6 (yellows). Lower values show higher loss (red) and higher values also show slightly higher loss (blue).

Vary LR
8


Experiments varying learning rate




Vary LR
8


Ngram size is most important




Word Dim (green)
3
Ngrams (violet)
3


Word Embedding and Ngram Size




Word Dim (green)
3
Ngrams (violet)
3