Incognition logo
Home
Learn
Practice
Leaderboard
0
VisualizationsSequences, Language & Attention

Word Embeddings

Click to swap a one-hot vector, all zeros but a single 1, for an embedding: a short list of numbers where similar words get similar values.

0
0
0
1
0
0
0
0

One-hot: mostly zeros, no meaning. Now replace it with something dense.

Customize