massOfai

Embedding Dimension

AI/ML Fundamentals

Size of vector representation for entities or tokens

What is Embedding Dimension?

Trade-off between expressiveness and memory/compute; common sizes: 50-1024 depending on application.

Real-World Examples

  • Word embeddings of size 300