massOfai

Top-k Sampling

NLP & Text

Sampling from the k most probable tokens

What is Top-k Sampling?

Limits candidate tokens to top k highest-probability tokens to reduce low-probability noise in generation.

Real-World Examples

  • Top-k=50

Related Terms

Learn more about concepts related to Top-k Sampling