Repetition Penalties
Last updated
What is Repetition Penalties?
Repetition penalties discourage LLMs from repeating words or phrases by reducing the probability of selecting previously used tokens. This includes frequency penalty (scales with usage count) and presence penalty (applies equally to any used token). These parameters improve output quality by promoting vocabulary diversity and preventing redundant phrasing.
Free resources to learn Repetition Penalties
More in stage 3: Prompt Engineering
Repetition Penalties: common questions
Can I learn Repetition Penalties in Hindi?
This lesson is written in English. Once you sign in, open it in the interactive course and ask the AI tutor to explain Repetition Penalties in Hindi or Hinglish. The tutor answers from this lesson’s own text, so it stays on the syllabus, and it runs on your own Google, OpenAI or Anthropic key.
Is this Repetition Penalties tutorial for beginners?
It is lesson 26 of 189 in the free AI Engineer roadmap, in stage 3, Prompt Engineering. If you are new to AI Engineer, start from stage 1 and come back here in order; if you already know the earlier stages, this lesson stands on its own.