prompt-repetition

LLMs are trained as Causal Language Models, where each token attends only to previous tokens. This leads to:

Prompt repetition enables the second pass to reference the entire first pass, effectively mimicking some benefits of bidirectional attention.

In the second repetition, the model reprocesses information across the entire first prompt and strengthens attention weights on key concepts, resulting in improved performance.

提高法學碩士準確性的快速重複技術。在 70 個基準測試中，67% (47/70) 實現了顯著的效能提升。自動套用於輕量級模型（haiku、flash、mini）。 來源：akillness/skills-template。