context-degradation

Language models exhibit predictable degradation patterns as context length increases. Understanding these patterns is essential for diagnosing failures and designing resilient systems. Context degradation is not a binary state but a continuum of performance degradation that manifests in several distinct ways.

Context degradation manifests through several distinct patterns. The lost-in-middle phenomenon causes information in the center of context to receive less attention. Context poisoning occurs when errors compound through repeated reference. Context distraction happens when irrelevant information overwhelms relevant content. Context confusion arises when the model cannot determine which context applies. Context clas...

These patterns are predictable and can be mitigated through architectural patterns like compaction, masking, partitioning, and isolation.

當使用者要求「診斷上下文問題」、「修復中間遺失問題」、「調試代理故障」、「理解上下文中毒」或提到上下文退化、注意力模式、上下文衝突、上下文混亂或代理效能下降時，應該使用此技能。提供用於識別和減輕上下文故障的模式。 來源：chakshugautam/games。