streaming-api-patterns

SKILL.md

CRITICAL: Async generators can leak resources if not properly cleaned up. Python 3.10+ provides aclosing() from contextlib to guarantee cleanup.

| External API streaming (LLM, HTTP) | ✅ Always | | Database streaming results | ✅ Always | | File streaming | ✅ Always | | Simple in-memory generators | ⚠️ Optional (no cleanup needed) | | Generator with try/finally cleanup | ✅ Always |

| Server-to-Client Streaming | SSE | Simple protocol, auto-reconnect, HTTP/2 compatible | | Bidirectional Communication | WebSockets | Full-duplex, low latency, binary support | | LLM Token Streaming | ReadableStream + SSE | Backpressure control, standard format | | Reconnection Strategy | Exponential Backoff | Prevents thundering herd, graceful recovery |

使用 SSE、WebSockets 和 ReadableStream 進行實時數據流。在實現流響應、實時數據更新、服務器發送事件、WebSocket 設置、實時通知、推送更新或聊天服務器後端時使用。 來源：yonatangross/orchestkit。

查看原文