experiment-design

Design experiments that actually prove something. Most A/B tests fail because they test vague ideas, run too short, or peek at results. A well-designed experiment has a clear hypothesis, adequate power, and a pre-committed analysis plan.

Every experiment starts with a written hypothesis before any work begins:

"If we [make this specific change] for [this audience], then [this metric] will [change in this direction] by [this amount], because [this reason based on evidence]."

使用正確的方法設計假設驅動的實驗和 A/B 測試。當被要求設計 A/B 測試、驗證假設、規劃實驗或為產品變更設定測試時使用。涵蓋假設寫作、樣本量和常見錯誤。 來源：assimovt/productskills。