Experimentation
A/B testing, randomization, confounders, Simpson's paradox, offline vs online evaluation.
0/40 done
Experimentation
5 lessons · Read before practicing
A/B testing
- 1Purpose of A/B TestingEasy
- 2A/B Test Null HypothesisEasy
- 3Role of Randomization in A/B TestsEasy
- 4Optional Stopping Risk in A/B TestsMed
- 5Statistical vs Practical Significance in A/B TestsMed
- 6Unit of Randomization vs AnalysisMed
- 7Multiple Testing in A/B Testing ProgramsMed
- 8External Validity in A/B TestingHard
- 9Tradeoffs Between Metrics in A/B TestsHard
- 10One-Sided vs Two-Sided Tests Post-HocHard