Statistical Inference and Experimentation

Learning objectives

• • Explain p-values, power, confidence intervals, and effect sizes without textbook hand-waving
• • Design trustworthy A/B tests with guardrail metrics and stopping rules
• • Identify peeking, selection bias, novelty effects, and multiple-testing risk

Interview prompts

• • How would you size an A/B test for a small lift on a rare event?
• • What is the difference between statistical significance and practical significance?

Prerequisites