Atlas · GenAI 2026
A/B Testing
Experimental design & A/B testing
conceptPeak: 2016Experimental DesignAI consensus: 3/3
Prerequisites
A/B testing requires understanding of p-values, confidence intervals, power analysis, and multiple comparison correction — all core statistical concepts
Recommended reference
Kohavi, Tang, Xu (2020) Trustworthy Online Controlled Experiments: A Practical Guide to A/B Testing — the definitive industry book from Microsoft/Airbnb veterans
Notes from AI deep research
Anthropic Opus
Kohavi (Microsoft) napisal biblie. W GenAI: testowanie promptow, modeli, chunking strategies wymaga solid experimental design
OpenAI Deep Research
Projektowanie eksperymentów. Relewancja: core [OA#3]
Google Deep Think
Ewaluacja stochastycznych wyników na produkcji [G#6]
Related skills
- → is subcategory of: Statistical Inference(2/3)
- → is an instance of: Experimental Design(1/3)