Complete Course on A/B Testing with Interview Guide
What you will learn
How companies like Google, Facebook, Amazon use Experimentation to launch successful products
Ace Experimentation & A/B Testing interviews
A/B Testing, Multivariate Testing & Multi-armed Bandit Testing
Hypothesis testing, including inferential statistics, significance level, type I and II errors, p-values, statistical significance and statistical power
End to end process from hypothesis generation & design to implementation & analysis
Real world examples from Amazon, AirBnb, Square, Uber
Relevance of statistics and how each statistical concept fits in the big picture of A/B testing
Sample size calculation and test results analysis using R
Use experimentation to optimize websites and app
Sample size calculation using online calculators
Use experimentation to increase conversion on landing pages or in-app campaigns
Templates & Cheatsheet to generate, prioritize and analyze A/B tests
Course Gallery
Charts
Comidoc Review
Our Verdict
The Complete Course on A/B Testing with Interview Guide offers a strong foundation in various aspects of experimentation, especially focusing on A/B testing techniques. The course's strengths revolve around its coverage of business intuition and interviews questions paired with answers. Additionally, it provides comprehensive explanations of complex ideas while introducing learners to the usage of R coding for real-world applications. However, there are areas of opportunity for this course related primarily to offering more detailed examples for complex topics, delving deeper into statistical concepts, providing hands-on practice with third-party tools, and giving learners access to downloadable presentations to foster further independent learning. With a greater emphasis on these specific components, the overall experience and effectiveness of the course could be significantly enhanced, making it an even more well-rounded A/B testing resource for students."
What We Liked
- In-depth coverage of A/B testing, including multivariate and multi-armed bandit testing
- Emphasis on business intuition and practical use cases, with interview questions and answers
- Usage of R coding and statistics, with concepts explained in an accessible manner for beginners
- End-to-end process from hypothesis generation to implementation and analysis
Potential Drawbacks
- Lack of detailed explanations for certain statistical concepts, such as confidence intervals and formula derivations
- Limited number of examples in some sections, causing difficulty in understanding the material
- Minimal hands-on practice with third-party testing platforms or tools like Optimizely
- Absence of downloadable PPT decks for reviewing concepts outside of the course