How to Use Multi-Armed Bandits for A/B Testing and Online Decision Making
A practical guide to multi-armed bandit algorithms for ML engineers: epsilon-greedy, Thompson Sampling with Beta-Binomial conjugate priors, UCB1 with regret bounds, contextual bandits with LinUCB, when to use bandits vs A/B tests, and implementing persistent bandit state in production with Redis.