Netflix Shares a Decade of A/B Test Learning
Saturday, March 14
9:30AM - 10:30AM
110 E 2nd St
In order to continually improve the customer experience the Netflix product, design and algorithm teams have run over a thousand A/B tests with tens of millions of users. We have had many successes and, even more importantly, many more failures. If too many of our tests are wins then we’re not pushing hard enough and not learning enough.
For years we made steady progress but 2010 was a turning point. As we started doing large scale UI testing on the “ten foot experience” we learned a smarter way to do A/B testing, rapidly accelerated the pace of product innovation.
Todd Yellin will share an assortment of design and algorithm wisdom gleaned from getting at the truths that can only be gained from focusing on actual user behavior. He’ll share some less obvious lessons about interaction design gained from some supposedly sure bets that flopped. And other more successful tests run on the interfaces and algorithms from sign up to content discovery to actual viewing experience.
VP Prod Innovation
Todd S. Yellin has enjoyed a career dedicated to film and TV entertainment. He started working at Netflix nine years ago. His current role as VP of Product Innovation revolves around changing the...Show the rest
Todd S. Yellin has enjoyed a career dedicated to film and TV entertainment. He started working at Netflix nine years ago. His current role as VP of Product Innovation revolves around changing the way people find great streaming content to watch over the internet on their TVs, computers and mobile devices.
He is responsible for inspiring best-in-class user interfaces and design across numerous viewing devices (PCs, smart TVs, tablets, smart phones, game consoles, set top boxes, etc.) that leverage vast amounts of data and sophisticated algorithms to create an easy, compelling way for Netflix members to find something great to watch. He also oversees member acquisition, content tagging, social discovery and messaging.
As a documentarian, in 1994, Todd became the only person ever to film Tibetan children escaping over the Himalayas. He also co-wrote and directed a feature film "Brother's Shadow," which as of September, '14 is available to stream on Netflix.Hide the rest