While the concept of online controlled experiments is simple, there are many practical challenges in running OCEs (A/B test) at scale and encourage further academic and industrial exploration.
To understand the top practical challenges in running OCEs at scale, representatives with experience in large-scale experimentation from thirteen different organizations (Airbnb, Amazon, Booking.com, Facebook, Google, LinkedIn, Lyft, Microsoft, Netflix, Twitter, Uber, Yandex, and Stanford University) were invited to the first Practical Online Controlled Experiments Summit.
The learnings from the summit can be read in the the paper (first link below).
Also in this newsletter:
- Your analytics data isn’t real and it’s only getting worse
- How to build a data driven culture
- G Suite updates blog: three new features to format and work with data in Sheets
- The CRO Course: win on mobile
Have a nice week!