Even several separate A/B-experiments on the same population on the same page at the same time could be a good thing to do.
Overlapping experiments, in the end, will lead to more noise which leads to a lower ROI. It could be that one experiment is making you money, but the other one at the same time is lowering the impact of that winning one so it leads to a less big uplift or even a non-significant result. But in the end: would you rather run a 100 experiments program in 6 months with a 25% win percentage or a 200 experiments program with a 23% win percentage?
What else in this week newsletter?
- The paradox of choice: do more options really tank conversions?
- Google Optimize supports synchronous installs
- 3 steps to personalization
- Podcast: interview with Stephan Tomke about his book: Experimentation Works
- Webinars about Growth Marketing & Ask me anything with David Arnoux
See you next week!