View profile

An A/B test in slow motion 🐌 & 3 awesome vacancies 🧠

To peek or not to peek at your A/B tests.. πŸ‘€πŸ™ˆ If you are like me you've peaked at least everyday for
An A/B test in slow motion 🐌 & 3 awesome vacancies 🧠
By Gino Arendsz • Issue #103 • View online
To peek or not to peek at your A/B tests.. πŸ‘€πŸ™ˆ
If you are like me you’ve peaked at least everyday for your first five experiments ever. Checking out Google Optimize, shout when it’s over performing, cry when it’s underperforming. What you then probably also remembered from those days is the variety of results you got in the first few days and essentially every day.
If you’re going for a statistical significant result of 95% and higher it is key that you fix the sample size and running time up front and stop the test when it’s done. However if you test on a bayesian scale you do not have this problem.
What are you using? Bayesian or frequentist P-values?

See you next week!
Gino πŸ€™πŸ½

PS. Check out these three vacancies at the bottom. In case you apply, tell the world what newsletter brought them to you ;-).

Tools
Hacking Kindness: Optimization Tactics for Better Behavior
Reads
An A/B Test In Slow Motion: Before Your Experiment Becomes Significant
4 Reasons Why You Should Design Without Color First
Jooooooobs πŸŽ‰πŸ’ͺ🏽
Data Engineer / Data Scientist @ Helloprint πŸ“ˆ
Did you enjoy this issue?
Gino Arendsz

Every Thursday reads, talks and tools on growth marketing.

Tweet Β Β Β  Share
If you don't want these updates anymore, please unsubscribe here
If you were forwarded this newsletter and you like it, you can subscribe here
Powered by Revue