Founders

Do any founders have a good method of applying A/B testing when doing feature iteration?

How do you split your test groups and collect feedback? Do you always test with people directly, or is there a smart way to implement it into the normal user experience?

Internet Stan | nickbrodeur.com |  jellybeans.wtf wannabet.cc

a/b testing is harmful sub scale

talk to customers

build, lift, & coffee | ENS Steward | namestone.com | slobo.xyz

I could see over-analysis being a waste.

But surely a/b testing provides better info on actual user preferences than their direct feedback, right?

Actually lmk if I’m on track with your thought process:

Decisions related to overall features can be better gathered from talking to customers, where specific UI decisions could be better decided from an empirical test. 

When doing product iteration, the features have a higher priority

for context i used to manage an 8 figure paid search budget at that scale a/b testing makes sense, but still super easy to fuck it up

you need thousands, if not 10s of thousands of visits per variation to get comfort in what's right 

you're not getting those numbers early