Roberto Bayardo 🎩 pfp
Roberto Bayardo 🎩
@bayardo.eth
Most of my casts are replies. Which apparently means nobody sees most of my casts.
6 replies
1 recast
41 reactions
HH pfp
HH
@hamud
Sucks because it ruins threading
1 reply
0 recast
7 reactions
Roberto Bayardo 🎩 pfp
Roberto Bayardo 🎩
@bayardo.eth
And it dramatically reduces the quality of conversations. I think it's a major L for a smaller, up and coming social network like this one. Everyone here feels very "distant".
1 reply
1 recast
9 reactions
Roberto Bayardo 🎩 pfp
Roberto Bayardo 🎩
@bayardo.eth
Improving reply visibility is the type of change that would be very hard to measure via a short-term A/B experiment so I understand why it might be hard to motivate for a team staring at dashboards all day. It would require a bit of a leap of faith in absense of a more sophisticated experimental infrastructure for tracking longer term impacts on engagement.
2 replies
0 recast
7 reactions
kenny 🎩 pfp
kenny 🎩
@kenny
you don't need to A/B test because they made a hard change when they killed reply bumping so you can see in the public network data how it nuked conversations https://paragraph.com/@yesyes/checking-the-comment-velocity-of-real-users they've seen this data, and they don't care
1 reply
0 recast
3 reactions
Roberto Bayardo 🎩 pfp
Roberto Bayardo 🎩
@bayardo.eth
I suspect they are fixated on some measure of "new user churn" more than anything, given some of the decisions I've seen.
1 reply
0 recast
2 reactions
kenny 🎩 pfp
kenny 🎩
@kenny
same, which I think is a bad assumption on their end because the new user churn is downstream of there being good content on here keeping replies more visible ➡️ better conversations ➡️ power users posting more ➡️ better content for new users to consume north star should be diversity of people interacting with each other in the comments of popular posts which is exactly what @yesyes's analysis showed was reduced by removing reply bumping
1 reply
0 recast
2 reactions
Roberto Bayardo 🎩 pfp
Roberto Bayardo 🎩
@bayardo.eth
Right, it's about optimizing for the right metrics, not just optimizing what the last VC who gave you $$ told you was important. This isn't easy though. All metrics are but shallow proxies towards achieveing your ultimate goals. You need to also understand the mechanisms & causal factors in play.
1 reply
0 recast
2 reactions
kenny 🎩 pfp
kenny 🎩
@kenny
speaking my language I spent years in Google Analytics for websites and running A/B tests, I know they have a time and place but some things can't be tested and you have to go with your gut
1 reply
0 recast
1 reaction
Roberto Bayardo 🎩 pfp
Roberto Bayardo 🎩
@bayardo.eth
You can sometimes test whether some mechinism you feel is at play based on your "gut" is for real with enough work. Harder of course for sites like this where the usage might not be high enough to get statistically significant results for anything but the most coarse of treatments.
0 reply
0 recast
2 reactions