adrienne
@adrienne
Seeing Farcaster DAU chatter on my feed today and it's reminding me of the time I was put in charge of calculating user counts for a public b2b saas company. Active user counts were a big deal at the company. Founder and CEO talked about user counts a lot. Showed up in every slide deck, on our website home page.
11 replies
4 recasts
37 reactions
adrienne
@adrienne
The problem: it took 5 days to calculate. I was put in charge of business intelligence and my first task was to "automate user counts". CEO wanted a dashboard. But every earlier attempt led to "our data sucks" "we can't trust the dashboard"
1 reply
0 recast
4 reactions
adrienne
@adrienne
Easy peasy, I thought. My engineering mind thinking it would be as simple as "select * from users where status = active" Only after weeks of research did I realize why it was taking so long to calculate. No one had ever defined exactly what it meant to be an active user...
1 reply
0 recast
4 reactions
adrienne
@adrienne
Because we were reporting to Wall Street in our quarterly earnings report, we had to make sure we didn't include users from demo portals, test/QA clients, or clients that hadn't yet gone live. But we didn't track client status anywhere in a database; info was in various spreadsheets and in the COO's head.
1 reply
0 recast
3 reactions
adrienne
@adrienne
What about usage though? If a user never logged in, should they be counted as active? Well, since we charged by the seat, not by usage, it didn't matter whether the user logged in or not. Well, at least not to Wall Street. But what about to the UX and Product people?
1 reply
0 recast
4 reactions
adrienne
@adrienne
I came to realize something as simple as user counts means something very different to different audiences. Wall Street = user counts as proxy to paying customers UX/Product = actual users logging in and using the software DBA/CTO = all users to model future infrastructure needs and cost
1 reply
1 recast
11 reactions
adrienne
@adrienne
Depending on who you were, active user meant something different. And you only cared about your definition. You were too busy and myopic to even realize there were other definitions. Everyone called their definition "user counts", which is why no one trusted the data or a dashboard
1 reply
0 recast
5 reactions
adrienne
@adrienne
Ultimately we did solve this problem and created a dashboard for Active User Counts that people could trust, but the hard work was less engineering and data science, and more social and organizational - aligning people around a common language before looking at data
4 replies
0 recast
11 reactions