Neynar

Celebrating the experimental launch of hubs.neynar.com

Since there's been a lot of curiosity about how three different scoring / labeling models compare, I pulled some data. Here's a contour plot of the Neynar Score, vs log of OpenRank score, color coded by Warpcast Label.

Building /neynar 🪐 and /sippp 🥤. Member of 🍊 DAO. Former CTO of $XMTR. Mom. Spirit animal is 🐼.

The main conclusion is that all three models are very different. The Neynar score and Warpcast labels correlate the most, especially on users with Neynar score above 0.8 (both models agree these are not spam).

Here's a scatterplot version. It's harder to see the overlap of the three categories because there are so many points covering up other points, but there's no smoothing or interpolation. This makes the spike in Neynar score at 0.5 more apparent. 

I think it looks like a whale holding a ski pole, lol.

The spike in Neynar score at 0.5 is because that is the default score for new accounts. Until there is sufficient activity in the account, the score stays at 0.5. The rationale is that, when an account has done very very little, we basically have no signal. These accounts also tend to have the lowest engagement scores.

Yes, there's a chart on this page: https://docs.neynar.com/docs/neynar-user-quality-score.

The "good score" cutoff depends on what you're using it for. If you only want to eliminate spam, without eliminating new users, you could set a cutoff below 0.5. If you want to filter to only established users with strong engagement, set the filter higher.

Pi-chi.eth (she/her) Artist /animeoutcasts
Purple Promoter| Hosting: /moxietools /kyoto /momiji  /anime-manga /farcasterunion

https://portrait.so/pichi

Do you have a distribution of Neynar scores? 

I don’t really know what’s a good score vs a bad one because I haven’t seen the full data set and how many people are in each bucket.