hey if you're wondering where the public data dump for April is, I need help figuring out the implications of my decisions with the Snapchain setup -- would love any ideas.

Short of it: Snapchain prefers a 24/7 running instance, can't afford to run a heavy box 24/7, stuck on filtering 90GB of data on 8GB of RAM

what’s this for? what is hugging face doing there?

it’s a full data dump of casts, likes, recasts, and follows — so anyone can do analysis on whatever they want

it’s a full data dump of casts, likes, recasts, and follows — so anyone can do analysis on whatever they want https://huggingface.co/datasets/jc4p/farcaster-casts