fam in ~18 hours we'll have 157 million casts with embeddings, pray for me it doesn't crash overnight

i dabble with ai using open data from crypto https://alexpaden.tech

love it, thank you! i’m planning on doing monthly ingestion of casts + monthly embeddings of those so hopefullyyyy this will be easier after i finish this giant backfill

silly me i thought the hard part would be writing a super optimized gRPC client 😂🙈

how are you actually pulling the casts? i do a cloud hub + .net multiprocessing + multiplexed connections