Kasra Rahjerdi pfp
Kasra Rahjerdi
@jc4p
fam in ~18 hours we'll have 157 million casts with embeddings, pray for me it doesn't crash overnight
9 replies
11 recasts
87 reactions
@
0 reply
0 recast
0 reaction
@
0 reply
0 recast
0 reaction
Kasra Rahjerdi pfp
Kasra Rahjerdi
@jc4p
love it, thank you! i’m planning on doing monthly ingestion of casts + monthly embeddings of those so hopefullyyyy this will be easier after i finish this giant backfill
0 reply
0 recast
0 reaction
@
0 reply
0 recast
0 reaction
Kasra Rahjerdi pfp
Kasra Rahjerdi
@jc4p
silly me i thought the hard part would be writing a super optimized gRPC client 😂🙈
0 reply
0 recast
0 reaction
@
0 reply
0 recast
0 reaction
Kasra Rahjerdi pfp
Kasra Rahjerdi
@jc4p
how are you actually pulling the casts? i do a cloud hub + .net multiprocessing + multiplexed connections
0 reply
0 recast
0 reaction
@
0 reply
0 recast
0 reaction
Kasra Rahjerdi pfp
Kasra Rahjerdi
@jc4p
love that! i tried doing hubble from the hub-monorepo but it was so slow i wanted to die haha, i kind of REFUSE to pay for open data though otherwise id use neynar too (granted i use their api for a ton of frames)
1 reply
0 recast
0 reaction
Kasra Rahjerdi pfp
Kasra Rahjerdi
@jc4p
why haven’t you uploaded your datasets to HF!!!!
0 reply
0 recast
0 reaction
@
0 reply
0 recast
0 reaction
Kasra Rahjerdi pfp
Kasra Rahjerdi
@jc4p
anything would be fun :) i’m realizing a ton of people could use this data and asking for neynar access isn’t always doable (whole reason i wrote https://github.com/jc4p/fast-hub-client is bc they didn’t give me access when i asked)
1 reply
0 recast
0 reaction
rish pfp
rish
@rish
You’re saying you asked access to something and we said no?
0 reply
0 recast
0 reaction