Content pfp
Content
@
0 reply
0 recast
0 reaction

Sanjay pfp
Sanjay
@sanjay
Our existing sync architecture for Hubs is running into scaling issues. Been thinking about a new design that can scale to billions of messages and millions of fids. If you enjoy complex distributed systems problems, I would appreciate feedback https://warpcast.notion.site/Sync-V2-a9c0fd81d7b245a0b3fbd51e6007909f
16 replies
15 recasts
92 reactions

jj 🛟 pfp
jj 🛟
@jj
Lastly super basic batching, compression, dedup might offer some serious roi in storage, latency, and performance
1 reply
0 recast
0 reaction

Sanjay pfp
Sanjay
@sanjay
All good points, we're already doing all of these. There's some more we can optimize, but it won't get us 10x perf improvements.
0 reply
0 recast
0 reaction