Content
@
0 reply
0 recast
0 reaction
Sanjay
@sanjay
Our existing sync architecture for Hubs is running into scaling issues. Been thinking about a new design that can scale to billions of messages and millions of fids. If you enjoy complex distributed systems problems, I would appreciate feedback https://warpcast.notion.site/Sync-V2-a9c0fd81d7b245a0b3fbd51e6007909f
16 replies
15 recasts
92 reactions
xh3b4sd ↑
@xh3b4sd.eth
Not knowing anything about hubs, try to * write data the way you want to read it * use hash rings for data locations * vertically scale for separate concerns * prioritize what's more important * checkpoint progress of processes * reduce complexity of data models * stream data chunks instead of polling Happy to chat!
0 reply
0 recast
0 reaction
