Content
@
0 reply
0 recast
0 reaction
Sanjay
@sanjay
Our existing sync architecture for Hubs is running into scaling issues. Been thinking about a new design that can scale to billions of messages and millions of fids. If you enjoy complex distributed systems problems, I would appreciate feedback https://warpcast.notion.site/Sync-V2-a9c0fd81d7b245a0b3fbd51e6007909f
16 replies
15 recasts
92 reactions
Manan
@manan
I couldn't comment on the notion. >The hubs will only hold the last 14 days worth of data in the trie, data beyond that will be pruned daily. Does this mean that any gossip holes not filled within 14 days will be left open until a catchup sync finds it is lagging by more than 10% of the messages?
1 reply
0 recast
0 reaction
Sanjay
@sanjay
Try logging in? If it was not caught within 14 days (extemely unlikely, except due to a bug or something), it should be caught the next time the fid takes an action since we’ll compare the root hashes for the fid again at that point for 14 more days.
0 reply
0 recast
2 reactions
