waypoint

Boys only want one thing and it's to watch every single available thread on their laptop be used for their worker/queue system written in Rust experience zero memory leaks and negligible CPU usage while it backfills from multiple Farcaster hubs.

Even perfect Rust code can’t make hub backfill fast

Based House. Engineering @neynar. Amusement, wonder, and uncertainty ✴︎ libred.org

Reason for Rust was so it could share all these resources on the same cluster/node/machine.

But I am running an army of workers against the queue using 700 connections (max allowed for CloudSQL without blowing all our budget).

Will report back how long it takes. 🫡