A place for developers to talk about building on Farcaster.

/dev

the older i get, the more sure i am that almost every backend engineering problem can be boiled down to using Kafka, Postgres, and Redis

lol i'm always intrigued by all the other streaming data pipeline projects like beam and nifi and whatever but they always sound so similar to kafka to me

@operator & /operator | BCI, bioinformatics, search, chaos, decentralized AI

Kafka has a data limit to be fast/scalable, so we put Beam downstream of it to pull from storage buckets