Content
@
0 reply
0 recast
2 reactions
Varun Srinivasan
@v
Redis Streams seem pretty powerful. @sds is cooking up some plans to rewrite our background processor, using streams instead of Faktory (which we are outgrowing). anyone have positive/negative experience working with streams? https://redis.io/blog/youre-probably-thinking-about-redis-streams-wrong/
22 replies
16 recasts
484 reactions
downshift
@downshift.eth
@rjs?
1 reply
0 recast
0 reaction
Ryan J. Shaw
@rjs
Nah never used it... It would be awesome if hubs reliably pushed message data to Kafka, though. Then you don't need any extra work to get real-time and historical data processing using the same model (and you can configure Kafka retention on the topics to drop data older than what you care about to save storage)
1 reply
0 recast
0 reaction
downshift
@downshift.eth
@samuellhuber.eth have you seen anyone do something like this yet?
1 reply
0 recast
0 reaction
Samuel
@samuellhuber.eth
Well the Hubs themselves no, but shuttle can be configured any way you want and a simple read the gRPC and push to Kafka means writing one script that does it So not out of this world to spin that up Just means your infra has to already have Kafka and the need for it 🤓 Shuttle currently uses Redis Event Stream iirc
0 reply
0 recast
3 reactions
