Content pfp
Content
@
0 reply
0 recast
2 reactions
Varun Srinivasan pfp
Varun Srinivasan
@v
Redis Streams seem pretty powerful. @sds is cooking up some plans to rewrite our background processor, using streams instead of Faktory (which we are outgrowing). anyone have positive/negative experience working with streams? https://redis.io/blog/youre-probably-thinking-about-redis-streams-wrong/
22 replies
16 recasts
487 reactions
Rafi pfp
Rafi
@rafi
Few years back I migrated sorted set-based lua-scripted job queue to streams. It worked really well. Level of abstraction of Streams API is just perfect to implement it without any third part library. Read groups makes it easy to scale and route tasks to horizontal worker clusters.
0 reply
0 recast
7 reactions
Ivy pfp
Ivy
@ivy
i am now bearish on farcaster given no one has made a don't cross the streams comment here
0 reply
0 recast
6 reactions
jj 🛟 pfp
jj 🛟
@jj
Nothing but positive things using redis streams in production and at high scale!
0 reply
0 recast
4 reactions
osama pfp
osama
@osama
@jkl has some streaming infra gods on his team
0 reply
0 recast
4 reactions
Vladyslav Dalechyn pfp
Vladyslav Dalechyn
@dalechyn.eth
BullMQ is based solely on redis subscriptions and it works really well.
0 reply
0 recast
2 reactions
Ertan Dogrultan pfp
Ertan Dogrultan
@ertan
have you looked into NATS (Jetstream)?
0 reply
0 recast
2 reactions
welter pfp
welter
@fun
nope sorry, first time hearing about it! looks useful
0 reply
0 recast
1 reaction
Chinmay 🕹️🍿 pfp
Chinmay 🕹️🍿
@chinmay.eth
@kijijij should have some.
0 reply
0 recast
0 reaction
Greg pfp
Greg
@greg
Don’t you guys already use Redis Streams in Shuttle? Seems to work well
1 reply
0 recast
0 reaction
Alex Loukissas 🍉 pfp
Alex Loukissas 🍉
@futureartist
I am also looking at this! Would love to join the discussion.
0 reply
0 recast
0 reaction
jtgi pfp
jtgi
@jtgi
@martinamps maybe?
0 reply
0 recast
0 reaction
downshift pfp
downshift
@downshift.eth
@rjs?
1 reply
0 recast
0 reaction
Kyle pfp
Kyle
@kalelabs.eth
We’ve seen much better performance using Dragonfly. Not as heavy as what I imaging you guys will be streaming but the performance improvement is pretty stark. https://github.com/dragonflydb/dragonfly
2 replies
0 recast
0 reaction
max 🧱 pfp
max 🧱
@sorto.eth
oh v nice
0 reply
0 recast
0 reaction
Payom Dousti pfp
Payom Dousti
@payomdousti
not sure if this has changed, but my issue with redis historically has been that it needs to scale vertically or be sharded. ime if you want queue semantics, just use a queue like rabbitmq or some other amqp server; there are lots of cloud hosted options if you don't want to manage it.
1 reply
0 recast
0 reaction
Zomboid Mocoa pfp
Zomboid Mocoa
@zombieofcrypto
Falling in love with Redis face ass! lol
0 reply
0 recast
0 reaction
Danny pfp
Danny
@ds
Looks nice. Supports most the killer features of Kafka. If your dataset fits in memory and you don’t need partitions for consumer groups, it’s probably much nicer to work with.
0 reply
0 recast
0 reaction
karan pfp
karan
@defikaran.eth
We're using redis sorted sets to power our background jobs infra at Wildcard, streams could be an interesting upgrade to it for sure.
0 reply
0 recast
0 reaction
CasterBites pfp
CasterBites
@casterbites
Great news! @trinh has curated your cast, and it's now featured among today's trending casts at https://casterbites.com/bites Remember, any Farcaster user can send and vote for the best casts of the day
0 reply
0 recast
0 reaction