Tiago
@alvesjtiago.eth
gm putting together a FC infrastructure plan: - Efficient indexer (until hubs?) - Kafka pipeline (for bulk & sequential production / consumption) - DB for scale (time series?) - Graph DB - Webhooks for event subscription - API for data, graph & metrics what am I missing?
3 replies
0 recast
0 reaction
carlosdp.eth
@carlosdp
You’re planning to bring a battleship to an RC sailboat competition hehe No need for Kafka and all that. Simple polling and a simple Postgres DB or something will last for a looooong time.
1 reply
0 recast
0 reaction
carlosdp.eth
@carlosdp
Don’t optimize for scale before there’s any sign of scale. Far better to have scale and not be ready for it than to be distracted getting ready for scale that never comes. Remember that Twitter fail whales was its identity for years and they’re still Twitter today
1 reply
0 recast
0 reaction
Tiago
@alvesjtiago.eth
that's a very good point @carlosdp. this is just a proposal for the long run as today indexers cannot provide this type of information. i agree with starting with something much simpler but it's important to know what the grand plan would be.
0 reply
0 recast
0 reaction