Nar
@nar
Feel like this is super common for me 1. Oh look a shiny API 2. But it’s rate limited 3. Let me just write a script to periodically query the API and persist the data to a DB I can freely query from Is there a better pattern? Otherwise doing something like this for ERC-20 and NFT indexers this week
11 replies
0 recast
2 reactions
Jem
@jem
I effectively did this with Graph Protocol subgraphs. Its GraphQL API is slow, rate-limited and has paging limitations, which would prevent querying it for large amounts of data. So now we have a script that figures out the schema, pulls new data and persists to BigQuery. 🤓 Costs a few $/month.
1 reply
0 recast
0 reaction
Nar
@nar
Nice yeah we use something called Goldsky because Graph is too slow, indexing the indexer in-house is next level 🫡
1 reply
0 recast
1 reaction
Jem
@jem
If it was a priority, I’d probably look at re-architecting our subgraphs and potentially switching platforms… but it’s not a priority and the current solution works, so 🤷🏻♂️
0 reply
0 recast
0 reaction
