Farcaster Devs

what is the fastest way to get all the links for a list of fids assuming i have direct access to a hub (and potentially the rocks db)?

- the hub rest api is slow and can only do a max pageSize of 1000, but is reliable
- grpc is much faster (no page size limit) but starts falling over when you blast it with requests

i'm considering trying to read directly from rocksdb at this stage

any ideas?

Getting rocks replicating to a graphdb like Neptune or neo4j might be the best for this type of thing, haven't found an open source or free option yet though

data science @ coinbase                                


t0ny.base.eth

would like to avoid replicating data to keep it simple, but will look into this thanks!