Content
@
0 reply
0 recast
0 reaction
Stephan
@stephancill
what is the fastest way to get all the links for a list of fids assuming i have direct access to a hub (and potentially the rocks db)? - the hub rest api is slow and can only do a max pageSize of 1000, but is reliable - grpc is much faster (no page size limit) but starts falling over when you blast it with requests i'm considering trying to read directly from rocksdb at this stage any ideas?
3 replies
1 recast
19 reactions
Stephan
@stephancill
cc @sanjay @horsefacts.eth
1 reply
0 recast
0 reaction
Sanjay
@sanjay
If by fastest, you mean, least effort, you could probably export the data from dune? If you mean most performant, it would be opening the db in read only mode and iterating the link messages. Although, grpc should be good enough for most use cases.
1 reply
0 recast
0 reaction
