woj on Warpcast

David Furlong pfp

Long time coming, but going to properly shut down discove.xyz Jan 1st; any remaining users, export your data/feed algo code that you want to keep. It costs too much to run & maintain, given nr of custom feeds it caches and given its hosted on vercel. Might relaunch at some point/could open source if enough interest

23 replies

15 recasts

53 reactions

timdaub pfp

what are the monthly costs?

1 reply

0 recast

0 reaction

David Furlong pfp

4 replies

1 recast

2 reactions

David Furlong pfp

/memes turns out a million slow requests (to cache feeds) a day is a lot

3 replies

0 recast

2 reactions

timdaub pfp

kiwi still 25€ a month

2 replies

0 recast

0 reaction

David Furlong pfp

yeah very different infra need lol

1 reply

0 recast

1 reaction

timdaub pfp

I also have global edge caching but for free with Cloudflare. I have everything a next js has

1 reply

0 recast

0 reaction

David Furlong pfp

lol thats a different kind of caching

1 reply

0 recast

0 reaction

timdaub pfp

1 reply

0 recast

0 reaction

David Furlong pfp

discove: - custom feeds can take up to 2 mins to run on SQL, can't let first user going to that feed in that time period get an uncached version, or they wait for 2 mins for the page to load. That's what just cloudflare edge cache would do - cache is stale (expires) in less than 5 mins (as chrono/algo social feeds are)

1 reply

0 recast

1 reaction

David Furlong pfp

=> discove caches to redis the first 3 pages of results for all custom feeds every 5 mins, hundreds of user created custom SQL feeds, some queries take 30s to 2 mins to run. Just a Cloudflare edge cache would result in a significant percentage of users having to wait the entire duration of the SQL exec to render page

2 replies

0 recast

1 reaction

woj pfp

damn bro just use neynar

3 replies

0 recast

0 reaction

David Furlong pfp

funnily enough now that the data is in dune very tempted to throw out my backend and let users write dune queries then give discove the dune query id and use the dune api

1 reply

0 recast

1 reaction

woj pfp

0 reply

0 recast

1 reaction