Matthew pfp
Matthew
@matthew
Can any devs help me find a solution for this? Building a game and when a user guesses word X, I want to see if it's sufficiently similar to word Y. could I deploy some kind of mini, local LLM inside my codebase for this? ideally don't want to wait / pay each time for an openai api call.
7 replies
15 recasts
23 reactions

dusan.framedl.eth pfp
dusan.framedl.eth
@ds8
llm is an overkill, i think embeddings are best for this. @nt built a fun game with word similarity as its premise — /guess — so i think he could give you poonters
1 reply
0 recast
1 reaction

Matthew pfp
Matthew
@matthew
it might be, but if i can just make one api call and move on idk if id call that overkill 😅
1 reply
0 recast
1 reaction

dusan.framedl.eth pfp
dusan.framedl.eth
@ds8
lol that's true 😂 pragmatism ftw
1 reply
0 recast
1 reaction

Matthew pfp
Matthew
@matthew
yeah my thought process is to get 100 people playing the game daily, not worry about costs (won't be more than $10-20 monthly), and then if I can do that go broader
0 reply
0 recast
1 reaction