Content pfp
Content
@
0 reply
0 recast
0 reaction

Avi đź’™ pfp
Avi đź’™
@savvyavi
A question for those of you who know the OpenAI playground. When on complete mode, what does “\n” mean (image below) and also what does “Total: -0.89 ….” And the rest below that mean? I’m a non techie who needs to understand…
2 replies
0 recast
0 reaction

gcmac.eth pfp
gcmac.eth
@gcmac
The log probability bit is just about how the output is natively represented. For math reasons (differentiable loss functions) the model outputs the log of the probabilities. You can reverse this by taking e ^ (-0.89) ~= 41.27%
1 reply
0 recast
1 reaction

Avi đź’™ pfp
Avi đź’™
@savvyavi
I’m asking because I’m writing a short post about how LLMs work and want to explain the probabilities which makes sense for the words displayed but don’t obviously add up to a 100 even if one bucket is “all other possibilities” which I don’t see. Why does next line have a probability?
1 reply
0 recast
0 reaction

gcmac.eth pfp
gcmac.eth
@gcmac
Sorry, I want to be helpful but I don’t fully understand the question. To get to 100% you’d need to show the probabilities for every token (of which there are over 50k). I think they are just showing the logit of the top probability in case that’s how someone wants to see the data represented.
1 reply
0 recast
1 reaction