Content pfp
Content
@
0 reply
0 recast
0 reaction

Avi đź’™ pfp
Avi đź’™
@savvyavi
A question for those of you who know the OpenAI playground. When on complete mode, what does “\n” mean (image below) and also what does “Total: -0.89 ….” And the rest below that mean? I’m a non techie who needs to understand…
2 replies
0 recast
0 reaction

gcmac.eth pfp
gcmac.eth
@gcmac
The log probability bit is just about how the output is natively represented. For math reasons (differentiable loss functions) the model outputs the log of the probabilities. You can reverse this by taking e ^ (-0.89) ~= 41.27%
1 reply
0 recast
1 reaction

Avi đź’™ pfp
Avi đź’™
@savvyavi
I’m asking because I’m writing a short post about how LLMs work and want to explain the probabilities which makes sense for the words displayed but don’t obviously add up to a 100 even if one bucket is “all other possibilities” which I don’t see. Why does next line have a probability?
1 reply
0 recast
0 reaction