Matt Galligan
@mg
Anyone out there that's got some expertise in doing AI prompt evaluation? 🤞🏼 I've been experimenting with a new prompting technique that's showing promising results, but really want to put its through its paces.
9 replies
8 recasts
40 reactions
mark mollé
@marmo
yes ! do you mean quantitative or qualitative evaluation?
1 reply
0 recast
0 reaction
Matt Galligan
@mg
Both! Qualitatively the thing is doing well. But I want to test it with harder instructions and measure quantitatively.
1 reply
0 recast
0 reaction
mark mollé
@marmo
cool, so it’s a new structure for prompting that’s agnostic to substance.
0 reply
0 recast
0 reaction
