Content
@
0 reply
0 recast
0 reaction
Leo
@lsn
Has anyone been doing large scale thematic analysis of free text using LLMs? I'm about to start doing this at my startup and wondered if anyone had ideas about best practice and prompting Please recast to other relevant channels! 🙏
4 replies
2 recasts
11 reactions
manansh
@manansh
I have! Tried it for work. heymarvin and a bunch of startups are trying to make this good. can share all of them if you want. just using Claude/OAI has mixed results, it kinda just makes stuff up that sounds “right”, but it struggles working with nuance unless you prompt it properly. 3 things impact quality, SCOPE, SPECIFICITY, and CONTEXT You want very tight scope and specificity with a lot of context. That might mean asking the LLM to code and create categories line by line.
1 reply
0 recast
1 reaction
Leo
@lsn
Thanks I’ll write the code and maybe even pick the categories I’m mainly interested in the prompt architecture
0 reply
0 recast
1 reaction