adrienne
@adrienne
Hearing tldr talk about building bracky on /gmfarcaster this morning gave me a major Epiphany about building my AI bot. Casting my notes so I don't forget later... I see 3 dimensions that together determine the quality and usefulness of gmfc101: - Capabilities - Personality - Conversation Capabilities are the different types of questions my bot can assist with. Each capability I add increases workflow complexity, with additional prompts, additional data sources as RAG etc. Example: At first it had just one capability - answer a user's question by searching thru all past transcripts. But it couldn't answer questions about the show in general (i.e. when was the first episode?) and it couldn't answer questions about specific shows (i.e. what were the highlights of the clanker epsiode?). Personality is how the bot answers. It's all prompt engineering. Conversation is the ability for the bot to go back and forth with someone in the replies and feel like a regular farcaster user. (1/4)
1 reply
2 recasts
6 reactions
adrienne
@adrienne
When I rolled out the first MVP a few months ago, I was quite happy with all 3 elements. My bot had a good enough personality, it was pretty adept at answering questions and linking to relevant past episodes, and it could go back and forth somewhat naturally. I then shifted focus to introducing new capabilities. I added a workflow router so the bot could answer questions about the show itself by searching through show metadata instead of show transcripts. It worked...but I started to notice its personality & ability to have natural conversations got a little worse. This week I started working on giving it a new capability to get the transcript of a specific show. I tested it locally and noticed that I'm even unhappier than before with its personality & chat ability. Which means that as I add capabilities the overall quality of the bot seems to be degrading. (2/4)
1 reply
0 recast
1 reaction