adrienne
@adrienne
Hearing tldr talk about building bracky on /gmfarcaster this morning gave me a major Epiphany about building my AI bot. Casting my notes so I don't forget later... I see 3 dimensions that together determine the quality and usefulness of gmfc101: - Capabilities - Personality - Conversation Capabilities are the different types of questions my bot can assist with. Each capability I add increases workflow complexity, with additional prompts, additional data sources as RAG etc. Example: At first it had just one capability - answer a user's question by searching thru all past transcripts. But it couldn't answer questions about the show in general (i.e. when was the first episode?) and it couldn't answer questions about specific shows (i.e. what were the highlights of the clanker epsiode?). Personality is how the bot answers. It's all prompt engineering. Conversation is the ability for the bot to go back and forth with someone in the replies and feel like a regular farcaster user. (1/4)
1 reply
2 recasts
6 reactions
adrienne
@adrienne
When I rolled out the first MVP a few months ago, I was quite happy with all 3 elements. My bot had a good enough personality, it was pretty adept at answering questions and linking to relevant past episodes, and it could go back and forth somewhat naturally. I then shifted focus to introducing new capabilities. I added a workflow router so the bot could answer questions about the show itself by searching through show metadata instead of show transcripts. It worked...but I started to notice its personality & ability to have natural conversations got a little worse. This week I started working on giving it a new capability to get the transcript of a specific show. I tested it locally and noticed that I'm even unhappier than before with its personality & chat ability. Which means that as I add capabilities the overall quality of the bot seems to be degrading. (2/4)
1 reply
0 recast
1 reaction
adrienne
@adrienne
I started to feel overwhelmed thinking about how much more work I need to do in dev environment before I can deploy this new capability. But then realized something this morning that got me unstuck: I can unwind the chat capability temporarily. Get the bot working on just its capabilities without worrying about personality & conversations. It reduces complexity while developing so I can focus on just getting good quality answers. People don't need to have a conversation with the bot at this time. It can be a single use bot. Ask it a question, it will answer. Then when satisfied, I can start to layer back in the other areas. I can iterate on the prompt to get its personality right. Then I can work on its memory and ability to have back and forth chat like a regular farcaster user. This might sound obvious or silly, but I was feeling overwhelmed until this clicked and now, I know the path forward and I'm excited to continue. (3/4)
1 reply
0 recast
1 reaction
adrienne
@adrienne
tldr (pun intended): Adding new capabilities to GMFC101 has been degrading its personality and conversational quality, but trying to fix everything at once is overwhelming. To move forward, I’ll temporarily set aside chat functionality to simplify the dev process—focusing first on solid answers, then layering personality and conversation back in later. (4/4)
0 reply
0 recast
0 reaction