aichannel

Switching between models seems easy nowadays - tons of cloud services with open models, and almost every SDK is openai compatible.  

But what surprised me is how the same prompts can work completely wrong on different models. Need a tool that auto fine-tunes prompts for each model

@reachbot - experimenting with AI & Frames | Custom Keyword Alerts in TG t.me/CastAlertsBot | Human-readable EVM data https://github.com/3loop/loop-decoder

Are you swapping directly from the models serving the APIs or the SDKs?

Sometimes the SDKs or third party services have system and user prompts in between to get some behavior that you gain or lose.

🗽based; 

building skeet.build 🟠;
building @buoy 🛟; 
building check.supply 🏦;

Yea if you’re using the api then you’re also setting the system prompt 

Interesting idea though - maybe these companies don’t want you to switch and so they do this…

I'm trying out model swapping with an api provider (Groq), gotta test that! So far, it feels like you need to create different prompts and tweak them for each model