anyone have a connect to anthropic? or have an understanding of rate limits?

testing haiku live in prod instead of sonnet, lets see

nvm it sucks but maybe i'm good on sonnet again??

4o was not great, too verbose, tried using haiku for a bit but its' not good either, more errors

finetuning is rough - would def take time

imo sonnet is super overkill for this no? feels like something achievable with 4o-mini or even llama 3.1 405b (maybe you have to fine tune a bit)

I really like the speed of haiku. And the cost lol. For my purposes I didn’t even find that much of a difference! It’s so fast!