Charlie Marketplace
@charliemktplace
🧵 How to think about building AI models (LLM Edition) How do LLMs work? 🏭 How do you scope a custom LLM? 📃 What are the tradeoffs between popular Foundational Models? 💱 Is Context enough? 📓 When is tuning worth it? ✍
1 reply
0 recast
0 reaction
Charlie Marketplace
@charliemktplace
[Instructions] + [Context] + [System Prompt] -> [Tuning filter] ->[Foundation Model] Instruction: summarize the main points of this article Context: the article System Prompt: behavior, censorship, capabilities (e.g., web browsing) Tuning Filter: specialize a model Foundational Model: GPT 3.5; Claude; Gemini; Llama-2
1 reply
0 recast
0 reaction
Charlie Marketplace
@charliemktplace
How do you scope a custom LLM? 📃 Have a specific goal: search? summarize? generate? Understand the resource constraints: proof of concept vs horizontal model (mixture of experts) vs vertical model (master many domains). The more ambitious the goal, the more likely you need tuning.
1 reply
0 recast
0 reaction
