Let's say you have a corpus of text — 10 million words — about a specific topic.

1. What's the best way to "train a model" on that text?

2. Is that even the right term? Or is it using an existing foundational model and then augmenting it? Fine-tuning it? Something else?

What should the model do? would this be an instruction-based model (answer questions - similar to ChatGPT)?

Hi! My name is Daniel. I am building bountycaster.xyz

Ex Phantom, 0x Project engineer.

From Italy originally, currently live in NYC

Yeah ability to give you answers based on what is in the corpus but nothing else

There's a tool called PrivateGPT that does exactly this. It won't answer anything not based on the text provided.

There's a tool called PrivateGPT that does exactly this. It won't answer anything not based on the text provided. https://docs.privategpt.dev/overview/welcome/introduction