Artificial Intelligence (AI)

What are the best tools for running a scaleable cloud instance of Llama3 for text generation? 

It doesn't need to go into production, but I want to test something on a machine larger than my MBP. 

I've tried Replit (not supported) and AWS (way too complicated for such a simple task). 

Any obvious tools?

Have you tried Modal?

I've found it very easy to use and the team extremely responsive.

Building /bright-moments - minting onchain art IRL | /purple #15 | FID 129 #magikarp

Rome, Metropolitan City of Rome Capital, Italy

Have you tried Modal?

I've found it very easy to use and the team extremely responsive.

https://modal.com/docs/examples/text_generation_inference