Artificial Intelligence (AI)

What are the best tools for running a scaleable cloud instance of Llama3 for text generation? 

It doesn't need to go into production, but I want to test something on a machine larger than my MBP. 

I've tried Replit (not supported) and AWS (way too complicated for such a simple task). 

Any obvious tools?

My company use vLLM with a rented GPU VM

I also have one of my friend hosting LLM as a service as well

Building /bright-moments - minting onchain art IRL | /purple #15 | FID 129 #magikarp

Rome, Metropolitan City of Rome Capital, Italy

My company use vLLM with a rented GPU VM

I also have one of my friend hosting LLM as a service as well https://float16.cloud