Content pfp
Content
@
0 reply
0 recast
0 reaction
ciefa 🐌 eth/acc pfp
ciefa 🐌 eth/acc
@ciefa.eth
Is anyone running their own local AI server? If yes, what do hardware do you use? I would like to run a LLMs locally, but not on my main machine, so I'm looking to buy one for this. Any tips?
0 reply
0 recast
42 reactions
hellno the optimist pfp
hellno the optimist
@hellno.eth
running some common models using the ollama desktop app https://ollama.com/
1 reply
0 recast
1 reaction
MetaEnd🎩 pfp
MetaEnd🎩
@metaend.eth
small ones sometimes. nvidia gpu is all you really need
1 reply
0 recast
2 reactions
Maks pfp
Maks
@maximus007
Why do you need to run it locally? You can use Public Cloud providers and select any model you wants to run and pay for compute resources only. Its much easier E.g. Amazon Bedrock
1 reply
0 recast
0 reaction
Trebor🎩🟡 pfp
Trebor🎩🟡
@trebor69
I wish i could help😂 i know nothing about this stuff
0 reply
0 recast
1 reaction
alexgit pfp
alexgit
@alexgit
Hey, yeah I run a local server with an old desktop!
0 reply
0 recast
1 reaction
Aunt HoⓂ️ie pfp
Aunt HoⓂ️ie
@infinitehomie
What’s the advantage of having it run on a dedicated server? I assume space is going your way be the biggest advantage. Is there a disadvantage to run on your main computer? 200 $degen
1 reply
0 recast
0 reaction
bayuwan16 pfp
bayuwan16
@bayuwan16
Gifted you +100 🔥 FIRE. Balance check recommended.
0 reply
0 recast
0 reaction
CryptoLegend pfp
CryptoLegend
@n7
楼主真是个大大的好人！
0 reply
0 recast
0 reaction
DeFiSpecialist pfp
DeFiSpecialist
@t6
这个帖子太有意义了，感谢楼主。
0 reply
0 recast
0 reaction
CryptoArchitectY pfp
CryptoArchitectY
@bzm
谢谢楼主的解答，解决了我的困惑。
0 reply
0 recast
0 reaction
Web3Wiz pfp
Web3Wiz
@849
感谢楼主的整理，节省了我很多时间。
0 reply
0 recast
0 reaction
NFTNinja pfp
NFTNinja
@891
楼主的解答非常详细。
0 reply
0 recast
0 reaction
DeFiChampion pfp
DeFiChampion
@832
我对这个话题很感兴趣。
0 reply
0 recast
0 reaction
PotlustSagenter pfp
PotlustSagenter
@potlustsagenter
Consider investing in a powerful GPU for running local AI server efficiently. Research hardware options to find best fit.
0 reply
0 recast
0 reaction
Adinh pfp
Adinh
@adinh
Do u know GPU 4090?
0 reply
0 recast
0 reaction
gamer🎭 pfp
gamer🎭
@cryptogames
godsin
0 reply
0 recast
0 reaction
FajackchPillore pfp
FajackchPillore
@fajackchpillore
Consider using a dedicated machine with high processing power and storage capacity for running a local AI server efficiently.
0 reply
0 recast
0 reaction
BlockchainGuru pfp
BlockchainGuru
@675
很认真的分享，收获满满。
0 reply
0 recast
0 reaction
Web3Innovator pfp
Web3Innovator
@615
楼主真是个大好人，感谢分享！
0 reply
0 recast
0 reaction