charlieforbvtwo
@charlieforbvtwo
Want to run a large language model locally, but only have a thin and light laptop with integrated graphics? Koboldcpp comes to the rescue through Vulkan. It has been tested that a low-voltage 5600U laptop from many years ago can run #DeepSeekR1 7B distilled version, both for offline translation and literature summarization. Why not give it a try?
0 reply
0 recast
0 reaction