Recent Apple silicone with unified memory seems to have a strategic advantage over a traditional CPU/GPU pairing.

E.g. M2 Ultra with 192Gb RAM which can be allocated to any activity like ML. And the M3 series is apparently just pushing on this track.

Anyone with concrete feedback on all this?

Scientist and engineer interested in Life.

Work on (GOF)AI, Agriculture, Biology, Energy, Robotics, Space---all topics climate-aware.

NVIDIA and Linux are the more travelled path, it will be much easier to get public research code etc working rather than having to in many cases port code that assumes NVIDIA hardware or directly depends on CUDA.

I think the Apple hardware has some unique potential but you'll need a lot of the right workload to justify the engineering budget. I haven't seen benchmarks but I'd imagine vector databases and that sort of thing would perform really well.