Content
@
0 reply
0 recast
0 reaction
Eric Platon
@ic
Recent Apple silicone with unified memory seems to have a strategic advantage over a traditional CPU/GPU pairing. E.g. M2 Ultra with 192Gb RAM which can be allocated to any activity like ML. And the M3 series is apparently just pushing on this track. Anyone with concrete feedback on all this?
2 replies
0 recast
1 reaction
Choong Ng
@choong
NVIDIA and Linux are the more travelled path, it will be much easier to get public research code etc working rather than having to in many cases port code that assumes NVIDIA hardware or directly depends on CUDA.
2 replies
0 recast
0 reaction
Choong Ng
@choong
I think the Apple hardware has some unique potential but you'll need a lot of the right workload to justify the engineering budget. I haven't seen benchmarks but I'd imagine vector databases and that sort of thing would perform really well.
0 reply
0 recast
1 reaction
Eric Platon
@ic
It really is so still today, close to 10 years after Tensorflow opening. There are many AI chip contenders (each with SDKs) and innovation (=new APIs), yet little surprising many need stability on the software side. On the other end Apple has now significant volumes (on the issue at hand). Strange attractor soon?
0 reply
0 recast
1 reaction
