tell me you have never done gpgpu prog, distributed training or anything w/ infiniband without telling me you haven't .. what are these people talking about? what is this black magic that defy's physics? I wanna seeee ... halp

tell me you have never done gpgpu prog, distributed training or anything w/ infiniband without telling me you haven't .. what are these people talking about? what is this black magic that defy's physics? I wanna seeee ... halp

https://x.com/_jamico/status/1811092929420873798

fwiw, I am not shitting on them but all attempts to talk at a technical level go unanswered. all these guys feel like what skrelli exposed with io... fwiw many quote https://vast.ai/.. it is a distributed not decentralized system. also they/vast don't claim to build a cluster on geographically spread compute as a single cluster to train/fine-tune large (or any!) models

back to my bunker to figure sweet `CONFIG_CPU_FREQ_DEFAULT_GOV_PERFORMANCE`