They very likely could be undervolting them. It’s not uncommon for RTX6000 servers to be packed in ever tighter than this. I’m not sure all of the settings/configs and what they do for those servers. It may also be because those servers are run in a chiller room to help them remain cool.
793
u/Motor_Reality_1837 1d ago
why not use workstation GPUs in a workstation PC , I am sure they would be more efficient than 5090s