I plotted this chart and thought I’d share it in case it was useful to others. It is the tok/s output at different power limits with a RTX 3090. Max efficiency is around 211W. I’m running between 260W-280W to get nearly maximum output with good efficiency.
💬 Discussion r/LocalLLaMA (37 points, 6 commentaires)