> You can get that much ddr5 today for like $400 Not comparable. M2 Ultra with 1...

kjkjadksj · on March 5, 2024

You can only get 2tb of storage max i believe, you are probably bottlenecked elsewhere if you are actually needing to move that much data that fast into memory in practice. I wonder what the temps would even be doing something that maxes that ram bandwidth

xcv123 · on March 5, 2024

> I wonder what the temps would even be doing something that maxes that ram bandwidth

The temps will be completely normal since that is normal operation. TDP is only 80 watts for M2 Ultra.

> You can only get 2tb of storage max i believe, you are probably bottlenecked elsewhere

No. Just no. This is not the issue. The models are loaded into GPU memory.