Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
sgt
51 days ago
|
parent
|
context
|
favorite
| on:
Apple M3 Ultra
So the M3 Ultra is amazing value then. And from what I could tell, an equivalent AMD Epyc would still be so constrained that we're talking 4-5 tokens/s. Is this a fair assumption?
adgjlsfhk1
51 days ago
|
next
[β]
No. The advantage of Epic is you get 12 channels of ram so it should be ~6x faster than a consumer cpu.
sgt
50 days ago
|
parent
|
next
[β]
I realize that but apparently people are still getting very low tokens/sec on Epyc. Why is that? I don't get it, as on paper it should be fast.
Aeolun
51 days ago
|
prev
[β]
The Epyc would only set you back $2000 though, so itβs only a slightly worse price/return.
Join us for
AI Startup School
this June 16-17 in San Francisco!
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
