Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

The BF16 and VNNI instructions are finally going to make AMD competitive for neural network inference.



Competitive with what? GPUs? Only for networks that fit in a cache and even then only in latency not in throughput. Still valuable but not competitive in the majority of use cases.




Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: