Sounds like M2-era onward have bfloat16: https://eclecticlight.co/2024/01/13/how... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		thadk 10 months ago \| parent \| context \| favorite \| on: Run LLMs on Apple Neural Engine (ANE) Sounds like M2-era onward have bfloat16: https://eclecticlight.co/2024/01/13/how-m1-macs-may-lag-behi...

anemll 10 months ago [–]

Yes for GPU, however ANE only supports FP16 plus integers. M4/A17 added accelerated int8 that is twice faster than FP16

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact