you can already run llms on iphone locally https://llm.mlc.ai/

I find it very difficult to believe that Apple is going to incorporate AI hardware into their device and then open it up to everyone freely. That would be very off brand. Even in the browser space Apple famously forced all competing browsers to use Apple Webkit as their engine. They certainly have history around lockdown and lock-in.

The CoreML APIs let you make use of the neural engine that’s built in.

It doesn’t benefit Apple to restrict access to silicon.

https://developer.apple.com/documentation/coreml

> I find it very difficult to believe that Apple is going to incorporate AI hardware into their device and then open it up to everyone freely.

The Core ML API for using the neural processing features of Apple's chips has been in there for a while and plenty of developers are using it.

They don’t have to open it up freely. They could choose to add an API with a chat completion type of interface, whisper-like, etc.

Nothing would need to change in the existing terms and conditions with developers: we only accept binaries that use our official APIs.