This is extremely useful and seems like what I need to fix all of my structured output woes, when my model gets chatty for no reason.

The issue poorly glosses over explaining what feature they are talking about, here's a link to the docs about it: https://github.com/ggerganov/llama.cpp/blob/master/grammars/...

Perhaps we could just call these ALLMs (Adversarial Large Language Models). You’re already dropping the N in GAN, I see no need for the G.

As an end result I think someone clever could make a LLaMA pun for the name of a LLaMA based ALLM.

Isn’t working on iOS 17.4, iPhone 14. Both in Safari and the App Store download.

Edit: yes I’d pay $2 to play with this. lol

You need to take your phone off silent.

Well, this fixed it. I bet there is a lot of confusion for the people reporting it just works, while their phone is on silent. Seems to work on silent if you have headphones on.

Interesting. I actually like this behavior and wish more applications would use it!

Having thought about it, it makes sense for the web browser. Though I think the app should do something to bypass it, but I realize it is probably just a browser embed.

I peeked at the source code and it’s pretty wild to see this is what JavaScript can do these day.

Yeah I thought it was broken on iOS too, then flipped the silent switch and it worked.

Works for me on iOS 17.4.1, iPhone 15 Pro.

Definitely getting it for my kids!