I believe the situation here is more a matter of they don’t have a dispatcher to guide them.
In some rural area of Africa they came across a car crash. Two people hop out and assist while a third drives off to notify someone to send emergency help.
An on device LLM might be very useful there depending on what it says…
Emergencies can freak people out but not once in my eight years in rescue have I ever encountered a scenario where a random bystander might do as drastic of an intervention as as a tracheotomy.
I have shown up at scenes where people have googled what to do though and, you know what, it was super helpful.
If someone is dumb enough to perform a tracheotomy because an llm, google, or a passerby told them to. The issue isn’t any of those factors. That person is just so incredibly dumb as to be a danger to everyone around them.
I've been a firefighter for 22 years. I'm sure neither of us will ever cease to be amazed at what otherwise intelligent people will do when they're in a panic.
People also do amazingly dumb things because a piece of software with a tone of authority told them to do it, even when they're not under duress. Look at the number of people who find themselves stranded or dead because they uncritically followed the directions of a navigation app, and who weren't in a panic state when they did it.
In some rural area of Africa they came across a car crash. Two people hop out and assist while a third drives off to notify someone to send emergency help.
An on device LLM might be very useful there depending on what it says…