Automatic emergency braking would be a good first step, it would certainly solve the case in article where the car drives though downed power lines.
I think the logical next step is to have the LLM output the driving path similar to how GPT4 outputs SVGs. Feed in everything you have, raw images, depth maps, VRU positions, nav cues, and ask the LLM output a path.
I think the logical next step is to have the LLM output the driving path similar to how GPT4 outputs SVGs. Feed in everything you have, raw images, depth maps, VRU positions, nav cues, and ask the LLM output a path.