> Understanding now hardware is used is very beneficial for programmers

I agree, but to say that all developers must know how AI benefits from GPUs is a different claim. One which is false. I would say most developers don't even understand how the CPU works, let alone modern CPU features like Data/Instruction Caching, SIMD instructions, and Branch prediction.

Most developers I encounter learned Javascript and make websites