PyTorch has a bunch of backends including CUDA, ROCm, OneAPI, etc.

i understand. but which backend is intel committing to ? not CUDA for sure. or have they created a new backend

Intel makes oneAPI. They have corresponding toolkits to cuDNN like oneMKL, oneDNN, etc.

However the Gaudi chips are built on top of SynapseAI, another API from before the Habana acquisition. I don’t know if there’s a plan to support oneAPI on Gaudi, but it doesn’t look like it at the moment.