Indeed -- but it's worth noting out that GPU code is closely analogous to SIMD, anyway.

(And PyTorch can be and often is run on pure CPU.)