>We also got stuck with stopgap SIMD measures like SSE/AltiVec instead of a truly scalable multicore/multiprocessor MIMD architecture.

We did have the Xeon Phi until recently: https://en.wikipedia.org/wiki/Xeon_Phi

It was a lot of simple (derived from the original Pentium) x86 cores on the same die, as you want.