In theory, yes. This is the case when you have small cores, which is why a lot of GPUs used VLIW.

But in practice the whole decoder stage is basically a rounding error because cores got so big.