Presumably simply because there isn't as much density. The interstellar medium particles must be less dense but more energetic, thus producing the pressure that causes the heliosphere to be restricted.

As I understand it, the much smaller number of particles hitting Voyager now are the interstellar medium. The rate of particles hitting Voyager is not a measure of the pressure of the ambient plasma.