By and large yes: T-SNE does it's best to achieve that - it's kind of tricky to take an N-dimensional space and flattening it to 2 dimensions. You inevitably get some tearing and some scatter.

So they're not always next to each other, but oftentimes.