Interestingly, as someone else afflicted with red-green colourblindness I didn't really struggle that much with the colourblind assist off.

I think it is because when the colours are displayed exactly side by side it isn't nearly as difficult to match them up than it would be for you to ask me to pick out that same colour from a pallet of similar colours.