You can opt out of allowing use of the electoral role for marketing - you can't opt out of political use.

You can also not be on the role but you cant vote in that case.