Once people start to realize that "liking" something is a fundamentally public act, this should be less of a problem. There's a huge difference between being a person "who likes Ashley Madison" (which I am not) and being a person "who has made a public declaration of liking Ashley Madison" (which I am also not).

Or, to be even more reductive: public declarations are public.