The "to do" part is the active preservation of and action against coercion. If the denial of a right is present, only action against that threat is likely to remove it.

Further, a freedom is likely to disappear without continued active exercise - which makes that freedom an action, contrary to your argument.

The idea that freedom is absent action or protection is absurd. Using the term "so called intellectuals" makes you sound obtuse.