The thing is the primary harm comes not from the drugs but from the illegal market and from the controls that are put in place. This is especially true of the drugs that are both therapeutic and recreational.