USAID is not just charity. It is a projection of soft power that keeps many countries and world citizens looking up to the USA. It reduces likelihood of terrorist attacks on US citizens.
Among people likely to consider a terrorist attack, USAID is widely considered a front for the CIA to meddle in other countries' governments (and this has been proven to be the case in some instances). Which, if true, makes it a bad front for the CIA, and if false, means it creates more resentment than anything else and does little to reduce the likelihood of terrorist attacks.