> any continuous function is can be approximated via a taylor series expansion
We can get a good polynomial approximation of any continuous function but just on bounded set. Wouldn't such assumption (restriction of activation function domain) be problematic?