You're right! When talking about function approximation most theorems work on compact sets only (for most purposes that's a good enough hypothesis).