If you want to start with a single self-contained book, then a really good choice is "Modern Mathematical Physics" by Peter Szekeres:

https://www.cambridge.org/core/books/course-in-modern-mathem...

It covers most of the mathematics needed for quantum field theory (which is a big chunk of applied mathematics) starting right from set theory.