TLDR: you can have a mathematics that always gives true answers (but that cannot answer everything). Or you can have a mathematics that can answer every possible question (but some answers are wrong, you do not know which). Choose.
This dispaired mathematicians of the early 20th century, who had hoped to create 'one mathematics to rule them all'. Of course you can have several disjunct mathematics, each one for the problem you like.
TLDR: you can have a mathematics that always gives true answers (but that cannot answer everything). Or you can have a mathematics that can answer every possible question (but some answers are wrong, you do not know which). Choose.
This dispaired mathematicians of the early 20th century, who had hoped to create 'one mathematics to rule them all'. Of course you can have several disjunct mathematics, each one for the problem you like.