Before we can ask "is this consistent", we have to understand what consistency means. Basically, underneath axioms we have to have one more underpinning that is yet more immovable than axioms, and that is rationality. If someone has a problem with that, we tend not to engage them in debate. It may be that they thereby they remain unsatisfied, but that is their problem.