If necessary, you can even retroactively ban the competitor's app from the App Store that you control.

As pretext, you can say the competitor's app is doing something now considered insecure or not privacy-respecting, or is not compliant with some new user experience or quality curation that you do.