Depends on what’s in your asserts. If, for example, you check validity of your custom data structure in an assert, even a single assert can cost a lot to more than nothing.

(Whether you should use assert for that kind of checks that probably only should run in tests is debatable, but it sometimes happens)