In addition, this kind of thinking will attrit some of those 5% of users, so repeated application will shrink their market share even further. it's the excel problem: a huge number of features will only be used by a minority of users, but a majority of users use at least one of those features.
Did you read my comment? If we had to remove one of two features and one of them was used by 5% of users and one of them was used by 95% of users wouldn't you like to know which one is which?
Without data you can invest your time into the wrong features.