The fediverse is not designed to scale to single-user instances. If it was designed for the in the first place then yes, this wouldn't be a problem.