So there are two things to note. First is that it takes a long time for the seconds to add up, and second is that when we're looking into the deep future the current system of leap seconds won't be enough even if we do keep them.