You're absolutely spot on. The reality is that candidates ending interviews prematurely is incredibly rare. If it happens then something has failed within your interview process. The only way you will know this is if the candidate clearly explains his reasoning for ending prematurely.