That depends on how you metabolise it, which can be very different. (genetic variation of neuro-receptors, liver, whatever) For most people about a week of abstinence would do, for me it needs two. Call it 'caffeeine fasting'.

Similar with nicotine btw.(especially sense of smell!)