I got my teeth whitened and I was forbidden to drink coffee for a week or so. I thought the same that coffee was just a ritual for me, but apparently I got really weird (moody, annoyed easily) when going cold turkey, so I had to go to the pharmacy and buy caffeine tablets :) That settled it for me, that coffee does have and effect on me despite not feeling these "jittery effects" as well.