I can count to ten in Japanese in my sleep because that's how we drilled when I was a child learning judo, but were you ask me to say "six" in Japanese, I'd have to start counting.

To learn a language, I think you really have to create a simulacrum of lived experience in that target language culture. Drilling morphology and vocabulary will never hurt, but it is not sufficient.