It's objectively slower when you need to leave the keyboard with one hand to reach your touchpad. I'm thinking about a desktop environment here where 1. you might not even have a touchpad and 2. you have your both hands on the keyboard.
I mean maybe if you're using vim all the time, but most of my apps require mouse interface, so my hand is usually near the trackpad. Even when I'm using external monitors I still use the laptop keyboard and trackpad.
