Only if you don't count the time waiting in line before it's your turn. Consider this analogy: you have a single-threaded task that takes 30 seconds to complete on CPU X, which has 4 cores, or 1 minute to complete on CPU Y, which has 24 cores. If your task is the only one running, then CPU X will finish it faster, but if there are 20 other tasks that also need to run, then CPU Y will finish yours faster.
Only if you don't count the time waiting in line before it's your turn. Consider this analogy: you have a single-threaded task that takes 30 seconds to complete on CPU X, which has 4 cores, or 1 minute to complete on CPU Y, which has 24 cores. If your task is the only one running, then CPU X will finish it faster, but if there are 20 other tasks that also need to run, then CPU Y will finish yours faster.