I would be careful A/B testing at such a small scale. You are going to hit so much noise, it's not usually a great use of time. Just make it feel good and go from there.
You did the right thing. You need Google-scale traffic to tease out subtleties, fractional gains. But at your stage you were looking for big signals. And clearly you found them. Congrats!
This totally depends on the sample size and the impact that you'd like to measure. You can get very actionable results with a 95% confidence and 80% power at a few thousand sessions.
A/B testing works great at google scale.