Check out https://parceljs.org/.

It's how I start every project. I can always move to Webpack if I need more customization and complexity.

I was thinking about more integrated solutions like Next.js or Expo.

For smaller projects I agree. For larger projects, it's worth spending an hour or two on a custom Webpack config tuned to the project's needs IMO. In most cases it doesn't even take nearly that long.