Speaking of AWS, I recently deployed a gatsby web site with AWS Amplify. It links to your git repo and will automatically deploy when you merge to master/main. You can also deploy branches you want to test out. As this was my second website I have ever deployed, I was amazed at how easy it was to setup.
Yep - we recently launched a couple of react sites on amplify and have found it super easy for our team to adopt. Hooked up to gitlab in a few seconds, added custom domain easily (automatically updated route53 for us), each PR gets its own deployment behind a password for testing, and develop and master are updated automatically on merge.