That seems extraordinarily poor battery performance. FWIW, I often go on hikes that take a similar 4-6h time. Granted, I get to charge it on the drive over so I usually start the hike with 100%.

We'll use my phone to take photos and videos on the hike. Never ran into battery issues. And it's Canada, so hikes are in cold-ish temperatures.