I have the exact opposite experience. As soon as I hit the trailhead my phone gets turned off and put in a waterproof bag. I almost never take it back out until the trip is over.
Though my wife keeps hers on hand for taking pictures so I guess I benefit from her phone being handy.
Can’t wait to play the 1.6 update as soon as I finish my BG3 campaign. It’s taking me forever though because I am a loot goblin.