I think there's your answer. I've had similar questions myself sometimes when hunting, particularly sitting alone, cold, on a whitetail stand. If it isn't fun and you'd rather be doing something else with your time, go do that. No guilt. As you know we only have so much time to be here, and nobody is promised tomorrow.My wife asked me last night, after hearing me recount the trip to multiple people over the last two days, if I had fun. It wasn't a quick answer...When you pile all that on the scale of life. It doesn't tip to positive.
I enjoy all the trip planning, prep work etc. because it connects me to family and friends before and during the hunt. The mountains motivate me to get in shape, I'm learning new skills for backpacking, camping etc. But that might change and then I'll know it's time to shift to other priorities. Bird hunting with my dog is a likely option, it's fun, feels rewarding, comparatively easy and I can include my young kids more easily.
We've all lost animals before, and it definitely sucks. Stepping back to a larger view of nature, like others have said, is likely to absolve you of guilt, eventually. Feels really bad in the moment though, I know it too well.
Here's to better hunting/fishing/camping trips ahead, and good times for you and yours.