I've had a full thickness tear on both shoulders at different times. I know what rotator cuff surgery is about (times two)! It never heals!
Opinions are like .... well everybody has one. My experience is that I would rather carry a light rifle and have more recoil, than have to carry a heavy rifle that I may not fire. Recoil isn't a problem when firing at game, just at the bench (thus I pad my shoulder at the bench).
Carrying any rifle all day is tiring. The lighter it is the better - especially if you do not get a shot. I'd opt for something uner 8 lbs (rifle and scope) with enough umph to take the game you are hunting. One shot in the field will not ruin your day, but a heavy rifle carried all day long certainly will.
Tried it both ways. Shedded my 7 mag, then went to a 300 WSM. It is heavy also. Stepped down to a lighter weight 7mm-08 which I haven't tried but I assume will be adiquate (I've use 280, 280 AI, and 30-06).
Stay with a caliber that works. If you are uncomfortable with the lighter caliber, bump it up a notch or two. I think recoil in the field is "unfelt", but energy at the terminal end of your bullet might make a big difference. I'd rather carry a gun that is comfortable and then shoot it, than visa versa.
