I've had no issues with mine. I use it for the MS Deer Primitive Weapon Season. The only load I've tried is the Federal Premium w/275 gr XPB. It is scary accurate at 100 yards and does not kick that badly. I currently have a Weaver Grand Slam 4.75 x 40 fixed power scope mounted on it. I have yet to have any issues with it "shooting loose", though I must admit that I have not shot it much. The only modifications I've made are to cut 1" off the stock and to put a rubber O-ring between the barrel and forearm (ie, I just tighten the forearm screw snug) to free float the barrel. BTW, when I was sighting in the rifle some time ago, I could only see 1 bullet hole and thought I was really screwing up. When I checked the target, there were 3 bullet holes almost through the same hole. I shot another 3-shot group to confirm what was happening. In the past I have maybe once or twice shot clover leafs with other rifles but not that small as for this H&R 500 S&W. I bought 2 more boxes of the Federal ammo with the same Lot #. So, ammo-wise, I'm set for the next 10 years with the small amount of shooting I do with this rifle. That's a good thing, given the price of the Federal factory load.
Now that i think about it, I'd be surprised if mine shot loose anytime soon. A couple of years ago, I accidentially knocked this rifle out of a 15' ladder stand in the pre-dawn hours, when I was getting my stuff situated (no, the rifle was not yet loaded). At the time I had a Leupold 6 x 42 FX III mounted on it (which I have since moved to another rifle). Both the rifle and scope were unscathed (other than a few scratches on the scope) and I was able to resight this combo with little adjustment. I don't recommend my "break-in" procedure to anyone else.