A barrel that is that much oversize, will not be very accurate. The grooves in H&R barrels are only 0.002"
deep so there is blow-by of powder gases. It is possible for the bullet to bear more on one side than the other and wobble. The best thing you can do is not clean the barrel and let the carbon build up some.
An oversize barrel fouled up may proof to be a bit more accurate.