I had my old 22Mag Ultra Varmint first, and dandy as it is had to wait some time looking for a Sportster in 22LR, then got a barrel from a member here. What a nice combo! I think its been wearing the LR barrel more these last few years than the Mag, but they are so easy to swap.
BTW, my Mag wears a scope, and the -0- is fine after a remount and a couple of 'settling' shots. It is a bit heavy though (mine is in BC wood now). I could see if you are a carrying it a lot that a light profile 22Mag might be just what you want. A plastic stock would probably be a asset too, and a lightweight scope, or irons if you can still see. The frame is still so heavy that you can only lighten up the other stuff so far......wouldnt a 4# small frame be sweet as a woods-loafin' gun!