You can easily make new holes in the correct spot, if they're too close to the old holes, drill the hole out to 1/8" or 3/16", then glue a piece of hardwood dowel in the hole and drill the new hole after it cures, also works for repairing stripped holes, although a sawdust and wood glue paste works too.

I've also put new holes in Limbsaver pads to work on the synthetic stocks, it's easier to relocate the holes in the pad than in the stock for them.
Tim