It may be worth less since it has been shot than it would be worth if it hadn't been. That said, what good is it if you aren't supposed to use it. (I have my fireproof britches on already.)
It may surprise you with its accuracy, the barrels are free floated and the action is plenty strong with a good lockup. I have one in .25-06 that I have not yet fired, but not because of collector value even though, like yours it will have some. Your rifle will always be worth more than a standard production gun. Take good care of it and it will hold value better than the standard guns. If you use it as a "truck gun", then maybe not so much.
I have played with my rifle and the trigger is pretty poor in present condition. I need to have someone work on it or work on it myself (I've done this before with good results). You might need to as well. I have had direct personal relationships with 2 other of these rifles and both were good shooters. I was able to shoot the 6mm one a little more accurately than the .30-06, but both were good enough to take on any kind of big game hunt. Even speed goats at long range. The 6mm easily shot minute of angle after the trigger job. The 3-06 shot less than 1-1/2" every time I had an opportunity to shoot it. I loaded ammunition for the folks that owned these guns and always tested the loads in the guns before deer season to make sure they functioned in the guns without any problem so had a pretty good chance to determine what the accuracy potential of those two were.
Since it has already been shot, you do not have to make a decision to shoot or not. Go ahead and enjoy it. Those maple stocks are really pretty. Some of the ones I've seen pictures of are fabulous. The stock on mine looks very nice too; not the best one maybe, but really nice - clearly the best looking wood I currently have on any gun.
EJ