There is little practical difference between the .308 and 7mm-08. That said, I still prefer the 7mm-08 as a whitetail cartridge.
Don't necessarily look at the "numbers" when trying to decide between cartridges. I made this mistake many times when I was younger. I first bought a 7mm Rem Mag because it had the best numbers (next to the .300 Win Mag). Let me tell you, that gun knocked the snot out of me. In recent years, I have wised up to the "myth" of the "numbers."
Don't get me wrong, there is SOME value to the numbers, but your best bet is what you are doing - ASK PEOPLE ABOUT THEIR ON HAND EXPERIENCE!!!
As such, I can tell you that the .25-06 is an excellent whitetail rifle with 115+ grain bullets. This is not to say that the .308 not good. I would consider the .308 for use starting from deer up to elk (yes elk, if shot at relatively closer distances with use of heavy premium caliber bullets.) With the .25-06, you can use the rifle from varmints (which is what you want), up to mule deer. Does that mean that you cannot use a .25-06 on elk? No, but the .25-06 is not as good of a choice on elk as is a .308, a .30-06, etc.
As such, for your intended purpose, I would get a .25-06.
Zachary