jonr,
When pushing a heavier bullet (like 180 grains rather than 150 grains - or even 165 grains rather than 150, and so on) there is more rearward force (recoil). Whether a shooter notices the additional recoil is another issue, but there is indeed higher recoil.
Zachary