I don't think fitness activities are very age related as your doctor says. I believe you can achieve your goal of being able to jog & hike and all. I know a man well into his 60's who still jogs everyday. It's all about ability, you probably want to start slow so, or with more low impact activities like the kayaking and swimming, so that you don't aggravate your injury. Best of luck!
Damian B. likes this comment.