nah you'll be fine man. My bro-in-law snapped his collarbone in two spots 2 seasons ago and required surgery as well. He is 21 and he pretty much followed the same routine as you (pushups, working out, etc.).
He was fine last year boarding and didn't have any setbacks. I would imagine you would have pretty similar results.