Yep, you just have to get used to it. You'll find that when you do and you stop leaning back, you have a lot more control over your board. It's just your brain trying to do what feels natural. Leaning forward doesn't. I'm a fairly experienced rider at this point and I still have to fight the urge when I get in gnarly terrain.
"People say that marijuana smoking is going to get in the way of my career. I say to them that on the contrary, my fighting career is getting in the way of my marijuana smoking." -Nick Diaz