One trick some people use is to grab their pants legs with both hands so the upper body stays parallel to the board. But do something. You have to break this habit.
I like that, I am trying to get my girlfriend into riding with me and she is not very balanced, and she is fairly stubborn once she becomes frustrated. That is a good learning tool to remember. +1