Just keep on practicing. It gets easier. I instruct once a week for a few hours and I've spent every class riding switch since all of the kids I teach are regular and I ride goofy. Now I can do switch ollies, switch presses, switch butters and just have an all around fun time riding switch. The trick is to be consistent in your practice. Don't stop trying just because it's hard at first. The kids in my class got a kick out of watching me fall semi-consistently for the first two classes. Now they ask me if I'm going to fall for them anymore. I just smile and tell them "Nope.". Then I'll try something like a switch 360 butter and eat it cause I'm still not great them, and the kids all laugh.
Switch is fun. It's hard, but it's fun.