a great board that is women's specific is the rome blue. i started in december, rented a couple of beginner boards, a burton feelgood, and i bought the rome when i was definitely still a beginner. i've been boarding 3/4 days out of every 2 weeks so i've stepped up my game. when i first got the board i had the same thought as you, but if you can handle an intermediate/advanced board, it will just make you a better rider. just attack it. you'll be fine.
the rome blue is a great board. not too stiff, it's responsive and it holds an edge like nobody's business. highly recommend it. it's a perfect intermediate - advanced all mountain board.