I tried to wear one one year and I hated it. I wear one of those neck toques and the helmet straps always got in the way. My ears were always cold. And lest importantly I looked and felt like a tool.
But once I start shredding with my daughter I will wear one ONLY when she's there.