You are rather new to this aren't you?
Aspen is one of the best ski town party scenes. That said, all mountain towns are sausage fests. Bring your own or start fucking guys. Though I think men who are into that are lacking in ski towns also.
The saying for ski towns goes "you don't lose your girlfriend, you lose your turn". That pretty much sums it up. Go riding instead...