I can mathematically prove that leaving early is pussy talk.
Using your numbers, consider total travel time for a day of riding, 90 minutes both ways, or three hours total. In the case where you leave at 1 (which realistically means you stop riding at more like 12:30) you will only get at most four hours of riding time in, assuming no breaks and one of the CO mountains that opens at 8:30 on weekends. So if you leave early, you get 240 minutes of lift accessed riding time for 180 minutes of travel, or a 4:3 riding:driving ratio.
On the other hand, if you have testicles of titanium and stay through last chair, you get an additional three and a half (or four, if you're at a resort that stays open until 4:30) hours of ride time for the cost of sitting in traffic on the ride home, which you guess at about an hour and a half of extra drive time. Calling it two hours for the occasional super shit drive, that puts our total at 450 minutes ride time and 300 minutes of drive time, or a much superior 3:2 ride time:drive time ratio.
Not only is it still more efficient, but you're also getting more riding time in, which will further fortify your mind and body against additional weak talk in the future.