Like mentioned before if you wipe water from the inside you have just removed your anti fog coating, and they will fog up faster and harder. (wiping them when there dry is fine.) Luckily you can buy anti fog coating you rub on and wipe off and there like new again. I had some stuff called cat crap and it helped my spy's last 6 seasons.
Another big no no is putting them near a fireplace, I had a buddy wreck 2 pairs of oakleys doing that, they will fog between the two lenses and never dry out.