Contacts: who's wearing them when they swim?

Contacts: Who's wearing them under their goggles and who isn't? At my last eye exam, my dr. sternly lectured me about the evils of swimming with contacts. When your goggles leak, which seems inevitable, the chlorine seeps in the lens, contaminates it and can thereby irritate your cornea. I wore contacts my whole youth without incident, but now I notice some dry eye and redness. The problem is I don't like most prescription goggles. What does everyone think? Anyone whacked out an eye?