cold water and earache

I swim in cold ocean water, and my ears hurt. I am looking for earplugs to keep the water out - the silicone ones I have fall out (my cap inevitably rides up during the swim, so doesn't keep the plugs in). Any suggestions? What has worked for you?