Swimming with a rash: Kosher or taboo?

Ok, so I have this dust mite allergy. When it flares up, it looks pretty darn bad. I feel kinda like a creep getting in the pool with my skin looking that way (it's usually just on the lower part of my calves, which get the most exposure to dust from carpets), but on the other hand I know it's nothing that's going to harm anyone, even if they were to play footsie with me. Right now it's looking kinda bad, and I'm conflicted. I still practice because, well, I don't want to lose out on pool time, obviously. But I'm very self-conscious whenever I walk out onto the deck. So what do y'all think? Is it ok to dive on in, as long as I know I'm not putting anyone's health at risk, even though it might make other swimmers go "Ewww!"? Or am I being inconsiderate? PS: I swim at a gym, not on a team, so I can't simply explain the situation to my poolmates.