Swimming near the Hilton Baltimore MD

I'm going to be at the Baltimore Hilton (Pratt Street) for a few days in early June. I'd love to get a swim or 2 in while i am there. Does anyone know of healthclubs or public pools in this area? Thanks