Frequency of swimming

I'm 55, in reasonable shape. I bike, walk, swim, lug my 21-pound grandson around! I have begun to get serious about swimming and have been in the pool six days a week. Fellow swimmers at Masters this morning adviused that six days a week might ust be too much and suggested back off to every other day. Anyone have exeperiences to share in this regard? Thanks, Mark