is it too late to compete?

I just recently started swimming because everyone was telling me about how "I have a typical swimmer's body".I tried it - and now can't spend one day without visiting my beloved pool.Anyways, I was wondering ig I am too late for competitive swimming.I am 24 years old, 6'1'', 162 lb., very lean and muscular.I am extremely determined, always have been good in sports(have 5 years of lifting experience).So yeah... That's the deal.I wish my parents got my ass into the pool when I was a kid.Could have been at a good level now.Anyways, what do you think, guys?After two months of swimming I clocked myself on a 100 meter freestyle - 1:25... yeah, I know - leaves a lot to be disired, but I was curious:how quick can you accomplish your time improvements at the start.to shave down 20 sec., say, would that take years? Thanks.