OW Training in Santa Barbara, CA?

HI All-- I will be out in Santa Barbara for work in a few weeks, and while I am there, I wanted to try to fit in some ocean swimming. (I am doing an Alcatraz swim in June so I wanted to use this SB trip in May as a chance to get more exposure to cold water, etc.) Are there spots in the SB or Goleta area where if I showed up at 6am on a Friday morning, there would be other swimmers around? I don't need to be part of an organized group, but I don't want to swim entirely alone either. Thanks!