I added double workouts on a few days a week, and I also swim on either saturday or sunday. That has been the only way for me to get my weight down, and even then it's been a slow process (15 lbs in about 4 months). However, I like swimming, so it works out ok.
It's worth looking at the calories of the foods that you think might not be a source of problems. A burrito, for example, can contain more than 1000 calories. I was eating a burrito for lunch each day, without even realizing that it had more calories than an entire dinner should contain.
