Vegies grown in pots, white fly and aphids

I planted pole beans in a large pot and they are doing very well, but I noticed white fly's flitting around when I disturbed the plants.  Is this to be expected?, I grew them from seed.  I hit them with insecticidal soap, am I going to battling them the whole season?  

I also planted Japanese globe egg plant in a pot and they are bothered by aphids, which I also hit with insecticidal soap. 

I also have jalapeno peppers, and bell peppers and 3 tomato plants in pots which I have no problems with.

My father had a huge garden when I was a child, and I don't remember him having all these bug problems, I'd love hearing from people with experience with growing vegies in pots and maintenance during the growing season.