It’s not the exercise, but rather the weight loss from exercising that can decrease the size of your breasts. You probably won’t notice any change with a slight weight loss, but if you lose a significant amount of weight, you may notice that your bras don’t fit as well as before. That’s because your breasts are mostly fat, so with weight loss they can get smaller.