The causes for low testosterone that occur in men can ... be a result of one’s lifestyle. Lack of exercise, unhealthy diet, smoking, and excessive drinking are all causes of low testosterone that can be modified by changing one’s living habits. These factors are responsible for some of the aforementioned gland damage.