Testosterone is easily converted into estrogen, which could account for a large part of your symptoms, due to the aromatase activity in fat cells. Aromatase converts the androgens (including testosterone) into estradiol. This often causes the sweats, as you've described. Additionally, if you have a gut flora imbalance, you can also have beta glucuronidase activity going on - causing your processed (conjugated and inactive - ready to pass out of the body) estrogen to be deconjugated, rendered active, and reabsorbed/recirculated in the body, keeping estrogen levels high. If you begin to see "moobs" (man boobs) forming, and excess fat being stored around the hips, butt, thighs, and upper arms getting flabby, you've got a sure indication of estrogen dominance - with testosterone feeding the supply.
To prevent this from happening, grape seed extract is an excellent aromatase inhibitor - one of the most powerful. This prevents the aromatase from converting testosterone into estradiol. Also calcium-d-glucarate prevents the unfriendly bacteria in the gut (e. coli, for example), from reactivating estrogen, by inhibiting beta glucuronidase activity.
I would lower the supplemental testosterone (unless your doctor is specifically overseeing this and has prescribed this for you for some reason), and take the GSE and CDG every day. You may find yourself needing less (or no) supplemental testosterone, as your body may begin utilizing your own inherent testosterone correctly. You may also want to supplement with SMALL quantities of DHEA (no more than 5 mg per day, sublingually), and SMALL quantities of pregnenolone (5 mg sublingually, first thing in the morning), as these will also help your body to produce more of its own testosterone, naturally, without suppressing any of your body's normal functions.