While gyno is normally associated with high estrogen, the sexual side effects from finasteride like reduced libido, decreased ejaculate, etc. can be attributed to the lowering of DHT.
Playing with anti-estrogen and aromatase inhibitors is tricky. By blocking the conversion of testosterone into estrogen, for instance, one can also increase the conversion of testosterone into DHT even while taking finasteride.
D.