had a similar issue.... stopped dutasteride October last year and I'm just getting back into normal shape.
Go get your hormones checked (testosterone, estrogen levels, the lot), while you're there get the endocrinologist to check the old marble bag and make sure you're normally androgenised i.e. your balls are in the normal size range.
dutasteride is farkin powerful stuff and I won't touch it again....
You may just find you're in a similar boat to myself which is that both your testosterone and estrogen levels are high.
The high estro levels can effect your sex drive alot and a mild aromatase inhibitor may be all you require to get back to normal....
DON'T do anything without seeing your doctor first though.....