What do you mean exactly when you say Is it safe while youre using finasteride?
Is it safe for you? Yes. Why wouldnt it be?
Is it safe for her? It's the same for her if you are or aren't on finasteride.
Although im not 100% clear on the safety of trying to have a baby while youre on finasteride...if youre not trying to make a baby I dont see why you wouldnt be fine.
Im in your same situation, im not a doctor or anything but neither of us have died...so i think you should be good....Happy Sexing!