Yeah, thats why I took mine off and decided not to wear one anymore. It just made me so paranoid and uncomfortable. Even when I had the hairpiece on good and knew it was not detectable, if someone looked at me I would feel uncomfortable thinking they "detected" it. I really think its not worth it and its a big hassle too with maintenance.
People with good natural looking wigs say that they feel like it's their own hair, didn't you feel it ?
I go with a comb-over for many years now, and I can tell you that people usually never look at my hair, I mean, when people who know me see me for the first time in the day, they look at my face and might glance at my hair, but not specific, THEN, if sometime later, I catch them raising their eyes to look at my hair again, I KNOW something is wrong with the combover. It is so easy to spot on their raised eyes. If your haircut is not something out of the ordinary, rather just an ordinary haircut they see everyday on people heads, you won't catch them looking at your hair, if you caught them looking at your hair, something is wrong. This leads me to think something was wrong with your piece (maybe too much density on top ?), something was wrong with the blending (color issues ?), it didn't look fully natural.
Do you have a pic of you wearing the piece ?
Regarding maintanance, well, I have a friend who has Type I Diabetes, he carries with him insulin and glucose meter to everywhere, take blood every few hours, and inject himself every few hours, every day he is spending like 20-30 minutes on this whole issue. Why shouldn't we spend 20-30 minutes a day on something that makes us look younger and more pretty ?
Oh, this same guy spends about 2 hours a day at the gym, mainly to look good for the girls, so again, why shouldn't we spend 20-30 minutes a day on something that is equivalent in our appearance to going to the gym ?
All I'm trying to say is, if it makes you look good, and you like looking good, the maintanance is worth it (as long as it's 20-30 minutes a day, and not hours each day). You must also feel good with it when it's on top, otherwise it's not worth it, if your wig looked natural (and I could see that if you provide a pic), then indeed you have a point.
I don't know how old are you and if you're married, but for me (young, unmarried, and want to enjoy dating for many years to come), the alternative to the wig, meaning looking less attractive and older (or in other words, bald), is out of the question.