If it continues, I would wash the face twice a day and use a non-oil based moisturizer (something glycerin based) right after.
I used to have oily skin, and had a dermo say that oil production in my skin was exacerbated when I would leave it dry and unmoisturized. He put me on a regime of washing my face with a quality facial wash (and NOT soap), exfoliating my face 2x a week, and using the glycerin moisturizer right after washing, while my skin was still moist (NOT wet, but dry and still somewhat hydrated from the shower). Helped my complexion 210%, and I still do it, and to this day I get compliments on my youthful complexion.