So back in my previous life I worked on big trucks. When pads got soaked with oil we would heat them with a torch which causes the oil to bubble to the surface and we would wipe it off.
I am not suggesting that with bike pads, they can't handle the heat like a truck pad.
I am suggesting that if you are using the brakes a lot in some twisties the oil will bubble to the surface.