I checked a couple of web sites after I read this....several suggested washing your hands with milk or bleach. The milk will neutralize it, and the bleach will break through the oil.
Several also said it will stay in the pores for a couple of days.....might want to wear gloves before you go potty.
The most logical suggestion I saw.....was to call poison control and ask what they recommend just in case you are also having an allergic reaction.
Hope this helps....