When I use to rollerset, i would apply leave-in only, rollerset, air dry and then seal with oil after removing rollers. If I put oil before rollersetting, my hair would take almost twice as long to dry.
Even now that I air dry loose, I still avoid oils (except on my ends) until my hair is about 60% dry before sealing, otherwise, it just takes too dang long . . .