In my experience, at least, it's only when you take it up. You should be fine when you get back to the ritual work, especially if you've continued with meditation, divination, or other nonritual practices.