Sex is a beautiful thing (I'm told
), so don't feel wrong for saying you enjoy it. I'd be worried if you weren't, and still having sex with your SO.
Having that said, the question is what's more important to you? Your relationship with your SO? Or your relationship with God?
The last thing you need to worry about is how no sex is going to impact your relationship, cause the truth is--if this dude dumps you because you want to pursue a closer relationship with God, than he's not worth your time.
I hope I'm not too blunt. I'm blunt because i've seen friend after friend and friend choose the rather (the boyfriend) and regret it.