You say one thing and did another, no wonder the man is confused. If you have cut him off then cut off everything. You have kept a very murky relationship going on with this man, you really need to cut the apron strings. Even though you have stated you have moved on, a small part of you haven't, not fair to him nor your new man. You have sorta had your cake and ate it too.
Women for the most part get mad with men do this and we have had plenty of posts on LHCF about when the woman is on the receiving end and it usually doesn't end well.