I'm so so sorry you are dealing with this.
Look at his actions and words: (this is what you wrote)
1. He has lied so much
2. he stays by his momma house saying I am driving him away
3. I call him - his phone is off.
4. When I see him he is constantly on the phone.
5. there is a house involved and he says that I should leave
6. first he says I should leave or if I stay I cannot bring a man to the house.
It takes two people to be in a marriage, and when the going gets rough, it takes two to save it.
Nothing in his actions or words above says that he is interested in being married or having an emotionally intimate relationship. (Especially kicking his wife and two children out of the house!)
God, counseling and good legal advice is important, but taking care of YOU is even more important. I hope you have a shoulder to cry on and kind ears that will listen when you need to "think out loud". You can always do that here with all of us!
I completely agree with everything stated above. It is not enough for him to just say he wants to stay married to you – nothing in his actions tells you that he’s doing anything different.
He told you about all of this because something was about to go down with the other woman, the other kids, his family. Someone said something that caused a threat to his façade and he came forward before someone else blew him out of the water.
He’s looking out for himself above all others – you, your children with him, his children with her, and her.
Time to have your own back.
No matter if you stay or go make SURE you treat this situation as if you’re dealing with a stranger.
Talk to a lawyer about your asset protection. And especially child support. Many women in your shoes have been shocked to find out that the amount of support for the children of the marriage was diminished because the other woman filed for support first. In a lot of states, whichever mother files first, gets more. Fair? Probably not – but it is what it is.
There is no question about staying or leaving. He already left and you just didn’t know it. Treat the situation from that standpoint. If his intentions are truly to work on and heal the marriage then he’ll act accordingly. It’s not your sole responsibility to fix this.
Get to the lawyer’s office NOW.
ETA: I've seen more than a few couples deal with infidelity. Without fail, the couples who were able to survive/recover from it were ones where the betrayed spouse stepped back and went and handled business up to and including filing for divorce. There is a significant messgae delivered to a cheater when they see the spouse they've dismissed as weak and irrelevant suddenly take control of the situation.