If you're feeling uncertain then being with him is probably something you should'nt do.
If you were always planning to be together in the future, then he should have taken precautions to not get someone else pregnant in the meantime.
You're right that baby and the baby's mother is going to be a part of his life forever and if you're with him, you will have to deal with that.