Yes, you just keep on praying. You'll be ok.
Remember the prayer you sent me? It had something in there about asking God to send you someone who you will be attracted to physically, emotionally, and spiritually. I am learning to trust God in this area. Why would he send us someone we have no attraction to? (Sure, it can happen over time but if it doesn't, then something's probably not quite right.)
So, don't fret over this guy. You may end up finding yourself attracted to him and you may not.
ETA: You're only settling if you get a sign from God that he is NOT right for you. I would think that can come in many ways. ie You go on a date and all you can think about is how short he is and how uncomfortable you feel but you continue to date him feeling like that all the time. (At least that's how I think of it.)