I think it depends on the context of how you are meeting this man.
If you are out at a party, club, get together, etc then yes the first thing he notices is going to be your physical attractiveness.
If is someone you work with, or have repeated interaction with then he has a better chance being attracted to you because of your personality because he has spent more time around you.