I'm average (5'10'') and I know I have usually been drawn to women shorter than me. I think this is for two reasons:

1. I feel more masculine around women that are shorter than me.

2. I have a better shot with women that are shorter than me. Women that are taller than me are likely to think I'm too short.

It's not just the insecurity of men. It's a social norm that has been reinforced by the sentiment of both men and women. Of course men are sensitive about their height. Men experience discrimination based on height the same way women experience discrimination based on their weight. In order for men, generally speaking, to be more confident regardless of their height, culturally we need to stop putting so much value on it.