I'm assuming this is only with men you know (i.e. not online dating). Otherwise, this behavior is risky (for you and him). I would not recommend a man going to a woman's home for the first date if they matched online (or visa versa). You may end up mugged or killed.

For online hookups, a public place would be safer.