They aren't using you for sex if you want to have sex too. If you don't want to have sex, then don't. If you want to have sex and you have it then quick asking for recompense. If you aren't into casual sex, make that clear. It doesn't justify agreeing to go out with men that you don't like simply for a free dinner.