What makes you think that he is using you? He will do what you allow him to do.
If you are blowing hot and cold on this one may I suggest that you find another fellow that when you meet and talk you feel very comfortable, than when you meet again the comfort grows into warmth and it justs get better from there.
You have time to explore love and pick the man that makes you feel wonderful in his presense and he will come to you when you are ready for him. Are You? Do not think for one second that you must settle so that you will not be alone. Spirit tells me to treat yourself to only the best and that you will be lead to the right man.