HI Shaz01, happy new year... his words meant that the only thing he's ever going to have with you is that... just company once in a while and s e x... he wont leave his wife and/or kids... has he ever told you he's planning a divorce and or leaving? does he have kids?
As long as you don't create problems and or drama he might continue to have this for as long as you want...
It's normal for a woman to have feeling become deeper when physically (intimately) involved with a man.
This situation is just going to become harder on you if you ever start wanting and/or expecting more from him... so it depends how much you know yourself and what you can live with or without.
I know it's easier said than done... you have to do whatever is best for you for now... but don't compromise your dreams and goals.
Wishing you the very best, HD