It sounds like your Gemini has a lot of inner conflict...
If he is unable to resolve this he will never be happy or at peace. He needs to be at peace with himself before he can be at peace with you or any other partner.
Do a compatibility report between you and your Gemini to see how the Energy flow is between you both.