Sharing Our Innermost Thoughts

I met him online just 2 months ago, he was in a relationship for 3y with a lady who left him 1 year ago saying that she will come back. But long distance didn’t workout and also they both couldn’t say proper goodbye. Since 2 months we both are meeting up, physically we are close, when I ask him is it FWB then he says no, he likes to be with me but he doesn’t like me in that way. But I fell in love with him, I understand him alot but today he said that he wanna go to his ex’s country and say proper goodbye as he can’t sleep at nights. He cant forget their memories which I understand and he should do it in order to move on. Now I dont understand what should I do, because am suffering alot, I dont just want a physical relation between us, I cant do one side. I cant be with him or stay with him knowing that he loves someone else but kiss me and hug me, I cant do that. I cant kiss him knowing that he doesn’t love me. I told him that we will take a break and I know this all gonna end very soon if I take a break as we already not talking much. Though we met just last weekend for my bday, it was only to show me, he was not happy. Last time I thought of not talking to him but within 2days I spoke to him as I couldn’t resist but now I wont talk for sure. As I dont wanna be used by anyone anymore.