How do you leave someone you love?

Bare in mind that I moved to another continent to be with him my son(4yr) think of him as his father.But it seems I don't fit into his life and his family and it seems like his ex is still his best friend.And it feels like he think of me as stupid.I don't work at the moment.and my family is on a nother continent. I am heartbroken and lost.