Well, When I use another SEO plugin it works perfectly. So I have deleted the Yoast plugin Since it really seems the yoast plugin creates troubles (You can argue is it the Yoast or the theme). You can both point to each other that’s fine. I dont want to be in the middle. So I have deleted the Yoast and installed the ALL in One SEO plugin and that seems to work out of the box just fine.