After some more testing I think I found that the problem lies in the background slideshow in the top section.
And the reason I believe why it takes a couple of times of zooming for it to break, is that when you zoom out at the same time as the slideshow is changing image the site breaks.