Why remove the interface when paused?

Very annoying that the player is animated to the left while my cursor is positioned where I paused it – why? I just want to pause and play at the same position and not having to go all the way over to the left again to start what I paused. Bad usability.