I found the problem myself.
When you are logged in to too many Gmail accounts Google will just give error 400 pages when connecting to something.
You will need to perform the action on an incognito tab and all will be fixed.
This will not happen too often. We use Chrome OS computers in my company and you will very likely only encounter this if you are in a similar situation like me.