After some testing on several sites, looks like the problem only happens (at least for me) if the settings for permalinks (for polylang) is set to ‘language is defined by content’. Changing the setting to ‘language is set by folder name in the permalink’ works fine.