I have the exact same problem. Categories are not subcategories of each other, I am not using any tags and this only happens with jetpack’s infinite scroll. When I deactivate it, everything is normal again.
Does anyone have an idea how to solve this or where to start? Thanks in advance for your help. Theme is the unmodified Twenty Twelve.