Ok I found the issue. Maybe some others have the same problem, so here is my situation.
I had a plugin called “Woocustomizer” activated, which was probably overriding the action. The plugin allows you to easily remove both the sorting menu and result count in your theme customization area. Very simple. The problem was not with Neve.