How to add wc_help_tip() to attribute ?

I need to add an attribute explaining if a certain product size is larger or smaller than the assigned size. For example sometimes a shoe size EU 36 can be slightly smaller depending on the brand or country of origin.

I made an attribute with all the values but I want to add the little question mark next to it (wc_help_tip()) which on mouse over would explain that no rights can be derived from the attribute value as we only know this based on customers reaction.

So in short, I would like to add the question box next to the value of the attribute.