how to prevent # letter from showing

You cannot prevent this from showing.

It is supposed to be hidden by default and shown whenever you have any items in your list that are not categorised into one of the alphabetical letters. For example, if you have a post beginning with a symbol like a quote character then this post will be put into the # category, and the # will be added to your listing to accommodate this.