Will making a small change to my blog title hurt SEO?

I would like to change my blog title, but I was told that this would hurt my site’s SEO. I have quite a high Google ranking, and I don’t want to ruin that. I currently have Google first page ranking for most words associated with my main topic.

I know how to go to Blog Title in the general settings page of WordPress, but I don’t want to do anything that will hurt the SEO. If the URL of my site doesn’t change, will I lose all of my Google status if I make any changes to the title (even a very minor change). For example, Say my site was called Gone Fishin’ – A Bass Fishing Blog, and I wanted to change it to a more general title like Gone Fishin’ – A Fishing Blog. Will this ruin my SEO? It is a small but important change that I want to make, but if I will destroy all of the Google links that I’ve worked so hard to gain, then I won’t make the change.

Help!!!!!