Style Search Widget from a theme

I am trying to change the search button from the default to a image. When I try to modify searchform.php it has no effect.
How can you change that in the theme only and not in any other wp files. This is for a custom theme I am making to distribute.