Normally it refreshes alone… Maybe it is because the simplepie component, which is responsible for fetching rss feeds in WP (and in this plugin) has a default refresh rate of about one hour I think… And the RSS feed itself might take some time to update.
I think there must be a way to force simplepie to update its cache more often, but doing that you might increase much you page loading time…