Removing Navigation When Not Needed?

Hey, I have styled the default:

<div class=”navigation”>
<div class=”alignleft”><?php next_posts_link(‘« Older Entries’) ?></div>
<div class=”alignright”><?php previous_posts_link(‘Newer Entries »’) ?></div>
</div>

Now the problem I am having is when you are in a category page that doesn’t have or need the “? Older Entries or Newer Entries” the code still shows up.. I have put a background color on the “navigation” class so now on those pages it just has an empty colored div heh..

How do I make it so that it ONLY shows up when there is actually something to display?