Query posts pagination problem

I have added the following code to a specific category archive loop:

<?php
query_posts('cat=164, -13' . '&paged=' . get_query_var('paged'));

if ( have_posts() ) : while ( have_posts() ): the_post(); ?>

Which does the Job and does hide category 13. However my issue is when you reahc the final page of pagination it is blank due to the discounted posts from category 13. How can I get the pagination to update also and display only the number of pages of the new loop minus category 13.

My pagination is `<?php if(function_exists(‘wp_page_numbers’)) { wp_page_numbers(); } ?>
`