How to link to the next post in a category?

Is it possible to link to the next post in the same category as the post or category that I’m viewing?

I’m using wordpress as a portfolio cms and am displaying only 1 post per page. Currently, I navigate through categories by going page by page with each page only displaying 1 post in the category. I think it’d be better (for permalinks, especially) display each category as a sequence of the single post pages in the category. When viewing a single post, however, I can’t figure out how to get a link to the next or previous post in the same category. Any advice?