Yeah I had the exact same problem. Here’s what I did to restore the page:
1. Deactivate podpress
2. Move all posts in the “podcast” category into a new category “newpodcast”
3. Re-upload the following from the default WP package:
wp-rss2.php
wp-rss.php
wp-rdf.php
wp-atom.php
4. Change the new category slug to “podcast”
5. Force WP to rebuild my htaccess file (Permalinks page)
6. Re-activate podpress
Messy I know, but it’s the only way I could save my domain.com/podcast URL. I think the problem lies when podpress tries to edit the wp feed files?