Garcya: Are you using the aLinks plugin on your blog? I’m using it and when I deactivated only this particular plugin, both my blog and my admin area got back to normal speed. (I’m using WP 2.2.1)
If aLink is causing this, it’s really sad, because it’s a great plugin…