The issue in my case turned out to be that the rating wasn’t relly selected.
If you look on the page on Gravatar where you manage email addresses. There should be a photo by each email address. If not, click through to the image page. There, you’ll see (or at least I did) your image with possible ratings. The “G” rating displays a thick black rule, as if to signify that it’s selected by default. But it isn’t! If you actually click on the ratings, you’ll see that when selected for real, they’re bordered in color.
No mea culpa. It’s a dumb UX mistake.
@mattmiklas, I don’t think this is your issue. @nowsathshereef, it might be yours. Hope this helps somebody in the future.