How do I display different text in Header Right widget on different pages?

Hi, I’m trying to build a bilingual website in English and French. I registered the Header Right widget so I can display the option for French speakers to click “Fran?ais” in the upper right hand corner when they are on the main English homepage, however, on all the French pages, it still says “Fran?ais” in the upper right hand corner and I want it to say “English”.

The idea is for people to easily navigate back and forth between the two languages. I believe the Header Right widget is universal across the entire site (this is all on one site, not multi-site) so I am not sure how to change this. Any help would be greatly appreciated.