Help with my Robots.txt
-
Can someone take a look at my robots.txt and see if it’s ok
I’ll like to block sections that shows low quality pages like this:
1. https://techtalkafrica.com/how-to-create-automatic-backup-for-your-website-with-ease.html/sitevault
2. https://techtalkafrica.com/how-to-create-automatic-backup-for-your-website-with-ease.html/xcloner
but will like to allow this:
3. https://techtalkafrica.com/how-to-create-automatic-backup-for-your-website-with-ease.html/
4. https://techtalkafrica.com/how-to-create-automatic-backup-for-your-website-with-ease.html/
This is what I’ve done,
Disallow: /*.html
Allow: /*.html$Can someone take a look and see if it’s ok, I need to know that I’m not blocking my normal URL’s
Thanks
- The topic ‘Help with my Robots.txt’ is closed to new replies.