How to direct bots to correct files?
-
Lookign through my server logs, I see a lot of requests for
index.rdf
andrss.xml
. I’m sure these are coming from some search bot.
Can anyone give me details on what I might do to myrobots.txt
file or ameta
entry to direct these requests to the appropriate WP files?
TIA
Viewing 6 replies - 1 through 6 (of 6 total)
Viewing 6 replies - 1 through 6 (of 6 total)
- The topic ‘How to direct bots to correct files?’ is closed to new replies.