Restrict to only registered users but allow search engines to crawl the site

  • I would like to only allow registered users to view my blog yet allow search engines to crawl the site. I have looked at some of the plugins available and they seem to block access to search engines as well as no registered users. Ideally I would like a user to find the site with a search engine based on the content of the posts, but be restricted from viewing the site unless they self register or have registered previously. Any suggestions would be greatly appreciated?

Viewing 1 replies (of 1 total)

  • thats going to ne a tough one to implement- and there is one primary reason why.

    Trying to track search engine spiders by IPs alone would be a monumental task

    Its nearly impossible to identify search engine spiders without using their user agent. And user agents can be spoofed — very easily.

    I would say, off the top of my head, that if you intend to have a strict members only blog, than you’re going to have to suffer the consequences of losing out to search engines.

Viewing 1 replies (of 1 total)
  • The topic ‘Restrict to only registered users but allow search engines to crawl the site’ is closed to new replies.