Hide data from search engines??

  • Hi,
    I though this plugin was de facto hidden from search engines, but google found a way to crawl it and display all the members.

    How can I make sure the database stays in the backend, and shows in the frontend only to “logged in” users?

    I need help, thanks!

Viewing 3 replies - 1 through 3 (of 3 total)
  • Plugin Author xnau webdesign

    (@xnau)

    Any page that is login protected won’t be spidered by search engines.

    Thread Starter morzar

    (@morzar)

    That I know, but google crawled this URL

    https://www.mywebsite.com/categorie/profils/

    I cannot hide a category, so what am I supposed to do?
    Many thanks for the quick answer!

    Plugin Author xnau webdesign

    (@xnau)

    You can use a robots.txt for this kind of thing. There are several plugins that will help you generate this file, which tells the spiders which areas of the site are off-limits and which should be spidered.

    It’s important to understand this is not security, it really only works to keep these pages from getting spidered by search engines that respect the robots.txt file.

    I also suggest you get a Google (or Bing) Webmaster account so you can see exactly what is getting indexed on your site.

Viewing 3 replies - 1 through 3 (of 3 total)
  • The topic ‘Hide data from search engines??’ is closed to new replies.