• I’ve just ventured into my Robot.txt file

    It looks like this:

    User-agent: *
    Crawl-delay: 1
    Disallow: /wp-content/plugins/
    Disallow: /wp-admin/

    For the line: Disallow: /wp-content/plugins/ – is this stopping all content held in my plugins from being indexed?

    I have a large FAQ section run through a plugin, plus a lot of galleries running through plugins – ideally I’d like this content indexed.

    Any pointers or advice really appreciated.

Viewing 3 replies - 1 through 3 (of 3 total)
  • Moderator Samuel Wood (Otto)

    (@otto42)

    www.remarpro.com Admin

    For the line: Disallow: /wp-content/plugins/ – is this stopping all content held in my plugins from being indexed?

    Yes, it is. It’s also a bad idea. Many plugins include Javascript code, and yes, Google wants to access that code in order to render your page correctly and see what exists there for it to index.

    Thread Starter Simast

    (@simast)

    thanks Sam – are their any downsides from allowing crawling of plugin content. For example security concerns?

    (fyi i think this entry is a hangover from when I had a managed WP site through GoDaddy)

    Moderator Samuel Wood (Otto)

    (@otto42)

    www.remarpro.com Admin

    For example security concerns

    No, not really. I would make sure your system has “Indexing” disabled, but other than that, it’s fine.

Viewing 3 replies - 1 through 3 (of 3 total)
  • The topic ‘Disallow: /wp-content/plugins/ – is this good or bad?’ is closed to new replies.