Viewing 8 replies - 1 through 8 (of 8 total)
  • Maybe the author has something better but what you are looking for would be https://support.google.com/webmasters/answer/96569?hl=en. (nofollow)

    Thread Starter Insomnis

    (@insomnis)

    that doesnt help.

    All my links from pretty link lite are nofollow but they has been crawled anyway.

    Justin Greer

    (@justingreerbbi)

    nofollow is a recommended attribute and only runs on the honor system. This means, if crawlers wants, they can crawl them anyways.
    Which search engine is crawling the links? Is it possible that there was no nofollow before and they was crawled previously?

    Thread Starter Insomnis

    (@insomnis)

    Hey,

    no they are nofollow alle the time.
    Google AND SEO Tools like Onpageorg identifies them as 301 permanent and so they are in google index. But NOT all. Just some of them.

    I really dont understand why.

    Justin Greer

    (@justingreerbbi)

    That is kind of odd. Maybe @supercleanse could shed more light on what may have happened or what is happening.

    Plugin Author cartpauj

    (@cartpauj)

    nofollow was initially started as a way to prevent bots from following links in comments etc which could hurt a site’s ranking. I read somewhere that nofollow is really (as Justin said) on the honor system and even Google doesn’t always obey it. With search engine algorithms being a secret it’s hard to say exactly why they would index some but not others unfortunately. But one thing that may help is adding slug prefix’s to your links and using a robots.txt file to ask search engines not to follow/index certain directories.

    Thread Starter Insomnis

    (@insomnis)

    Hey cartpauj.

    Thanks for your answer. The “Slug Prefix”-idea is good, but i already have thousands of links. How should i change them all manually? No way… ??

    Plugin Author cartpauj

    (@cartpauj)

    Yeah, if you already have that many — and if you’ve manually placed them on your site or other sites, then I wouldn’t recommend changing them.

Viewing 8 replies - 1 through 8 (of 8 total)
  • The topic ‘Pretty Link Lite – Links should not be crawled’ is closed to new replies.