SEO obstacles

  • Resolved bandhuji

    (@bandhuji)


    6 years, 6 months ago

    Greetings,
    I have been building my site with the wordpress option checked to discourage search engine indexing. Now that my site is done (enough) to be online, I have unchecked it and seem to be having very limited success in allowing search engines to index my site. For instance, I asked ryte.com to index my site and it returned an error saying that the server was blocking automated requests from bots. My robots.txt file is fine…
    The reason I am looking at this plugin as the problem is because yoast offers a chance to have ryte.com check the ‘indexability’ of our site from our dashboard. But, when I try to have the site checked out, I get an error message asking if I want to whitelist the ip address/action. That should not be happening because this is a professional, well know company attempting to view my site and improve its SEO performance. Help! is/has anyone had the same issue and does anyone have some guidance for how to get past this problem.

    The page I need help with: [log in to see the link]

Viewing 5 replies - 1 through 5 (of 5 total)

  • I wouldn’t bother with ryte.com. Look, your pages are being indexed by Google: https://www.google.com/search?q=site%3Ashakticare.com
    If you haven’t done so already, register your site with Google’s Search Console, submit your sitemap and keep an eye on any potential indexing issues from there.

    Hi @bandhuji!

    Whenever Wordfence blocks anything a record of this is created in the Wordfence Tools > Live Traffic view. So if you think something is getting blocked that shouldn’t, please head over there to find out.

    If you find an unwanted block in Live Traffic, check our documentation or reach out here on the forums if you need help figuring out how to allow that specific request. If you trust a service completely one option can be to simply whitelist that services’ IP-address.

    Hope that helps!

    Thread Starter bandhuji

    (@bandhuji)

    that’s what I thought too, but that is recording the visit & blocking of the crawler. Since I posted here, I contacted ryte & they said their old crawler was being blocked, but the newer one had success. But there is no record in wordfence of a bot being blocked….
    Also, while it has been indexed by Google, if I go to yahoo and search for my business name, it lists the site, but the description says the website is not allowing yahoo to access the information….

    Thread Starter bandhuji

    (@bandhuji)

    bing.com is also giving the same listing…

    shakticare.com

    We would like to show you a description here but the site won’t allow us.

    this is hugely frustrating considering I have even put the meta info to allow bing to do verified indexing!

    Hi bandhuji,

    Do you have other security plugins installed? Do you have any custom blocking rules in .htaccess? If you can’t find any record of Wordfence blocking something in Live Traffic, then it doesn’t sound like Wordfence is doing the blocking.

    I’m not sure what you mean that the site won’t allow you? You can upload an image to a dropbox account or imgur and send a link to that image.

    Thanks,

Viewing 5 replies - 1 through 5 (of 5 total)
  • The topic ‘SEO obstacles’ is closed to new replies.