• Resolved LV

    (@lordvader)


    How can I allow Bingbot to crawl like googlebot ?

    I gave the “If a crawler’s page views exceed” a higher number.
    But this way I also give other ( let say not so nice ) crawlers
    more options to crawl.

    Regards,

    LV

Viewing 4 replies - 1 through 4 (of 4 total)
  • Anonymous User 9948090

    (@anonymized-9948090)

    Absolutely. I also want an option to allow Bingbot always similar to Google bot. In this way, we can reduce maximum pageview limit for crawlers without worries.

    If I reduce the crawler limit, it blocks Bingbot.

    I have observed that not only Bing but also Yahoo SEO crawlers get restricted when they are attempting to make legitimate crawls through my site.

    There is still a significant market share that utilize Bing or Yahoo to assist in web search as well as web ad delivery clearing houses that us more than AdSense/AdWords alone.

    Is there a way to treat these other SEO platforms the same as Google?

    Anonymous User 9948090

    (@anonymized-9948090)

    I definitely want an option to allow unlimited accesses for Bing as Google.

    Hi,
    Thanks for your suggestion, I’ve already added your vote for this feature request to a similar request we have (internal reference number: FB839), although I’m not sure if this can be seen in one of the plugin’s upcoming releases or not, but all suggestions are evaluated by our dev team and considered seriously.

    For now, I suggest using a higher number in “If a crawler’s page views exceed” option and set those who exceed it to be “throttled” instead of “blocked”.

    Thanks.

Viewing 4 replies - 1 through 4 (of 4 total)
  • The topic ‘Allow Bingbot to crawl like googlebot’ is closed to new replies.