Brew Brothers slot demo,Jill dermaplaning spray where to buy.REGISTER NOW GET FREE 888 PESOS REWARDS!

Googlebot going crazy

Matt Knowles — Tue, 23 Apr 2019 16:50:43 +0000

Today I noticed this site was suspended as it exceeded it’s monthly bandwidth allocation. Looking at stats, Googlebot was by far the worst offender. Looking at log files I saw numerous entries like this:

66.249.75.58 – – [09/Apr/2019:15:44:15 -0500] “GET /?cat=-1&page_number_0=2&page_number_4=3&page_number_6=1&page_number_19=2&page_number_20=2&page_number_16=2&page_number_5=2 HTTP/1.1” 200 457785 “-” “Mozilla/5.0 (compatible; Googlebot/2.1; +https://www.google.com/bot.html)”

I have All In One SEO installed and canonical URL’s enabled. Any idea why Google is accessing the pages using these types of URLs?

I added an entry to the robots.txt file to disallow /cat=* and hopefully that will take care of it, but I’m wondering what would have triggered this sudden behavior from Googlebot. Also what’s with all the different page number parameters?

Reply To: Googlebot going crazy

t-p — Wed, 24 Apr 2019 01:12:48 +0000

Also review this: https://support.google.com/webmasters/answer/182072?hl=en

Reply To: Googlebot going crazy

clemart — Wed, 24 Apr 2019 12:57:56 +0000

Hello,

I had the same problem a few years ago, this drove me crazy… Googlebot was doing infinite crawl with a not-so-well-constructed plugin page with a lot of GET parameters.
This could help you: https://support.google.com/webmasters/answer/76401?hl=en

robotx.txt config should help you indeed