bella2011

Nevermind. I put in into safe mode via wp-config.php and deleted the faulty snippet.

How do you remove a snippet once it causes a Critical Error?

Update:

I have fixed the Error:robots.txt fetch failed in Google Webmaster testing tool.

The only error that remains with the WP Rocket Caching plugin, which erases any changes made to the Robots.txt file in the AIOSEO dashboard, after updates have been saved.

Hi there,

So, we talked with our hosting provider – they do not generate the robots.txt file, they must be manually added in the root directory.

I’ve recreated the issue again, after confirming the removal of the robots.txt file from the root.

When changes are made inside the AIOSEO dashboard to robots.txt file and saved. I then hit Clear Cache and all of the updates are erased.

I’ve read your post on Cloudflare Firewall rules (https://aioseo.com/docs/aioseo-uses-rest-api/) and updated Cloudflare.

So the conflict is with our Caching plugin (WP-Rocket).

Have you had prior issues with caching plugins and is there a fix?

Thanks.

Second issue:

We migrated from Yoast, and never had an issue with Google fetching the robots.txt file. However, when using Google Webmaster testing tool (https://www.google.com/webmasters/tools/robots-testing-tool), to update the file in Google, we receive the following error:

robots.txt fetch failed
You have a robots.txt file that we are currently unable to fetch. In such cases we stop crawling your site until we get hold of a robots.txt, or fall back to the last known good robots.txt file. Learn more.

The file is accessible at its origin point (domain.com/robots.txt), and we’ve entered the URL into the Google Robots Testing Tool to see if GoobleBot is blocked, and it is Allowed.

Can you shed light on this issue and a fix?

Update: I’ve noticed that when we clear the cache (WP Rocket), we lose all of our robots.txt customizations.

Really helpful. Thank you!

I am having the same issue and this plugin author is unresponsive.

sh-themes & SomethingWonderful,

Thanks for sharing! WooCommerce was the culprit. The issues with WordPress 4.2.3 forcing a secure connection in Chrome were fixed once we updated WooCommerce! Thanks again for your help!

Okay. Thanks. We will purchase the Advanced Targeting extension for mobile disablement capabilities. Would rather wait for the update on the session based cookie. In the meantime we can just set for 1 hour expiration until then.

Do you have an ETA on when the browser session (and possibly hide on mobile functionality) will be available? This is the best popup we’ve found so far — and we’ve tried at least 10. Would like to use it for a current ad campaign we are running on-site.

Okay. Thanks.

Lastly, does this have the option to disable on mobile devices — specifically smartphones?

We are running a DFP rich media ad (i.e. javascript) inside the content and it works great so far, except as such the creative isn’t viewed best on a mobile phone. Is there a way to disable when mobile is used?

Thanks.

We are noticing that it takes 62 seconds to load the cPanel (onload event 62591 ms). Which confirms it is definitely a server-side issue.

I have come to the conclusion that HostGator chronically has server-side issues that they fail to own up to and consistently attempt to blame users for their issues.

As an update,

A HostGator Admin suggested:

“The top suggestions for dealing with this would be to see about optimizing that site as well as possible, along with limiting traffic from crawler bots, which is a significant portion of total traffic, which contributes to the problem.”

We blocked all bots – outside of Google – and surely enough the site is still slow. So, after calling HostGator at least 8 times and speaking to two Supervisors that was the estimation. I called back again today and another rep concluded there is a server error.

Specifically, Apache server error line reads that the application could not execute script … index.php … so it’s reading it as a complete error.

Simply put, do not do business with HostGator. They have a lot of folks that lack the skill to do anything except regurgitate scripted answers and the Admins that actually do have a clue are unreachable to customers. Stay away from HostGator — we will be migrating soon enough.

Hi Mrinal,

Unfortunately the above mentioned code does not work when added to the root wp-config.php file. Thank you for trying. Hopefully someone knows how to fix this issue.