Wordfence seems to block google pagespeed insights.

I just checked, worked fine for me. That said, Gtmetrix.com is perhaps much better, perhaps your customer could use that instead? MTN

Hi @salocinten,
If you are using Google Webmasters tools, can you see any crawl errors there?
What about “Fetch as Google” test?

Thanks.

Hi @wfalaa,

We tried to use a “View as Googlebot” and it encountered the 503 error of site access limitation.

I guess there is some issue there about this which we have already tried by raising the limit and enabling for all Google crawler URLs.

Please share a screenshot showing “Fetch as Google” test result.

Thanks.

Hi @wfalaa,

We are unable to do that because site verification itself times out…

Verification failed for https://…./ using the HTML file method (less than a minute ago). The connection to your server timed out.
Verify your ownership of https://…../.

Our customer has noticed this as well and would like a solution or a workaround.

Thank you.

Hi @wfalaa,

Further information.

If the robots.txt of the site was analyzed, it gave the following warning: –

The official standard does not include Allow directive even though major crawlers (Google and Bing) support it. If both Disallow and Allow clauses apply to a URL, the most specific rule – the longest rule – applies. To be on the safe side, in order to be compatible to all robots, if one wants to allow single files inside an otherwise disallowed directory, it is necessary to place the Allow directive(s) first, followed by the Disallow. It is still nonstandard.

Warnings Detected: 1

Errors Detected: 0

robots.txt source code for https://

Line Code
1 User-agent: *
2[RED] Disallow: /wp-admin/
3[WARN] Allow: /wp-admin/admin-ajax.php
4

I need to know your website link for further investigation, if you can’t share it here on the forum, feel free to email me at “alaa [at] wordfence [dot] com”, also may I ask if you are using “Country Blocking” feature or not?

Knowing that, our premium customers can always open a ticket at https://support.wordfence.com , if you don’t have a ticket opened there yet regarding this question then please do and we will be glad to help you further.

Thanks.

Noted with thanks.

Will be emailing you about it.

Thank you.