GSC Error Link

Hello @pexel

What other details say the browser console about those entries?

Best regards.

Hello,

On the GSC (Google Search Console) screen; Under the page count; “Indexed – currently not in the index” “Blocked by robots.txt”

I am seeing hundreds of thousands of such links being created. Additionally, these issues started on July 22. This type of link is also being indexed.

A form screen appears with no explanation: ?cff-form=44&cff-form-target=_top&_nonce=ee38f13488&cff_iframe=cff-iframe-668d6e5c042bd.

Let me know if you need any more help with this!

Hello @pexel

That is not a problem. You are loading the form directly into iframe tags whose URLs are generated dynamically with additional parameters to prevent they can be cached by third-party plugins. But as these URLs are generated dynamically they are not listed in the index file on your website or included in the robots.txt to be indexed by search engine crawlers. But that is correct.

Best regards.

Unfortunately, it is currently being indexed, and there are examples in the index. Even though there is a robots.txt file, there is a section on the GSC screen showing that it has been indexed.

Picture : Indexed even though it is blocked by robots.txt
This is a non-critical issue. Pages with these issues will be indexed, but their search result appearance may be improved

Google Index Image is at the bottom.

Hello @pexel

In this case, you can exclude them via the robots.txt file to exclude URLs with the cff-form parameter:

Disallow: /*?cff-form=*

Best regards.

Hello,

We already have this tag (Disallow: *?*), but the exact issue is as follows:

When visiting the page https://www.xxx.com/?cff-form=1, there used to be a title and a description explaining the form. It was indexed and represented a form.

In the current situation, https://www.xxx.com/?cff-form=44&cff-form-target=_top&_nonce=ee38f13488&cff_iframe=cff-iframe-668d6e5c042bd produces something after the form is submitted. Even if we block them, thousands of links are being created. Currently, there are 11,400 of these links.

Despite the robots.txt file, these URLs are being indexed, which is destroying the site’s crawl budget. I believe this issue might be software-related since we haven’t made any modifications to the plugin. The first thing that comes to my mind is whether the automatic height adjustment might be causing this issue.

Thank you.

• This reply was modified 4 months ago by pexel.

Hello @pexel

What I don’t understand is why the crawler is ignoring your robots.txt file.

The height registration occurs via post, not get.

Do you ticked the “Do not load the forms with crawlers” checkbox via the “Calculated Fields Form > Troubleshoots Area & General Settings” menu option?

Best regards.

No, that box is not checked.

Picture show

Do not load the forms with crawlers
* The forms are not loaded when website is being indexed by searchers.
Do we mark the last part?

Hello @pexel

Yes, please. Tick the checkbox.

Best regards.

Hello;
Blocked by robots.txt. page continues to rise rapidly, producing an average of 200-300 links every day. Why does it produce so many pages even though these pages are defined as meta, robots.txt and remove URL option to be added to the index? It harms the crawl budget. Do you have any ideas? I have been reviewing it for 3-4 days, but it continues to grow on the Google Search Console screen even though it is not added to the index.

• This reply was modified 3 months, 3 weeks ago by pexel.

Hello @pexel

That makes no sense if you entered in the robots.txt the rule for blocking URLs with the https://www.xxx.com/?cff-form=* structure.

However, if you prefer to disable the option for updating the form’s height, please, follow the steps below:

Open the “/wp-content/plugins/calculated-fields-form/js/fbuilder-pro-public.jquery.js” file with the text editor of your choice:

Go to the piece of code:

$.post(
	document.location.href,
	{
		'cffaction'     : 'cff_register_height',
		'form_height'	: f.height(),
		'screen_width'	: $(window).width(),
		'form'	 		: id,
		'_nonce'		: nonce
	}
);

and edit it as follows:

/*****
$.post(
	document.location.href,
	{
		'cffaction'     : 'cff_register_height',
		'form_height'	: f.height(),
		'screen_width'	: $(window).width(),
		'form'	 		: id,
		'_nonce'		: nonce
	}
);
*****/

Go to the “Calculated Fields Form > Troubleshoot Area & General Settings”, untick the “JavaScript Cache” option, and press the “Update” button.

Finally, purge your website and browser caches.

Best regards.