Virtual robots.txt blocks site from google

  • Hi!

    Somehow a virtual robots.txt is blocking the site https://www.domda.se from google search.

    The site is open for search engines in the Integrity settings (of course ??

    I have tried:

      Turning the privacy setting/search engine allowance off and on again.
      Turning all the plugins off.
      Adding a totally allowing robots.txt to the root directory.
      Using a robot plugin to write what should be in robots.txt

    Now I wonder if someone can help me. The robot doing code in wp-includes/functions.php says:

    function do_robots() {
	header( 'Content-Type: text/plain; charset=utf-8' );

	do_action( 'do_robotstxt' );

	$output = "User-agent: *\n";
	$public = get_option( 'blog_public' );
	if ( '0' == $public ) {
		$output .= "Disallow: /\n";
	} else {
		$site_url = parse_url( site_url() );
		$path = ( !empty( $site_url['path'] ) ) ? $site_url['path'] : '';
		$output .= "Disallow: $path/wp-admin/\n";
		$output .= "Disallow: $path/wp-includes/\n";
	}

	echo apply_filters('robots_txt', $output, $public);
}

    I hope someone can help.

Viewing 10 replies - 1 through 10 (of 10 total)

  • Somehow a virtual robots.txt is blocking the site https://www.domda.se from google search.

    Why do you think that? I cannot find anything on your site that is blocking bots.

    Thread Starter fortes – illustration

    (@fortes-illustration)

    When I search for domda.se in google it says that a robots.txt is blocking the info

    Thread Starter fortes – illustration

    (@fortes-illustration)

    More correctly google says that the robots.txt file is blocking the description of the site.

    This isn’t a core WordPress issue. Have you tried:

    – deactivating all plugins to see if this resolves the problem. If this works, re-activate the plugins one by one until you find the problematic plugin(s).

    – switching to the Twenty Eleven theme to rule out any theme-specific problems.

    – resetting the plugins folder by FTP or PhpMyAdmin. Sometimes, an apparently inactive plugin can still cause problems.

    Thread Starter fortes – illustration

    (@fortes-illustration)

    I’ve tried everything on your list and the problem is still there.

    Do you have a Google Webmaster account?

    Thread Starter fortes – illustration

    (@fortes-illustration)

    Yes

    Have you checked in there for any clues? Have you asked Google to re-index the site? are you submitting a Google sitemap. Bear in mind that it can take up to 90 days for Google to re-index a site naturally.

    Hello Mam
    How Are You Today Please I Really Want To Start Programing,I Know Noting Of It Please Can You Put Me True A Bit? Please? I Beg You In The Name Of GOD Almighty ? Please? Not More Than This For Now And I Await Your Enthusiastic Response Imminently.
    Regards
    Optimist1

    @ptimist1: It is impolite to interrupt another poster’s ongoing thread with a question of your own and it causes significant problems for the forum’s volunteers. Please post your own topic.

Viewing 10 replies - 1 through 10 (of 10 total)
  • The topic ‘Virtual robots.txt blocks site from google’ is closed to new replies.