Viewing 4 replies - 1 through 4 (of 4 total)
  • Plugin Author bestwebsoft

    (@bestwebsoft)

    Hi,

    Could you please provide robots.txt file or its screenshot abd a screenshot of the plugin’s page so that we could analyze the problem?

    Sincerely,
    BestWebSoft Support Team

    Thread Starter davide81

    (@davide81)

    Hi, the robots.txt file is:

    User-agent: *
    Disallow: /wp-admin/
    Disallow: /wp-includes/
    Sitemap: /sitemap.xml

    but it should be

    User-agent: *
    Disallow: /wp-admin/
    Disallow: /wp-includes/
    Sitemap: https://www.mywebsite.com/sitemap.xml

    In the plugin setting page I flagged this option: “I want to add sitemap file path in robots.txt”

    Best regards

    Thread Starter davide81

    (@davide81)

    Hi there! I just installed the new plugin version 2.8.6.

    The file robots.txt now is changed from:

    User-agent: *
    Disallow: /wp-admin/
    Disallow: /wp-includes/
    Sitemap: /sitemap.xml

    to

    User-agent: *
    Disallow: /wp-admin/
    Disallow: /wp-includes/
    Sitemap: sitemap.xml

    Unfortunately the problem with Google Webmaster Tool is still present and returns:
    “Line 4: Your Sitemap contains an invalid URL. ” ==> Sitemap: sitemap.xml

    I give a fast look into the code.

    To fix the problem I use this workaround to add the complete URL to robots.txt:

    Line 562

    //$site_url = parse_url( site_url() );
    //$path = ( ! empty( $site_url['path'] ) ) ? $site_url['path'] : '';
    $path = home_url('/');

    now the file return the complete URL path:

    User-agent: *
    Disallow: /wp-admin/
    Disallow: /wp-includes/
    Sitemap: https://www.myDomainName.xx/sitemap.xml

    After upgrade the plugin file the google problem is fixed.
    Do you thing that this option can be added in the next version?

    Best regards and thanks a lot for your help.

    Plugin Author bestwebsoft

    (@bestwebsoft)

    Hi,

    After updating the plugin you removed the line

    Sitemap: sitemap.xml

    in the robots.txt file.
    The thing is that the plugin checks if this line is present in the robots.txt file and does not re-write it. Could you please provide a link to the site?

    Sincerely,
    BestWebSoft Support Team

Viewing 4 replies - 1 through 4 (of 4 total)
  • The topic ‘robots.txt sitemap URL’ is closed to new replies.