what is the blocked addreesses in google webmaster by robots,txt

  • hi this is my robots.txt file

    User-agent: *
    Disallow: /cgi-bin/
    Disallow: /themes/
    Disallow: /wp-includes/
    Disallow: /wp-admin/
    Disallow: /wp-config.php
    Disallow: /wp-cron.php
    Disallow: /wp-login.php
    Disallow: /wp-content/languages/
    Disallow: /wp-content/plugins/
    Disallow: /wp-content/upgrade/
    Disallow: /wp-content/w3tc/

    Sitemap: https://foxit.ir/sitemap.xml

    and i have 476 blocked address
    is this normal

Viewing 2 replies - 1 through 2 (of 2 total)

  • If any of the blocked addresses is something that you want search engine to crawl, then it is not working fine for you.

    Thread Starter javadth

    (@javadth)

    so i want to know what is the addreesess i have dissallowed in this robots
    is important ?

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘what is the blocked addreesses in google webmaster by robots,txt’ is closed to new replies.