Cannot change the robots

  • Hi,

    I’m uploading sitemap on webmaster for SEO, but the url is always limited by robots.

    I tried to change edit the robots by WP Robots Txt plugin, and I edited it to
    User-agent: *
    Disallow:

    View post on imgur.com

    But the robots still didn’t change and some pages are still limited by robots, https://18hall.com/robots.txt

    Is there other solution for the problem?

    Thanks!

    The page I need help with: [log in to see the link]

Viewing 1 replies (of 1 total)

  • For me I’m getting this in robots.txt:

    
#
# Added by Google
# Modify or delete lines below to allow robots to crawl your site.
# Block all robots
User-agent: *
Disallow: /

    Is this not correct then? I’m not quite sure what end result you’re going for?

    • This reply was modified 6 years, 9 months ago by AshboDev.
Viewing 1 replies (of 1 total)
  • The topic ‘Cannot change the robots’ is closed to new replies.