Robots.txt file has format errors/ Malformed robots.txt

  • Resolved fortis1

    (@fortis1)


    2 years, 6 months ago

    Hello,
    Robots.txt file shows error: Malformed robots.txt <!– WP Optimize page cache – https://getwpo.com – page NOT cached because: Output is too small (less than 255 bytes) to be worth caching –>
    How can I fix this ? Can you please help me

    The page I need help with: [log in to see the link]

Viewing 1 replies (of 1 total)
  • Plugin Contributor Venkat Raj

    (@webulous)

    Hello @fortis1

    I’m not sure how robots.txt ended up with this content. We don’t write any comments to that file except this line Disallow: /wp-content/uploads/wpo-plugins-tables-list.json

    Besides when considering headers serving robots.txt should be greater than 255 bytes.

    To fix you need to manually edit the file and remove the unwanted content.

    Turn off debugging mode define('WP_DEBUG', false);

    If problem persist, You may even add robots.txt to Dashboard => Cache => Advanced Settings => URLs to exclude from caching textbox.

    I tried to create this problem at my end without success. So, if you could write down the steps to reproduce the issue, we can dive deep and fix the root cause.

Viewing 1 replies (of 1 total)
  • The topic ‘Robots.txt file has format errors/ Malformed robots.txt’ is closed to new replies.