Robots.txt File Now Blocks TwitterBot

  • Resolved tmrg

    (@tmrg)


    4 years, 2 months ago

    Hi, my robots.txt file now shows that is blocking Twitterbot. I need to unblock it in order to show rich cards on Twitter.

    This new piece of code is now within Robots.txt file:

    User-agent: Twitterbot
    Disallow: /

    I have uploaded a manual robots.txt file but the plug-in says it could result in conflict and not recommended. How can I remove the above 2 pieces of code from my site: https://www.themetrorailguy.com ?

    Thanks

Viewing 6 replies - 1 through 6 (of 6 total)
  • Plugin Author benjaminprojas

    (@benjaminprojas)

    @tmrg,

    This is not something that is added by AIOSEO. Can you try deactivating other plugins on your site to see if the rule goes away?

    Our robots.txt editor only appends the default rules, we don’t add any that you have not added yourself.

    Can you provide a screenshot of the robots.txt editor?

    Thread Starter tmrg

    (@tmrg)

    Hi, no custom rules have been added. Google’s robot.txt tester says a new version of the file was uploaded Dec 21. I did not do that, so must be an auto update of a plug-in. I checked and no other plug-ins have been updated.

    screenshot: https://i.imgur.com/1yYag1m.png

    If possible, can we please do a zoom call? This is important for me.

    Plugin Author benjaminprojas

    (@benjaminprojas)

    @tmrg,

    That screenshot helps a lot, what you see there is different from what is in the robots.txt file, so something else is adding or appending it.

    Did you try deactivating other plugins to see if it goes away? You would need to verify by opening up your robots.txt file and refreshing after other plugins are deactivated.

    We do offer priority support at our website aioseo.com/contact, so feel free to reach out to us there and just mention this URL so we can connect the dots on this issue.

    Thread Starter tmrg

    (@tmrg)

    Hi, I appreciate the quick response but $199 for premium support is beyond my budget.

    I have 16 plugins. Besides AIO, only Google Kit was updated in the past 2 days. I don’t think Google Kit would have added the code.

    The only 2 plugins which are related to social media are “Jetpack” and “Open Graph and Twitter Card Tags”. None of those have updated nor touched by me.

    Plugin Author benjaminprojas

    (@benjaminprojas)

    @tmrg,

    I completely understand. Regarding the plugins, I’m not seeing anything in the code for the 3 you mentioned and I’m not seeing anything in the code that might cause this. Can you provide me with the other 13 plugins so I can check those out as well?

    If you want to keep your plugin list confidential, feel free to send us a contact at aioseo.com/contact and we can take a look at them there.

    Thread Starter tmrg

    (@tmrg)

    Thanks – I have sent the list over via the contact form.

Viewing 6 replies - 1 through 6 (of 6 total)
  • The topic ‘Robots.txt File Now Blocks TwitterBot’ is closed to new replies.