How to add a user agent to allowlist in robots.txt

  • Resolved oscyp

    (@oscyp)


    5 months ago

    I am trying to setup a facebook login but my site is giving a 403 error for facebookexternalhit?agent. How to add it to allowlist using AIOS? Here is the error:

    Response Code: 403

    Response Code Reason: This response code could be due to a robots.txt block. Please allowlist facebookexternalhit on your sites robots.txt config to utilize Facebook scraping

Viewing 1 replies (of 1 total)
  • Plugin Support hjogiupdraftplus

    (@hjogiupdraftplus)

    Hi @oscyp,

    AIOS do not have setting for robots.txt to allow or disallow user agent,

    You should check SEO related plugin for that.

    Regards

Viewing 1 replies (of 1 total)
  • You must be logged in to reply to this topic.