Jetpack, please stop crawling my domain!!!

  • Resolved amongthieves

    (@amongthieves)


    3 years, 11 months ago

    So i had installed Jetpack many ages ago, and for some reason, it has indexed my entire domain and every single folder. This is a problem as i a constantly creating staging sites to test plugin and theme updates, these staging sites are entire copies of my current site. They are only online for maybe 24-48 hours but jetpack somehow finds the folder and then is crawls it over and over, even after ive deleted it. I just checked 2 minutes ago and Jetpack is crawling old staging sites from over a year ago, still. According to cloudflare.com Jetpack is connecting to my server over 600 times a day. What the hell? Please remove my entire domain from your web crawling, i want nothing to do with Jetpack and its hogging up my servers resources for something i am not using.

    • This topic was modified 3 years, 11 months ago by amongthieves.

    The page I need help with: [log in to see the link]

Viewing 3 replies - 1 through 3 (of 3 total)
  • Plugin Support Bruce (a11n)

    (@bruceallen)

    Happiness Engineer

    Hi @amongthieves

    I believe we have now removed all instances and connections from our end. Can you let us know if you continue to have the issue?

    Thank!

    Thread Starter amongthieves

    (@amongthieves)

    Nope, it is still just as bad as it was before.

    Here is a picture of my cloudflare showing 2 different sub folders being searched for just 2 minutes ago, and within seconds of each other. These staging sites only existed for less then 24 hours, over 12 months ago.

    View post on imgur.com

    • This reply was modified 3 years, 10 months ago by amongthieves.
    Plugin Support Bruce (a11n)

    (@bruceallen)

    Happiness Engineer

    Hi @amongthieves

    Thanks for the screenshot. We had the devs take a look and these should be turned off now. Please let us know is this is not the case.

Viewing 3 replies - 1 through 3 (of 3 total)
  • The topic ‘Jetpack, please stop crawling my domain!!!’ is closed to new replies.