High CPU Usage when updating feed

  • Resolved richesnrags

    (@richesnrags)


    5 years, 7 months ago

    Recently my CPU usage has been maxing out on my server and we have narrowed it down to this plugin. Its randomly happening but yesterday when we manually updated the feed it spiked and we were able to single the cause out. see below for the logs from the host

    We have 57 active products on the site and in the feed I was updating there are 18 products

    According to my host, So far for the first 10 days of July the plugin generated 16315 hits which according to them is not normal activity for a plugin.

    [email protected] [~/logs]# zcat domain.com-ssl_log-Jul-2019.gz | grep “page=woosea_manage_feed” | wc -l 16315

    According to this one the plugin used 44 hits during a 1 second period originating from my IP address.

    [email protected] [~/logs]# zcat domain.com-ssl_log-Jul-2019.gz | grep 66.215.202.214 | grep feed | grep 10/Jul/2019:18:49:56 | wc -l 44

    and here are a few of the logs during that 1 second

    66.215.202.214 – – [10/Jul/2019:18:49:56 -0500] “POST /wp-admin/admin-ajax.php HTTP/1.0” 500 1862 “https://www.domain.com/wp-admin/admin.php?page=woosea_manage_feed” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/75.0.3770.100 Safari/537.36”
    66.215.202.214 – – [10/Jul/2019:18:49:56 -0500] “POST /wp-admin/admin-ajax.php HTTP/1.0” 500 1862 “https://www.domain.com/wp-admin/admin.php?page=woosea_manage_feed” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/75.0.3770.100 Safari/537.36”
    66.215.202.214 – – [10/Jul/2019:18:49:56 -0500] “POST /wp-admin/admin-ajax.php HTTP/1.0” 500 1862 “https://www.domain.com/wp-admin/admin.php?page=woosea_manage_feed” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/75.0.3770.100 Safari/537.36”
    66.215.202.214 – – [10/Jul/2019:18:49:56 -0500] “POST /wp-admin/admin-ajax.php HTTP/1.0” 500 1862 “https://www.domain.com/wp-admin/admin.php?page=woosea_manage_feed” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/75.0.3770.100 Safari/537.36”
    66.215.202.214 – – [10/Jul/2019:18:49:56 -0500] “POST /wp-admin/admin-ajax.php HTTP/1.0” 500 1862 “https://www.domain.com/wp-admin/admin.php?page=woosea_manage_feed” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/75.0.3770.100 Safari/537.36”
    66.215.202.214 – – [10/Jul/2019:18:49:56 -0500] “POST /wp-admin/admin-ajax.php HTTP/1.0” 500 1862 “https://www.domain.com/wp-admin/admin.php?page=woosea_manage_feed” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/75.0.3770.100 Safari/537.36”
    66.215.202.214 – – [10/Jul/2019:18:49:56 -0500] “POST /wp-admin/admin-ajax.php HTTP/1.0” 500 1862 “https://www.domain.com/wp-admin/admin.php?page=woosea_manage_feed” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/75.0.3770.100 Safari/537.36”
    66.215.202.214 – – [10/Jul/2019:18:49:56 -0500] “POST /wp-admin/admin-ajax.php HTTP/1.0” 500 1862 “https://www.domain.com/wp-admin/admin.php?page=woosea_manage_feed” “Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/75.0.3770.100 Safari/537.36”

    Please let me know your thoughts and if there is any other information you need from the host

    Thank you

Viewing 2 replies - 1 through 2 (of 2 total)

  • Hi richesnrags,

    Thanks for using our plugin and reaching out to us. First, let me explain some of the inner working of our plugin:

    First:
    Depending on the amount of feeds you configured the plugin will automatically check what the status of the feed(s) are. When the feed is on “processing” the browser will automatically keep checking if the percentage needs to increase or not. When the status of the feed(s) are on ready it will do the check only once. The plugin will only do this check if you, as a user, are logged in on your WP-admin section and the browser is open on the manage feeds section. Those are actually the requests you copied/pasted above. Those request are really low on server resources as they are AJAX request made via the browser and only request a really minimum amount of data.

    Secondly:
    This is were you are experiencing the server load. When the plugin is processing the product feed it will load batches of products into memory before it can output it to the product feed(s) / XML’s. This is causing peaks in the memory usage but they should be very short peaks. Our plugin is designed as such that it creates (small) batches of products which it outputs to the feed. The size of these batches depend on your server-configuration, PHP-version and amount of products and attributes you have configured. Unfortunately there is no way around this, any feed plugin will cause the same peaks in memory.

    Hope this answers your question?

    Best,
    Eva

    Hi,

    Assuming the issue at hand has been resolved and/or our support is no longer required I am going to close this topic for housekeeping reasons now.

    Please do not hesitate to reach out again whenever you need our help.

    All the best,
    Eva

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘High CPU Usage when updating feed’ is closed to new replies.