Refresh interval

  • Resolved HoeFinidyGeorges

    (@allemachines)


    4 years, 3 months ago

    Hello,

    We have bought the elite package and can’t find another place where we can ask this question.

    By now we have a lot of feeds activated. We have about 80k+ products in our woocommerce shops, so cpu usage controle is everything for us.

    Your plugin is relatively slow, to generate one feed takes about 45 minutes. So in order to reduce the cpu usage of our servers, we activated daily refreshes, all seperated.

    However, every time the daily refresh is at 1 specific time in a day and ALL the feeds start refreshing. Which is, as you can imagine, terrible for server performance.

    We need a way to schedule refreshes based on our wishes. No feed should be allowed to refresh at the same time. How do we do this?

    P.S. where do we find tips/tricks to speed up the process of making an xml for 80k+ products?

    Kind regards

Viewing 3 replies - 1 through 3 (of 3 total)

  • Hi,

    Thanks for using our plugin and reaching out to us.

    Let me try answering your questions:
    Unfortunately, due to WordPress wp-cron limitations, not possible to schedule the processing of feeds on different times. I understand that this might cause an unwanted burden on your server performance and CPU, that is why we developed the batch size feature. You can lower the batch size so the product feed processes less products per batch and thus puts less of a strain on your server. The consequence of that however is that the feed processing will take more time.

    Please see:
    https://adtribes.io/batch-size-configuration-product-feed/

    Hope this helps somewhat?

    Thread Starter HoeFinidyGeorges

    (@allemachines)

    Hello,

    Thank you for your response!

    By lowering the batch size it indeed will lower the burden on server performance but also lowers the speed. Obviously. A normal batch would be at 2500. This would be ok for 1 feed with 80k+ products. We have about 25 feeds running, so that would mean that the batch size would have to become 100 so that all feeds can run simultatiously. Thats not preferred. We’d rather run each one on 2500 for about 35-45 minutes and then start the next.

    I don’t really understand what you mean about the wp-cron limitations, I can set unlimited cron jobs spread over the whole day. Why is that impossible for you? Also, many other plugins like Wp All Import etc have a proper scheduling option for each feed/batch/import. Also on wp-cron. Please, could you explain this a little more?

    Kind regards

    Thread Starter HoeFinidyGeorges

    (@allemachines)

    Hello,

    Lowering the batch size is not really helping. Although it may be not possible to schedule seperate cron jobs for each feed, would it be possible to schedule the cron job to after midnight? For example at 03:00 when its less crowded on our sites. Now it runs during the day and slows down the site for customers.

    Thank you.

    Kind regards

Viewing 3 replies - 1 through 3 (of 3 total)
  • The topic ‘Refresh interval’ is closed to new replies.