Super slow chat replies (up to 60 sec)

  • Resolved npvb

    (@npvb)


    1 year, 5 months ago

    Hi! I’ve connected ChatGPT via API and it’s working. However, the chat responses take forever to populate: 20-60 sec. I’m wondering what could be the issue(s)? Any ideas to speed up the chat replies? Thanks!

Viewing 1 replies (of 1 total)
  • Plugin Support Val Meow

    (@valwa)

    Hey @npvb ??

    The plugin is not responsible for it; execution takes just a very few milliseconds on the plugin side. The problem is the distance between you and your server, as well as between your server and OpenAI’s server, and then the availability of OpenAI.

    Make sure that your server is not slow either; if you have a lot of plugins installed and doing things, that will also slow down the time before the AI Engine actually starts interpreting the request.

    But performance-wise, it is on the networking side. If you are using Embeddings, making multiple requests, sending big requests, passing security filters, and so on, it will increase the requesting time.

    Hope this helps ??

Viewing 1 replies (of 1 total)
  • The topic ‘Super slow chat replies (up to 60 sec)’ is closed to new replies.

Tags