Chat timing out

  • Resolved mrbosch

    (@mrbosch)


    7 months ago

    Hi, I’ve recently installed the plugin and embedded it successfuly on my website. The chatbots primary use will be to interact with visitors based on the trained assistant. However, I’ve run into an issue. Whilst the assistant works perfectly in terms of its trained outputs in the assistant page. Through the plug in it eventually time outs about half way through an interaction with an error message that says:

    “Error: timeoutOops! This request timed out. Please try again”.

    I checked the API Test Results and everything is connected fine.
    API STATUS: Success: Connection to the OpenAI API was successful!

    I’ve got enough tokens so its not that. I’ve also tried running the plug in with the maximum timeout and am using GPT4 Turbo as I though other versions might be slowing it down.

    I’m not sure what left to try to stop it timing out? Any help would be greatly appreciated!!

Viewing 4 replies - 1 through 4 (of 4 total)
  • Plugin Author kognetiks

    (@kognetiks)

    Hello mrbosch (@mrbosch)

    In the Chatbot Settings on the API/Model page at the very botton is a setting for “Timeout Setting (in seconds).” The setting should default to 360 seconds, but, your solution might require a longer time period. Can you try increasing this value to say 420 and try again?

    Rereading your post, maybe you’ve tried this already. If so, here are some other ideas.

    Can you create a simple assistant that doesn’t do anything in particular and add it to a test page to make sure there is not any other problem with accessing assistants?

    Stephen

    • This reply was modified 7 months ago by kognetiks.
    Thread Starter mrbosch

    (@mrbosch)

    Hi Stephen many thanks for you reply. I’ve tried increasing the timeout settings, even all the way to the max and eventually it just times out anyway with the error message.

    I did try the simple assistant which worked perfectly. As mentioned the assistant when accessed via the direct OpenAI tab worked normally with no lag or time out issues. I’m scratching my head!

    Plugin Author kognetiks

    (@kognetiks)

    Hello mrbosch (@mrbosch),

    Thank you for the additional information and the results from testing using a simple assistant.

    The next thing to look at might be the Model that you’re using with the Assistant.

    On the OpenAI platform, Assistants using GPT-3 and earlier models there are some instances where the OpenAI API doesn’t work as expected.

    What model have you set in the Assistant? If not one of the gpt-4 series, try changing the model to gpt-4-0125-preview or gpt-4-turbo-2024-04-09.

    I’ve had good success with both of those models.

    Let me know what you learn.

    Stephen

    Thread Starter mrbosch

    (@mrbosch)

    Hi Stephen, thanks again and for replying so quickly, I’ve been trying the different versions and previously Turbo wasn’t appearing in assistant but today it was. The change in assisant has improved the response time. Still a few minor niggles but that’s on the assistant end. I’ll mark as resolved and best of luck with the continued development of the plugin – great work so far.

Viewing 4 replies - 1 through 4 (of 4 total)
  • The topic ‘Chat timing out’ is closed to new replies.

Tags