Good plugin, but not good for customized chatbot

  • To customize chatGPT for task specific for your site you need to focus on good prompt engineering and provide well structured context to model. The plugin removes many characters that are used (as a “good practice”) for structuring the inputs (“\”, eol, …) and thus it is almost not usable if you need chatbot with more complex context. You will never get similar results as in OpenAI playground or while directly using Python library openai.

Viewing 3 replies - 1 through 3 (of 3 total)
  • Plugin Author senols

    (@senols)

    Hello @lukaskot,

    Thank you for your feedback.

    I am eager to learn more about the issue you are experiencing.

    As far as I know, our plugin doesn’t remove any special characters when sending them to OpenAI. For instance, below is the context that we are using on our website:

    “You are a helpful AI assistant, named Lisa. Your primary purpose is to provide accurate, relevant, and helpful information exclusively about the AI Power WordPress plugin. If a user asks a question or initiates a discussion that is not directly related to the plugin or its features, functionalities, and usage, do not provide an answer or engage in the conversation. Instead, politely redirect the user’s focus back to the AI Power plugin by providing the documentation link (https://docs.aipower.org). Your expertise is limited to the website’s content and specifically the AI Power plugin. Avoid providing information or suggestions on topics that fall outside the scope of the AI Power plugin.“

    Could you please share your context with me or provide an example so I can test it?

    Thread Starter lukaskot

    (@lukaskot)

    Thanks for the reaction. Just add there (to additional context menu) for instance there “\” and eol (structure it in paragraphs):
    “You are a helpful AI assistant, named Lisa.\

    Your primary purpose is to provide accurate, relevant, and helpful information exclusively about the AI Power WordPress plugin. If a user asks a question or initiates .. \

    …. “

    save it and reopen it. “\” are and eol are removed. Maybe I am wrong, but for context it can make huge difference in chatgpt output. With the exactly same context, and same parameters, I am not able to achieve comparable behaviour in AIpower plugin and in openai playground (in playground it provides much more precise answers and it behaves in way we need).

    For more complex tasks it is recommended to use more structured context, see e.g. https://platform.openai.com/docs/guides/gpt-best-practices/strategy-split-complex-tasks-into-simpler-subtasks

    In my case, structured context are saved as string with some special characters and line breaks removed which AFAIK makes chatgpt answer much more confused and it is also makes quite hard to edit in the additional context window.

    • This reply was modified 1 year, 4 months ago by lukaskot.
    Plugin Author senols

    (@senols)

    Hi @lukaskot

    I’ve just made a test and you are right. I think it is only removing \ and eol and I know the reason. You are absolutely right that these small things have huge impact to the response and I am definitely going to fix this. Thanks a lot for reporting this. I have also noted your comment about window size. I will look into that too.

Viewing 3 replies - 1 through 3 (of 3 total)
  • The topic ‘Good plugin, but not good for customized chatbot’ is closed to new replies.

Tags