How to configure AI Engine to connect to other LLM servers ?

Dear All,

How can I configure the IP Address or URL in settings of the AI Engine to connect to one of other LLM servers such as Ollama ?

Thanks !

Best Regards. Cloud

Hi @cloudchan,

It’s not possible; actually, only the Messages API is similar, but the API in its entirely is not. Auth, getting models, etc, this is not totally the same. Modifying the URL only wouldn’t be enough. I think I will add Ollama as an add-on, at some point soon ??

Dear Jordy,

Thanks for your reply & promise for adding Ollama to AI Engine !

That’s good news because we can connect to our trained LlaMa2 or LlaMa3 LLM via AI Engine.

According to https://ollama.com/blog/openai-compatibility and https://github.com/ollama/ollama/blob/main/docs/openai.md, we can use the OpenAI?Chat Completions API on the Ollama Server.

Is it possible to make current version of AI Engine to allow us to enter the Server IP or URL of the Ollama Server before your new version if we only use the Chat Completions API ?

Thanks !

Best Regards. Cloud