Feature Request: Support for Custom API Endpoint #39
Description
I have locally deployed LLM and other API services, all encapsulated in the OpenAI format.
Would it be able to use these services instead of relying solely on OpenAI?
{{ message }}
I have locally deployed LLM and other API services, all encapsulated in the OpenAI format.
Would it be able to use these services instead of relying solely on OpenAI?