Custom providers

[waynetheron]

I'm not sure if this is possible (YET). I am behind an enterprise firewall, and we cannot directly connect to the usual providers. We have an in-house-built AI proxy that passes through messages and handles authentication with an Azure OpenAI endpoint. It would be great if there were something like a provider trait where we could implement a custom provider.

[joshua-mo-143]

Hi, this actually already exists.

Here is some documentation on this: https://docs.rig.rs/guides/extension/write_your_own_provider

If you need generic HTTP client usage as well, we have a helper trait (HttpClientExt) which you can use to do this. Some documentation still needs to be written on it, but at the moment you can infer usage from our official model provider source code.

If you have any other questions, please let us know!

[waynetheron]

No idea how I missed the guides section. Was looking at the core crate docs. Thanks you are a champ

Loving Rig