Default LLM ... not found in available models: []

[syedyusufh]

Env:
Spring Boot 4.0.2
Spring AI: 2.0.0-M2
Embabel: 0.3.3

I have a custom ChatModel and ChatClient beans defined based on the enterprise's custom api-key and base-url for OpenAI GPT-4o

When starting the Embabel Agent Spring Boot Application I get the below error,

Defaltt LLM 'gpt-4o' not found in available models: []

[igordayen]

may i inquire whether you included dependency on openai starter:

embabel-agent/embabel-agent-starters/embabel-agent-starter-openai

Thank you

[johnsonr]

Also, Spring Boot 4.0.2 is not yet supported...It may work but we haven't tested it

[syedyusufh]

@igordayen yes, have included all the said dependencies. Tried debugging, however SpringAiLlmService class wasn't invoked, which would have provided the configured ChatModel bean.

@johnsonr Also tried downgrading to Spring Boot 3.5.10, still the same.

[alexheifetz]

@syedyusufh please elaborate on how did you put together Custom ChatModel Bean

Please Note:
Embabel Model Provider is designed to detect ChatModel wrapped as com.embabel.agent.spi.LlmService only.

Meaning, if you have something like:

@Bean 
org.springframework.ai.chat.model.ChatModel myCustomModel() {}

This would not work.

There are other means to construct custom OpenAI compatible models either
declaratively with one of our out-of-box Starters ( embabel-agent-starter-openai, or embabel-agent-starter-openai-custom ),
or programmatically by utilizing com.embabel.agent.openai.OpenAiCompatibleModelFactory

[syedyusufh]

Yes, I have a bean of type org.springframework.ai.chat.model.ChatModel.

Thanks, let me check com.embabel.agent.openai.OpenAiCompatibleModelFactory

[alexheifetz]

Cool. There are few places you can find reference code:

https://github.com/embabel/embabel-agent/blob/main/embabel-agent-autoconfigure/models/embabel-agent-openai-custom-autoconfigure/src/main/kotlin/com/embabel/agent/config/models/openai/custom/OpenAiCustomModelsConfig.kt

https://github.com/embabel/embabel-agent/blob/main/embabel-agent-autoconfigure/models/embabel-agent-openai-autoconfigure/src/main/kotlin/com/embabel/agent/config/models/openai/OpenAiModelsConfig.kt

[syedyusufh]

Thanks @alexheifetz issue stands resolved.

[johnsonr]

Converting to a discussion, as this does not seem like a bug or enhancement request.