[BUG]Improve UX for integrating Private/Local LLMs (e.g., vLLM, Ollama)

## Describe the bug
A clear and concise description of what the bug is.

## To Reproduce
Steps to reproduce the behavior:
1. Go to '...'
2. Click on '....'
3. Scroll down to '....'
4. See error

## Screenshots & Logs
If applicable, add screenshots to help explain your problem.

## Additional context
 - OS: [e.g. iOS]
 - Browser [e.g. chrome, safari]
 - Version [e.g. 22]
