You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: content/manuals/ai/compose/models-and-compose.md
+21Lines changed: 21 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -333,6 +333,27 @@ models:
333
333
- "0.9"
334
334
```
335
335
336
+
### Embeddings
337
+
338
+
When using embedding models with the `/v1/embeddings` endpoint, you must include the `--embeddings` runtime flag for the model to be properly configured.
339
+
340
+
```yaml
341
+
services:
342
+
app:
343
+
image: app
344
+
models:
345
+
embedding_model:
346
+
endpoint_var: EMBEDDING_URL
347
+
model_var: EMBEDDING_MODEL
348
+
349
+
models:
350
+
embedding_model:
351
+
model: ai/all-minilm
352
+
context_size: 2048
353
+
runtime_flags:
354
+
- "--embeddings" # Required for embedding models
355
+
```
356
+
336
357
## Alternative configuration with provider services
0 commit comments