Skip to content

Custom properties

Custom properties allow you to decorate your repository with information such as compliance frameworks, data sensitivity, or project details.

{'HF_TOKEN': '<YOUR_HUGGINGFACE_ACCESS_TOKEN>'}
env variables
A100
available gpu's are T4, A100, A10
meta-llama
llama-3-1-8b-instruct-gguf
name of the template
inferless-runtime-config.yaml
the runtime file name
PYTORCH
source framework type options PYTORCH, ONNX, TENSORFLOW