- backend
- vllm
- text-generation-model-1
- pvc
- deployment
- command
- env
- api key
- vllm-text-generation-model-1 parameters dir path
- hf token
- ports
- service
- tei
- text-embedding-model-1
- pvc
- deployment
- args
- env
- api key
- tei-text-embedding-model-1 parameters dir path
- ports
- service
- hf token external secret
- litellm
- database creds external secret
- stateful set
- env
- database username
- database password
- ports
- litellm key external secret
- api key external secret
- config
- litellm key
- database url
- models
- vllm-text-generation-model-1
- vllm-text-generation-model-1 api url
- api key
- tei-text-embedding-model-1
- tei-text-embedding-model-1 api url
- api key
- metric
- deployment
- args
- env
- litellm key
- database url
- database username
- database password
- api key
- ports
- service
- istio
- certificate
- gateway
- virtual service
- service monitor
←Previous
Next→