List LLMs
Retrieves a list of LLM configurations accessible to the caller, with optional filtering.
PERMISSION-BASED FILTERING: With LIST_LLM_OWN permission, you can only see your own LLMs (ownerId filter is ignored if set to another user). With LIST_LLM_ANY permission, you can see all LLMs or filter by any ownerId. This is a read-only operation with no side effects.
In: header
Query Parameters
Filter LLMs by owner ID. With LIST_LLM_ANY permission, omitting this shows all accessible LLMs; providing it filters by that owner. With LIST_LLM_OWN permission, only your own LLMs are shown regardless of this parameter.
Filter LLMs by provider type (e.g., OPENAI, VLLM, OLLAMA, etc.)
Filter by label value. Multiple label filters can be specified (e.g., ?label.environment=production&label.team=ai)
Response Body
curl -X GET "http://localhost:8080/v1/llms?ownerId=550e8400-e29b-41d4-a716-446655440000&providerType=OPENAI&label.*=%3Flabel.environment%3Dproduction%26label.team%3Dai"{
"llms": [
{
"llmId": "550e8400-e29b-41d4-a716-446655440000",
"displayName": "GPT-4 Turbo",
"description": "OpenAI's GPT-4 Turbo model for chat completions",
"providerType": "OPENAI",
"endpointUrl": "https://api.openai.com/v1",
"apiPath": "/chat/completions",
"modelIdentifier": "gpt-4-turbo-preview",
"supportedModalities": [
"TEXT"
],
"labels": "{\"environment\": \"production\", \"team\": \"ai\"}",
"version": "1.0.0",
"monitoringEndpoint": "https://monitoring.example.com/llms/status",
"capabilities": {
"supportsChat": "true",
"supportsCompletion": "true",
"supportsFunctionCalling": "true",
"supportsSystemMessages": "true",
"supportsStreaming": "true",
"supportsSamplingParameters": "true"
},
"defaultSamplingParams": {
"maxTokens": "2048",
"temperature": "0.7",
"topP": "0.9",
"topK": "50",
"frequencyPenalty": "0.0",
"presencePenalty": "0.0",
"stopSequences": "[\"\\n\\n\", \"END\"]"
},
"maxContextLength": "32768",
"clientConfig": {
"property1": {},
"property2": {}
},
"ownerId": "550e8400-e29b-41d4-a716-446655440000",
"createdAt": "1617293472000",
"updatedAt": "1617293472000",
"createdById": "550e8400-e29b-41d4-a716-446655440000",
"updatedById": "550e8400-e29b-41d4-a716-446655440000"
}
]
}