Syntax
llmGateway:
'$ref': <string>
apiKey: <string>
chatCompletions: {}
claude: {}
google: {}
jdbcAiApiUsageStore: {}
openai: {}
policies: {}
simpleStore: {}
systemPrompt: {}
llmGateway:
'$ref': <string>
apiKey: <string>
chatCompletions: {}
claude: {}
google: {}
jdbcAiApiUsageStore: {}
openai: {}
policies: {}
simpleStore: {}
systemPrompt: {}
Attributes
| Name | Required | Default | Description | Examples |
|---|---|---|---|---|
| $ref | false | - | Reference a component defined under components. | - |
| apiKey | false | - | API key for the LLM provider. Specify here the API key from OpenAI or Anthropic. | - |
Child Structure
| Element | Cardinality | Description |
|---|---|---|
| chatCompletions | 0..1 | OpenAI Chat Completions API compatible provider. Can be used for the following providers: |
| claude | 0..1 | (Experimental) Anthroic Claude provider configuration Use to configure a LLM gateway to use the anthropic API |
| 0..1 | (Experimental)Google AI provider configuration Use to configure a LLM gateway to use the Google LLM API | |
| jdbcAiApiUsageStore | 0..1 | Stores AI API usage in a database (experimental). |
| openai | 0..1 | OpenAI provider configuration Use to configure a LLM gateway to use the OpenAI API |
| policies | 0..1 | LLM Gateway policies for token usage and model restrictions. |
| simpleStore | 0..1 | Simple store for the LLM Gateway that stores limits in memory. Users and keys can be configured in the configuration file. |
| systemPrompt | 0..1 | When used with older chat completions API the instruction is converted to a system message like: "system": "You are a helpful assistant." |