AIGatewayProviderVllm

object

Configuration for an upstream LLM provider.

* Additional properties are NOT allowed.
typestringrequired

Allowed values:vllm

display_namestringrequired

The display name for this provider instance.

Example:Azure AI SE

refstringrequired

A user-defined unique identifier for this provider instance, used as a stable human-readable reference.

Example:azure-ai-se

labelsobject

Public labels store information about an entity that can be used for filtering a list of objects.

Public labels are intended to store PUBLIC metadata.

Keys must be of length 1-63 characters, and cannot start with “kong”, “konnect”, “mesh”, “kic”, or “_”.

Example:{"category":"finance"}

managed_byobject

Indicates the managing entities for a resource. A maximum of 5 keys is allowed.

Keys must be 63 characters or less, starting and ending with an alphanumeric character,
and may include dashes (-), underscores (_), and dots (.).

Values must be non-empty strings of 127 characters or less.

Keys and values must not contain spaces or control characters, and are case-insensitive.

Example:{"team":"platform","owner":"kong"}

configobjectrequired

Configuration for the provider.

* Additional properties are NOT allowed.
Show Child Parameters
Example

AIGatewayProviderXai

object

Configuration for an upstream LLM provider.

* Additional properties are NOT allowed.
typestringrequired

Allowed values:xai

display_namestringrequired

The display name for this provider instance.

Example:Azure AI SE

refstringrequired

A user-defined unique identifier for this provider instance, used as a stable human-readable reference.

Example:azure-ai-se

labelsobject

Public labels store information about an entity that can be used for filtering a list of objects.

Public labels are intended to store PUBLIC metadata.

Keys must be of length 1-63 characters, and cannot start with “kong”, “konnect”, “mesh”, “kic”, or “_”.

Example:{"category":"finance"}

managed_byobject

Indicates the managing entities for a resource. A maximum of 5 keys is allowed.

Keys must be 63 characters or less, starting and ending with an alphanumeric character,
and may include dashes (-), underscores (_), and dots (.).

Values must be non-empty strings of 127 characters or less.

Keys and values must not contain spaces or control characters, and are case-insensitive.

Example:{"team":"platform","owner":"kong"}

configobjectrequired

Configuration for the provider.

* Additional properties are NOT allowed.
Show Child Parameters
Example

AIGatewayProviderConfigAuthBasic

object

Basic auth config for an upstream LLM provider.

* Additional properties are NOT allowed.
typestringrequired

Allowed values:basic

headersarray[object]

<= 1 items

* Additional properties are NOT allowed.
Show Child Parameters
paramsarray[object]

<= 1 items

* Additional properties are NOT allowed.
Show Child Parameters
Example

AIGatewayProviderBedrock

object

Config for AWS LLM provider.

* Additional properties are NOT allowed.
typestringrequired

Allowed values:bedrock

display_namestringrequired

The display name for this provider instance.

Example:Azure AI SE

refstringrequired

A user-defined unique identifier for this provider instance, used as a stable human-readable reference.

Example:azure-ai-se

labelsobject

Public labels store information about an entity that can be used for filtering a list of objects.

Public labels are intended to store PUBLIC metadata.

Keys must be of length 1-63 characters, and cannot start with “kong”, “konnect”, “mesh”, “kic”, or “_”.

Example:{"category":"finance"}

managed_byobject

Indicates the managing entities for a resource. A maximum of 5 keys is allowed.

Keys must be 63 characters or less, starting and ending with an alphanumeric character,
and may include dashes (-), underscores (_), and dots (.).

Values must be non-empty strings of 127 characters or less.

Keys and values must not contain spaces or control characters, and are case-insensitive.

Example:{"team":"platform","owner":"kong"}

configobjectrequired
* Additional properties are NOT allowed.
Show Child Parameters
Example

AIGatewayProviderConfigAuthAWS

object

Configuration for AWS LLM provider.

* Additional properties are NOT allowed.
typestringrequired

Allowed values:aws

access_key_idstring
secret_access_keystring
assume_role_arnstring
role_session_namestring
sts_endpoint_urlstring
batch_role_arnstring
Example