AIGatewayModelConfig
objectRouting, logging, and load balancing configuration for the model.
Configuration for an AI Gateway route.
Show Child Parameters
Configuration for AI Gateway logging.
Show Child Parameters
Allowed values:allowalwaysdeny
Default:allow
Default:1048576
Show Child Parameters
Load balancing strategy when multiple target models are configured.
Show Child Parameters
AIGatewayEmbeddingsModelConfig
Configuration for an embeddings model.
One OfThe name of the embeddings model.
The URL of the embeddings model.
Allowed values:azure
The Azure deployment ID for the model.
The Azure OpenAI API version to use.
Default:2023-05-15
AIGatewayAzureEmbeddingsModelConfig
objectAzure-specific configuration for a model.
The name of the embeddings model.
The URL of the embeddings model.
Allowed values:azure
The Azure deployment ID for the model.
The Azure OpenAI API version to use.
Default:2023-05-15
AIGatewayBedrockEmbeddingsModelConfig
objectAWS Bedrock-specific configuration for a model.
The name of the embeddings model.
The URL of the embeddings model.
Allowed values:bedrock
S3 bucket prefix for batch inference jobs.
Whether to normalize embedding vectors in the response.
Default:false
Latency performance configuration for the model invocation.
S3 URI for storing video generation outputs.
AIGatewayGeminiEmbeddingsModelConfig
objectGoogle Gemini-specific configuration for a model.
The name of the embeddings model.
The URL of the embeddings model.
Allowed values:gemini
The Google Cloud location ID for the model endpoint.
The custom API endpoint for the Gemini model.