AIGatewayEmbeddingsModelConfig

Configuration for an embeddings model.

One Of
namestringrequired

The name of the embeddings model.

upstream_urlstringrequired

The URL of the embeddings model.

typestringrequired

Allowed values:azure

deployment_idstring

The Azure deployment ID for the model.

api_versionstring

The Azure OpenAI API version to use.

Default:2023-05-15

Example

AIGatewayAzureEmbeddingsModelConfig

object

Azure-specific configuration for a model.

* Additional properties are NOT allowed.
namestringrequired

The name of the embeddings model.

upstream_urlstringrequired

The URL of the embeddings model.

typestringrequired

Allowed values:azure

deployment_idstring

The Azure deployment ID for the model.

api_versionstring

The Azure OpenAI API version to use.

Default:2023-05-15

Example

AIGatewayBedrockEmbeddingsModelConfig

object

AWS Bedrock-specific configuration for a model.

* Additional properties are NOT allowed.
namestringrequired

The name of the embeddings model.

upstream_urlstringrequired

The URL of the embeddings model.

typestringrequired

Allowed values:bedrock

batch_bucket_prefixstring

S3 bucket prefix for batch inference jobs.

embeddings_normalizeboolean

Whether to normalize embedding vectors in the response.

Default:false

performance_config_latencystring

Latency performance configuration for the model invocation.

video_output_s3_uristring

S3 URI for storing video generation outputs.

Example

AIGatewayGeminiEmbeddingsModelConfig

object

Google Gemini-specific configuration for a model.

* Additional properties are NOT allowed.
namestringrequired

The name of the embeddings model.

upstream_urlstringrequired

The URL of the embeddings model.

typestringrequired

Allowed values:gemini

location_idstring

The Google Cloud location ID for the model endpoint.

api_endpointstring

The custom API endpoint for the Gemini model.

Example

AIGatewayHuggingfaceEmbeddingsModelConfig

object

Hugging Face-specific configuration for a model.

* Additional properties are NOT allowed.
namestringrequired

The name of the embeddings model.

upstream_urlstringrequired

The URL of the embeddings model.

typestringrequired

Allowed values:huggingface

use_cacheboolean

Whether to use the Hugging Face inference cache.

Default:false

wait_for_modelboolean

Whether to wait for the model to load if it is not ready.

Default:false

Example