---
title: "AIGatewayTargetModelHuggingfaceConfig"
url: "https://nov18-dev.movespot.fyi/apis/konnect-ai-gateway-dev-0/versions/eaabd2fa-a9d5-44cc-b086-e210c9c21bf3/schemas/AIGatewayTargetModelHuggingfaceConfig"
---

> Full API specification: https://nov18-dev.movespot.fyi/apis/konnect-ai-gateway-dev-0/versions/eaabd2fa-a9d5-44cc-b086-e210c9c21bf3.md

# AIGatewayTargetModelHuggingfaceConfig

Hugging Face-specific configuration for a model.

## OpenAPI definition

```yaml
openapi: 3.0.0
info:
  title: Konnect AI Gateway
  version: 0.0.0
servers:
  - url: https://us.api.konghq.com/v1
    description: United-States Production region
  - url: https://eu.api.konghq.com/v1
    description: Europe Production region
  - url: https://au.api.konghq.com/v1
    description: Australia Production region
  - url: https://me.api.konghq.com/v1
    description: Middle-East Production region
  - url: https://in.api.konghq.com/v1
    description: India Production region
  - url: https://sg.api.konghq.com/v1
    description: Singapore Production region
components:
  schemas:
    AIGatewayTargetModelHuggingfaceConfig:
      description: Hugging Face-specific configuration for a model.
      type: object
      properties:
        embeddings_dimensions:
          description: The number of dimensions for embedding outputs.
          type: integer
        max_tokens:
          description: The maximum number of tokens to generate in the response.
          type: integer
        input_cost:
          description: Cost per input token for billing and cost tracking.
          type: number
        output_cost:
          description: Cost per output token for billing and cost tracking.
          type: number
        temperature:
          description: Controls randomness in the model output. Higher values produce more
            varied responses.
          type: number
        top_k:
          description: Limits the number of highest-probability tokens considered during
            generation.
          type: integer
        top_p:
          description: Nucleus sampling probability mass. Tokens with cumulative
            probability up to top_p are considered.
          type: number
        upstream_url:
          description: The upstream URL for the model endpoint.
          type: string
          format: uri
        type:
          type: string
          enum:
            - huggingface
        use_cache:
          description: Whether to use the Hugging Face inference cache.
          type: boolean
          default: false
        wait_for_model:
          description: Whether to wait for the model to load if it is not ready.
          type: boolean
          default: false
      additionalProperties: false
      required:
        - type
```
