Nvidia L4

1x GPU · 24 GB 7x vCPUs · 30 GB

$0.8 / h

Catalog Recipe Pre-selected hardware for the current recipe.

Private Public HF Auth.

Only you can access your endpoint, using a Hugging Face Token generated from your personal account.

Automatic Scale-to-Zero

Number of replicas

Min Max

More options

Daily Autoscaling Schedule

Autoscaling Strategy

Hardware Usage Pending Requests

Hardware Utilization Threshold (%)

A scale up event will be triggered if the average hardware utilization (%) exceeds this threshold for more than 20 seconds.

This Catalog Recipe comes with a pre-configured Default engine.

Server Arguments

optional

Server Command

optional

Default Env values come from the Catalog Recipe and can't be edited during Endpoint creation.

Default Env

Secret Env

VPC Config

Use AWS PrivateLink

whisper-large-v3